Abstract: Due to the bad real-time, resource underutilizations and hard to design properties of the classical digital signal processor based image processing system, a new image tracking high-peed processing system is presented. In this system, the FPGA is used as the core processor, and the fast median filtering is used to implement the image preprocessing. Finally, the image real-time point target tracking is realized by the combination of the mean absolute differences and the FPGA high-speed parallel processing. The system test validates the system has the advantages of good real-time, the effect on tracking and resource utilization rates, which meets the design requirements.