Abstract: Research the object image accurately tracking problem.This article mainly aims at the traditional target tracking algorithm for video image complexity, while movement mutation existence, making movement between relevance is substantially reduced, tracking results appear larger deviation, it is difficult to accurately track the video image, proposes a kind of particle filter optimization of image frames for visual tracking of new technologies.The algorithm introduced random motion mutations affecting the operator, in the motion estimation process as the penalty factor, at the same time using particle filter visual target sample video image, so as to obtain the real time tracking.The experimental results show that the method proposed in this paper, to avoid the traditional tracking algorithm for delay, can accurate real-time positioning objects.