Abstract: Aiming at the shortage of video data processing ability by traditional DSP, this paper takes the TI's heterogeneous multi-core processor TMS320DM8168 as the center, designs a set of embedded video surveillance system, make a detailed presentation of video processing framework and propose a program of dynamic switchable algorithm in the DSP core.Finally, realizes the camera tamper detection and motion detection for the application of Intelligent Surveillance.