Based on the techniques of three levels classification and dynamic scene analysis, the prototype multi-target recognition and tracking system can not only segment faint moving targets from slowly varying background, but also track moving multi-target, predict impending occlusion, reacquire and track targets which wander in and out of the field of view. The system has high percentage of correct identification, and performs real-time processing. The processing rate of target classification is 10 frame/second.