In this paper,the recognition and tracking of infrared images are presented.Since the design of the hardware structure of a real time image signal processor is modularized,it can be used to implement background clutter suppression,target characteristic analysis,identification and classification of threats,selection of main tracking targets and tracking and forecasting of targets.Its target tracking precision is improved.