A high speed recognition system of plane infrared image used for missile was presented. Base on the neighborhood parallel theory, this system was adopted by parallel processing structure with multi processor, and combined parallel inputting, parallel processing, parallel storing. The neighborhood image processor was used for the frame processing of the long distance image, the recognition of the target and the state of the missile target engagement could be realized. The large scale parallel digital circuit with the one detector to one processor structure was used for the near distance image, the recognition of the part of plane could be realized. This system can meet the need of real time recognition during the high speed engaging of missile and target.