A new method for small target detection of IR guard system was investigated. According to the environmental characteristics of low contrast, small size, continuously moving target, and the complex background scene, the symmetry difference operation was done in the three frames of image sequences to guarantee the probability of target detecting and probability of false alarming required by the system and real time implementation of hardwares. The software and hardware implementing principle of this algorithm was offered, and the analysis of real time processing was given.