An improved multiple hypothesis tracking(MHT) algorithm and its application in infrared target tracking systems are presented. According to the characteristic of infrared target, the system firstly employs adaptive spatial preprocessing, then takes advantage of the improved MHT algorithm to recognize and track target. The pipeline hardware architecture is constructed based on 4 DSPs to implement the algorithm and acquires excellent result.