In an air-to-air missile, the amount of the data to be processed by the infrared imaging system is too large for real-time processing. To address this problem, a high-speed infrared image data acquisition system based on RapidIO and PCI-Express is presented. The design of a key modular image acquisition card which uses the XMC base plate and XMC interface board of a high-speed serial bus as its frame structure is discussed emphatically. The system not only has a dual channel data acquisition function, but also has a dual channel data broadcast function. Each channel has a data acquisition rate up to 1.2 Gbps and a code rate in the range 0 M to 400 M. The system can implement the real-time acquisition and display of high frame rate infrared images.