To achieve the spectral imaging of an object in a large field of view, the technology path which combines a two-dimensional pointing mirror with a staring spectrometer is usually used. However, when the two-dimensional pointing mirror is used to image close objects, the image rotation and distortion generated at different azimuths and pitch angles are different. Therefore, it is necessary to establish an optical transfer model among the actual object coordinate system, the detector image coordinate system and the azimuth and pitching angle firstly. According to the optical transfer model, the transformation relationship between the transmission distortion image and the real image can be obtained. Then, after the transmission distortion image is corrected by perspective transmission, image stitching can be implemented on the large field-of-view image. The experimental results show that the method is feasible, easily implemented and stable.