Infrared astronomy, capable of penetrating dust extinction, detecting cold and warm matter, identifying molecular vibrational and rotational spectral lines, and observing rest-frame ultraviolet and optical emission redshifted from the early universe, is one of the most technologically dependent and scientifically rewarding observational fields in modern astrophysics. This paper takes the evolution of infrared detector technology as its main thread, reviews the development of infrared astronomy from single-element detectors and few-pixel scanning surveys to small-format arrays for imaging and spectroscopic diagnostics, and then to large-format arrays, cryogenic space observatories, and highly stable space platforms, and explains how the synergistic breakthroughs in detectors, cryogenic systems, telescope platforms, and observation strategies have continuously opened new infrared windows on the universe. The paper further summarizes the current major frontiers in infrared astronomy, including extremely high-redshift galaxies and cosmic reionization, exoplanet atmospheres and habitability, the Galactic-center supermassive black hole, and kilonova observations in multi-messenger astronomy. It also analyzes the specific requirements of these scientific questions on array format, dark current, read noise, quantum efficiency, response uniformity, temporal stability, and spatial adaptability of infrared detectors. From the perspective of China, this paper discusses the current development status of domestic infrared astronomical observation facilities and infrared detector technology. It points out that China possesses significant development potential in high-quality sites such as Lenghu, follow-up observations of the Chinese Space-station Survey Telescope (CSST) and ground-based spectroscopic surveys, the Antarctic near-infrared time-domain survey, suborbital and near-space platforms, and the engineering foundation for infrared detectors. However, significant gaps remain in astronomical-grade large-format low-noise detectors, cryogenic infrared instruments, mid- and far-infrared detectors, space-based validation platforms, and long-term calibration loops. Finally, this paper proposes that Chinese infrared astronomy should be guided by distinctive scientific objectives to drive detector performance, starting with ground-based near-infrared instruments, the Antarctic infrared time-domain survey, suborbital instrument verification, and small space-based infrared missions, gradually forming a closed-loop system of "scientific needs–detector development–instrument integration–astronomical observation–calibration feedback". Establishing autonomous infrared detectors and cryogenic observing systems will be essential for China to move from being a user of infrared data to becoming an active pioneer of new infrared windows on the universe.