The spectral characteristics of architectural materials covered by different paints were analyzed. Experiment and study show that the changes of spectral characteristics are highly relevant to the paint color and its thickness for different wood and metal plates. Spectral characteristics in short-wave infrared range is least affected by the external paint and can be used to distinguish different materials under the paint. The experimental process and the data qualities are also evaluated. This study is significant for the application of hyperspectral remote sensing in detecting the man-made objects and military camouflage materials.