A procedure of detecting man-made objects in natural background from the infrared and visible images was presented, in which the fractal structure was employed to model natural background, and the intrinsic difference in fractal characters between manmade objects and natural background was used to identify man-made objects. The methods of adaptive enhancement for fractal features and image detection were also discussed.Some experimental results for practical images were presented to show the effect of the procedure.