A moving object detection method in video sequence was proposed, which is considered a fixed camera model. Firstly, a new method was presented for detection of changes of motion. After the change detection, the recursive higher order mothod was used to extract the change from the Gaussian noise. Compared with the classical higher order statistics method, the recursive higher order statistics method uses the former n images information, so it can obtain better estimates of HOS to reduce the effect of additive noise and detect the small object and perform well on segmetation.