A new method of segmenting head and shoulder object was presented by using the bi motion model, which is better in describing such objects' motion than single motion model. An algorithm was developed to estimate the model parameter and implemented in an semi automatic segmentation system. The simulated result reveals that the segmentation system using the authors' bi motion model can segment head and shoulder object more accurately.