With the development of fiber grating sensing and the increasing demand of vibration testing technology, the research on fiber grating vibration sensor has been carried out rapidly. In this paper, the principle of the fiber Bragg grating (FBG) based vibration sensor is introduced. In addition, the research on FBG vibration sensor in recent years is summed up in terms of different structural types, with emphasis on the cantilever beam and diaphragm structure. The advantages and disadvantages of different fiber grating packaging methods of the same structure type are expounded. Based on the research and analysis, four factors are proposed to optimize the performance of the FBG vibration sensor. Finally, the development of the FBG vibration sensor is prospected.