Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images

Abstract

In view of the needs of applications such as human-computer interaction(HCI) systems and virtual reality(VR) systems, the study on theories and methods of 3D gesture tracking has become one of the hot issues with widespread concern at home and abroad.In recent years, the 3D gesture tracking algorithms based on computer vision develop rapidly.Among them, the more economical and ubiquitous monocular RGB camera has the most potential.It is an important tool and way for 3D gesture tracking applications to take into reality, which has been focused by researchers.In order to comprehend the development status of gesture tracking algorithms, and assist researchers in this field to conduct more deep-going explorations, firstly, in comparison with the traditional methods, this paper introduces the 3D gesture tracking algorithms based on monocular RGB image, and divides it into three categories:discriminative methods, generative methods and hybrid methods, and summarizes the corresponding advantages and disadvantages.Secondly, the influence of RGB image characteristics on 3D gesture tracking is discussed, and the methods to alleviate the depth ambiguity of the image are generalized.Thirdly, according to the classification, the representative algorithms with RGB as input data are emphatically analyzed, and the specific superiority and weaknesses of related algorithms are compared through visualized performance evaluation index.Finally, the problems faced with the current 3D gesture tracking algorithms are summarized and the future development is prospected.

Keywords

• human-computer interaction|virtual reality|rgb image|3d gesture tracking|computer vision