Real-Time Static and Dynamic Gesture Recognition Using Mixed Space Features for 3D Virtual World's Interactions

Abstract

Gesture Recognition is a technology that makes devices such as a computer capable of recognizing and responding to different gestures produced by the human body. With the recent growth of 3D virtual world applications, the demand to improve the gesture recognition method, especially hand gesture recognition, has increased. In this paper, we propose a novel vision-based gesture recognition system for controlling the 3D virtual world based on depth images obtained from the 3D camera device. For the proposed system, we used mix spatial space features consisting of 3D and 2D space features. The finger position in the point cloud represents the 3D space feature and the contour of hand from the images as 2D space feature. To investigate the robustness of our system, we designed 9 gestures including 6 static and 3 dynamic varieties. During experiments, we instruct people to display those gestures and calculate the recognition rate. Our results demonstrate that the proposed system was able to recognize the 9 gestures very well with the average accuracy of 95% for static gestures and 81.34% for dynamic ones.