Multi-sensors Based 3D Gesture Recognition and Interaction in Virtual Block Game

Human-computer interaction, especially gesturebased interactive technology, plays an important role in virtual reality scenarios. Currently, gesture-based interactive technology mostly uses a single sensor, such as data gloves or Kinect. When using single data gloves, some have the problem of lacking hand displacement information. When using single Kinect, it can't be real-time and intuitive to show the changes in gestures. And when the gestures are blocked, the gesture recognition rate drops. Therefore, multi-sensors based 3D gesture recognition and interaction method is proposed. To achieve the 3D gesture visualization, tracking and recognition. Experiments show the effectiveness of the proposed method. It can overcome the shortcomings of a single sensor.