Gesture based 3D man-machine interaction using a single camera

Abstract

This paper describes a new gesture based input interface system that allows users to control both 2D and 3D applications using simple hand gestures. Using a single camera attached to the computer, the system tracks the user's hand in three dimensions and computes up to four parameters in real-time (60 Hz). The system recognizes three gestures that can be interpreted as discrete commands to applications. This system is an off-shoot of an earlier system called Gesture VR that requires multiple cameras. Since the new system uses a single video source it can run readily on a standard home computer equipped with an inexpensive camera and is, therefore, accessible to most users. The system can be used with applications that require 2D and 2D interactions. Examples discussed in this paper include 3D virtual fly-throughs, graphical scene composers and video games.