Gesture recognition system for surgical robot's manipulation

Abstract

This paper presents a newfangled gesture recognition system for handling two surgical robots in a virtual simulator. The two robots are designed to perform laparoscopy, in order to provide a basis for a surgical trainer. Originally the system is commanded by a joystick, but the inclusion of the new Leap Motion device allows the simulator to be handled by the gestures of the user's hands, which makes it more natural in its management. This device uses infrared signal processing to determine the position and orientation of the objects that are above him and promises to improve the user experience and the usability of 3d applications using natural interfaces instead of mechanical devices.