Hand Talk-Implementation of a Gesture Recognizing Glove

Abstract

We present our prototype for a gesture recognizing glove (data glove). We use low cost packaging material (velostat) for making piezoresistive sensors. These flex sensors detect a bend in fingers and we map this data to a character set by implementing a Minimum Mean Square Error machine learning algorithm. The recognized character is transmitted via Bluetooth, to an Android phone, which performs a text to speech conversion. Our motivation for Hand Talk is to compare hand configurations with sign language charts and generate artificial speech which articulates the gestured words. This technology also has further applications as a 3D mouse, virtual keyboard, control for precision control of robotic arms.