Vietnamese sign language reader using Intel Creative Senz3D

Abstract

This paper describes a computer based system that utilizes a 3D sensor to bridge the communication barrier between hearing (and/or speech) impaired people and hearing ones. The proposed Vietnamese sign language reader successfully recognizes 28 static and 7 dynamic gestures taken from the Vietnam sign language dictionary. To recognize the gestures of a static type, various techniques have been deployed, such as Gabor Filtering, Fisher's Discriminant Analysis and Cosine Metric Distance method. The proposed technique achieves a good result with 93.89% accuracy and speed of 14 frames per second. Recognition of the dynamic gestures is based on the $1 Recognizer algorithm providing quite a good accuracy with 97.14% of accurate recognition with real-time running at 15 frames per second.