Three-dimensional gesture interactive system design of home automation for physically handicapped people

Abstract

In this paper, we propose a three-dimensional gesture interactive system design of home automation for physically handicapped people. In order to provide a convenient and comfortable environment, we design a finger and hand gesture user interface for physically handicapped people based on stereo cameras to achieve remote control and gesture recognition system. We use stereo camera to capture stereo image and calculate disparity map and depth map for supplying physically handicapped people a real-time interface based on hand gesture and finger action. The system can achieve 93% accuracy of eight direction function, 93.75% accuracy of zoom function, and 90% accuracy of click function. The experimental results prove the efficiency of the proposed system.