An Interactive System to Control a Humanoid Robot using Vision and Voice

Human-Robot Interaction (HRI) can improve a system effectiveness if implemented properly. This project presents an HRI interactive system to control a humanoid robot using vision and voice. The proposed system is aimed to ease the difficulty of controlling a robot as well as create an effective vision and voice system. The vision system is implemented in the form of a color-based object tracking system on the robot head while the voice-controlled system is implemented in the form of limb movement control through voice commands. As a result, they achieve an average accuracy of 84% and 84.29% respectively. The robot head and limb movement also achieve a maximum average error of 2° and 2.11° only. Finally, the voice-controlled system has an average response time of 1.73s. Possible future enhancements include considering other feature in the object tracking system such as texture and noise filtering on the voice recognition to improve their accuracy.