Companion bot with voice and facial emotion detection with PID based computer vision

Abstract We live in a world where technology embraces us and makes our lives easier. With increasing technological advances we feel the need for smart robotic assistants/companions to reduce the manual efforts taken by humans in day-to-day tasks and providing the necessary knowledge. In this paper, we develop a smart self companion robot that runs using human voice commands using some standard way of speech and this voice is converted into standard text form which is, in turn, converted into instructions and is fed to the robot, which further performs the necessary actions. The companion is fully automated with the capability of movement based on object tracking and voice response based on facial expression. The three main modules of this work are facial detection, emotion detection, and voice recognition. The bot is a wireless vehicle that will move along the human, interact with them depending on his/their emotions.