Development of a Learning-aid tool using Hand Gesture Based Human Computer Interaction System

Abstract

A hand gesture recognition system is a natural and simple way of communicating in today’s world. The development of teaching methods by using technology-dependent useful items to increase communication and interaction between the teacher and the student is a major part of today’s e-learning. In this paper, we have proposed an interactive learning-aid tool based on a vision-based hand gesture recognition system. The system uses MediaPipe for hand gesture recognition. The recognized hand gestures use a virtual-mouse-based object controlling system to control various virtual objects created using Unity. The system has been tested using six hand gestures and it is found that the system can be used effectively for controlling various virtual objects.