A Simple Approach for Scripting in Air and Display using Computer Vision

Abstract

Online teaching-learning platforms have become an integral part of life, during and post Covid-19 pandemic. In this regard, many teaching-learning accessories have been developed for use. AirPad, the work presented in this article is an application that helps draw one’s imagination on screen by just capturing the motion of object of interest with a camera in air. Computer vision is concerned with the extraction of meaningful information from image data. Continued explorations on computer vision are often concerned with the development of computer algorithms for specific applications. Computer vision is a field of artificial intelligence that works on enabling computers to see, identify and process images in the same way as human vision does, and then provide the appropriate output. Three important tasks involved during computer vision processing are: 1) Detection 2) Tracking 3) Recognition. Computer vision algorithms are utilized to perform the task. The preferred language used is Python due to its exhaustive libraries and easy to use syntax, but can be implemented in any OpenCV supported language. Present work uses PyQt5 which is a python interface for Qt library. It is one of the most used modules in building GUI apps in Python, and that’s due to its simplicity. Following features have been implemented in the present work: i. Functions to draw square, rectangle and circle. ii. Testing Tab to ensure proper traction of object of interest in each frame. iii. Export the work in multiple formats like images and pdf. The user requires a laptop with webcam and a virtual pen which could be a finger to use the application and enjoy its features.