Person Identification Using Face and Speech Recognition for Visually Challenged with Mask Detection

Abstract

A system and method for facilitating a visually impaired person for identifying a person. The method includes the step of storing a plurality of instructions for facilitating the visually impaired person identify the person in front of them by their face and/or voice characteristics by updating our project with Mask Detection using OpenCv and keras. It includes the step of receiving voice signals from the person present in surrounding of the visually impaired person and includes the step of capturing the pictures of a particular person and their surroundings of the visually impaired person and storing the processed data into the database or any storage devices. The data will be processed to AWS server or any local storage for processing and determining the person with the help of the database we already have. After processing and identifying the person with the help of face and voice recognition modules the name is sent to the visually impaired user’s phone in the form of a text message which will be read aloud by his phone’s virtual assistant.