Visual and Auditory Assistant for people with various cognitive impairments

Abstract

The recent survey presents the increase in people with cognitive impairment and disorders related to the same. The current project aims to reduce the distress and impairment in social and academic functioning caused by the symptoms of various disorders such as dyslexia, dysgraphia, dysphasia, visual processing orders, and others, by adopting a model that tackles difficulties associated with various cognitive capacities as well as auditory and visual impairments. The first section of the three-phase mobile application converts the input image of scripts to concise, visual representations alongside a speech assistant that restates the summarized version of the text. The second phase has been designed to assist people with difficulties in grasping long audio notes, by converting them into a set of intuitive visual representations with speed and volume regulated speech assistant. Furthermore, the model has been extended to creating a tutorial environment on the app to improve the syntactic spelling of general words in the English language for people with dyslexia. Intending to cater to the needs of the user with all three sections in a single cross-platform application, we believe that we were successful in creating the assistant as envisioned. The appropriate usability of the app for the target audience presented above shall mark the success of the app as well as the AI community working for years in this field.