Speech recognition and Filipino sign language E-tutor system: an assistive multimodal learning approach

Abstract

Speech recognition technology facilitates student learning. It has potential benefits for students with physical disabilities and the technology has been implemented in the classroom over the years in order to learn in a more efficient way. This study provides deaf students with various methods of studying, learning, and remembering new information. Aside from speech-to-text, the developed system is also provided with speech-to-visual approach, which represents information associated with objects. Also, Filipino Sign Language was used utilize as an alternative way of presenting Statistics lessons included in K-12 curriculum. Practical real world approach in presenting Statistics lessons are used to enhance delivery in face to face class se-up or in self-phasing learning. These multiple learning strategies were combined together to have a balance approach for a greater practice and recall will be more successful, especially for the target users. From the initial results, this research showed a significant advantage of using speech recognition and Filipino Sign Language in learning basic Statistics lessons compared from the traditional method.