Corpus approach to research the structure of homovisemes in Russian oral speech and their visual perception

Abstract

In the article, we investigate how a person visually perceives and distinguishes words in oral speech with similar articulation patterns (homovisemes) from the speaker's lips. These words are defined by the term "homovisemes" introduced by the authors. To carry out our research, we have developed a corpus of homovisemes based on prepared material. This material is grouped into separate chains according to the principle of identical articulatory shells of words, with the exception of pseudowords. If such words are interchangeable, a person visually perceives them differently. The purpose of this research is to analyze if it is possible and expedient to use the homovisemes corpus to solve certain difficulties in how we learn to read from lips. In the article, we consider the main advantages of the corpus approach to this study. We present examples of possible variants of recognized words with similar visemes based on the content of the developed corpus. Our results allow us to conclude on how relevant the chosen topic is. The results will help us to predict uncertainty when choosing the right value. Work in this area will provide new results, create useful applications, and help people with hearing disabilities – an important social task.