The effect of different visual feedback interfaces of music training games on speech rehabilitation in hearing-impaired children: An fNIRS study

Singing plays a critical role in enhancing musicality, sound discrimination, and attention, and proves advantageous for speech rehabilitation in children with hearing impairments. Computer-based training games are well-suited to the learning behaviors of children, with substantial evidence suggesting that music training augments speech training capabilities in this demographic. Despite this, there is a lack of detailed exploration into the design of interactive online music training interfaces tailored for these needs. This study investigates brain activation changes using two visual feedback singing games, analyzed through functional near-infrared spectroscopy: a serious game (SG) and an entertainment game (EG) with visually enhanced feedback. It also assesses the efficacy of home-based music training software for speech rehabilitation.

Methods involved recording oxygenated hemoglobin concentration (Delta [HbO]) signals from the prefrontal cortex, motor cortex, occipital lobe, and temporal lobe in 21 children (average age: 9.3 ± 1.9 years) during two singing interface experiments. Subjects also completed the Intrinsic Motivation Inventory (IMI) questionnaire post-experiment.

Main results showed that brain regions, particularly the temporal lobe, exhibited stronger and more pronounced activation signals with the SG interface compared to the EG, suggesting that SG is more effective for speech system rehabilitation. The Intrinsic Motivation Scale results revealed higher acceptability for SG than for EG. This study provides insights into designing online speech rehabilitation products for children with hearing impairment, advocating for better interactive training methods from a neuroscience perspective.