A systematic computerized training program for using Sensory Substitution Devices in real-life

Abstract

In the past decades, Sensory Substitution Devices (SSDs) have been widely used as a research tool to unravel the properties of the sensory brain. Although their rehabilitation potential is repeatedly demonstrated, SSDs were never widely adopted by blind individuals in everyday life, except for a few super-users’ cases. One reason explaining this gap is the lack of structured SSD training programs for everyday use. We thus developed an ambitious computerized SSD training program using the EyeMusic visual-to-auditory SSD and gathered 10 blind participants to test its efficiency. Participants were trained to identify pictures of real objects from different categories (e.g., furniture). For each category, we tested the performance of participants before training and again after 10 hours of dedicated training. The test included both trained and untrained stimuli. The 10 hours training program involved a combination of static stimuli and dynamic computer games and was individually adapted to participants’ learning pace. Initial results show that after training, participants achieved significantly higher accuracy rates in object recognition compared to baseline for trained and most importantly, for untrained objects from the same category. This further supports the suitability of SSDs in everyday life, and thus propels their adoption for this purpose.