Adapting the SoundThimble Movement Sonification System for Young Motion-impaired Users

SoundThimble is an interactive sound installation which uses motion capture and machine learning to establish relationships between human movement and virtual objects in 3D space. This paper documents the strategy for adapting this system for interacting with children with physical and cognitive impairments. Starting from a specific child subject, we show how the hardware, software and interaction design can be modified, with the view of generalising to a wider range of young disabled users. The project’s ultimate goal is threefold: inclusion, entertainment, and rehabilitation.