Pushed by Sound: Effects of Sound and Movement Direction on Body Perception, Experience Quality, and Exercise Support

Abstract

Wearables integrating movement sonification can support body-perception changes and relatedly physical activity; yet, we lack design principles for such sonifications. Through two mixed-methods studies, we investigate sound pitch and movement direction interaction effects on self-perception during squats exercises. We measured effects on body-perception, affective quality of the experience, actual and perceived movement, and compared them to two control conditions: no-sound and vibrotactile feedback. Results show that regardless of movement direction, ascending pitch enhances several body feelings and overall experience quality, while descending pitch increases movement acceleration. These effects were moderated by exercise physical demand. Sound and vibrotactile feedback enhanced flexibility and strength feelings respectively and contributed to exercise completion in different ways. Sound was perceived as an internal-to-body force while vibrotactile feedback as an external-to-body force. Feedback effects were stronger in people with lower fitness levels. We discuss results in terms of malleability of body-perceptions and highlight opportunities to support demanding physical activity through wearable devices.