Investigating crossmodal correspondences between vibrotactile stimuli, colour, and emotions

Abstract

There is an increasing interest in Human–computer Interaction in multisensory interactive systems, creating a need to deepen our understanding of how multiple sensory modalities relate to and affect each other. We extend prior research on crossmodal correspondences by investigating colour and emotional associations with pure vibrotactile stimuli. We asked 32 participants to assign colour properties (hue and brightness) and emotional categories (pleasure, arousal, and dominance) to stimuli of varying amplitude and angular frequency. We found that perceptions of pleasure and arousal increased with amplitude and angular frequency, but negative and relaxing emotional states were not able to convey. We also found associations between vibrotactile stimuli and colour properties. High amplitude stimuli were linked to warm colours and darker shades, while low amplitude was associated with brighter shades and greater variance in hue. We finish by discussing the causal mechanisms of crossmodal correspondences and contribute a design space for creating multisensory experiences.