Touchless Gestural Interaction with Wizard-of-Oz: Analysing User Behaviour

Abstract

In many gestural interfaces, the gesture set is developed or trained by real users, but many use gestures with unchanging definition that do not account for variation between different users or performances. Over time, if the user performs gestures different, the definition should evolve to accommodate these changes. We performed a Wizard-of-Oz experiment with a user-defined gesture system to determine if participant's gestures changed over repeated performances, and when and why these changes occurred. The results showed that although the definitions provided changed in a unique way for each participant, most reported their gestures as becoming simpler and less difficult to perform over time.