Enabling remote deictic communication with mobile devices: an elicitation study

Mobile systems provide many means to relay information to a distant partner, but remote communication is still limited compared to face-to-face interaction. Deictic communication and pointing, in particular, are challenging when two parties communicate across distances. In this paper, we investigate how people envision remote pointing would work when using mobile devices. We report on an elicitation study where we asked participants to perform a series of remote pointing tasks. Our results provide initial insights into user behaviors and specific issues in this context. We discovered that most people follow one of two basic patterns, that their individual pointing behavior is very consistent and that the shape and location of the target object have little influence on the pointing gesture used. From our results, we derived a set of design guidelines for future user interfaces for remote pointing. Our contributions can benefit designers and researchers of such interfaces.