Exploring Aural Navigation by Screenless Access

Abstract

When people who are blind or visually impaired navigate the mobile web, they have to hold a phone in their hands at all times. Such continuous, two-handed interaction on a small screen hampers the user's ability to keep hands free to control aiding devices (e.g., cane) or touch objects nearby, especially on-the-go. In this paper, we introduce screenless access: a browsing approach that enables users to interact touch-free with aural navigation architectures using one-handed, in-air gestures recognized by an off-the-shelf armband. In a study with ten participants who are blind or visually impaired, we observed proficient navigation performance, users conceptual fit with a screen-free paradigm, and low levels of cognitive load. Our findings model the errors users made due to limits of the design and system proposed, uncover navigation styles that participants used, and illustrate unprompted adaptations of gestures that were enacted effectively to appropriate the technology. User feedback revealed insights into the potential and limitations of screenless navigation to support convenience in traveling, work contexts and privacy-preserving scenarios, as well as concerns about gestures that may become socially conspicuous.