NUX IVE - a research tool for comparing voice user interface and graphical user interface in VR

Abstract

A trend of using natural interaction such us speech is clearly visible in human-computer interaction, while in interactive virtual environments (IVE) still it has not become a common practice. Most of input interface elements are graphical and usually they are im-plemented as non-diegetic 2D boards hanging in 3D space. Such holographic interfaces are usually hard to learn and operate, espe-cially for inexperienced users. We have observed a need to explore the potential of using multimodal interfaces in VR and conduct the systematic research that compare the interaction mode in order to optimize the interface and increase the quality of user experience (UX). We introduce a new IVE designed to compare the user inter-action between the mode with traditional graphical user interface (GUI) with the mode in which every element of interface is replaced by voice user interface (VUI). In each version, four scenarios of interaction with a virtual assistant in a sci-fi location are implemented using Unreal Engine, each of them lasting several minutes. The IVE is supplemented with tools for automatic generating reports on user behavior (clicktracking, audiotracking and eyetracking) which makes it useful for UX and usability studies.