A Demonstration of ALTRUIST for Conducting QoE Subjective Tests in Immersive Systems

Abstract

Subjective Quality of Experience (QoE) studies often require setting up complex lab environments to study users' perceptions of the application or service under controlled test conditions. These lab environments must control applications and devices to generate the required test conditions accurately, reliably, repeatedly, and error-free under study. Further, the data collection should be performed on many devices, such as clients and servers, often in real-time, and correctly labelled according to each test condition. To circumvent the complex task of configuring the lab environment and the laborious and error-prone work of data collection, we demonstrate ALTRUIST, a multi-platform tool to conduct subjective tests efficiently. In particular, we present the use of ALTRUIST in two lab setups involving immersive applications such as mobile cloud gaming and virtual reality gaming.