Virtual reality interview with feedback framework for situational practice of gaze among autistic adults

Background

Autistic individuals commonly seek employment; however, only a small fraction are in the workforce. In part, this might be due to mismatches between their social patterns of attention and gaze, and society’s normative expectations during interviews.

Method

To help mitigate such disadvantages through a solo situational practice tool, we present a framework that consists of a virtual reality (VR) based job interview simulation and a coaching component. Employing data visualization, video modeling, and VR role-play of the targeted behavior, the coaching support could be done in a self-deliverable practice manner. A participatory design session with two autistic design partners was important in the co-creation of the feedback methods, making them easier to understand, and including positive reinforcement.

Results

Fourteen autistic individuals used the VR job interview simulation tool. Eleven received the gaze analysis and support stage and participated in a second VR simulation session. Preliminary results were positive, in that participant scores on average eye contact duration, average time without eye contact, and percentage of eye contact while listening and while speaking generally approached the corresponding medians of the non-autistic reference dataset. Participants were surveyed about the utility of the tool after the second feedback session and two months later. All survey respondents perceived the tool to be useful and the provided feedback to be helpful in daily social interactions.

Conclusions

This study provides insights towards the development of a VR job interview simulation and feedback framework that can enable solo situational practice of gaze and common interview questions.