A Preliminary Study of Multimodal Feedback Interfaces in Takeover Transition of Semi-Autonomous Vehicles

Abstract

This study aims to preliminarily investigate the explanatory effects of elaborated multimodal feedback compared to the current feedback system in takeover transition. In this study, a scenario-based experiment was conducted with ten participants using a driving simulator, and a semi-structured interview with all participants followed. We compared the driver's behavioral and affective aspects under the current and the multimodal feedback systems. The scenario includes five different situations in the combination of two types of takeover transition, suggestion and request, and three urgency-based situations such as constructions, obstacle emergence, and highway exit-entry. The results demonstrated the significant effects of multimodal feedback in that it shortened the drivers’ response time in takeover transition and helped manage their perceived annoyance and urgency when requesting a takeover transition. This study has theoretical and practical implications in designing multimodal feedback to encourage natural takeover transition under various situations.