Deciphering Automation Transparency: Do the Benefits of Transparency Differ Based on Whether Decision Recommendations Are Provided?

Abstract

Objective: To better understand automation transparency, we experimentally isolated the effects of additional information and decision recommendations on decision accuracy, decision time, perceived workload, trust, and system usability.

Background: The benefits of automation transparency are well documented. Previously, however, transparency (in the form of additional information) has been coupled with the provision of decision recommendations, potentially decreasing decision-maker agency and promoting automation bias. It may instead be more beneficial to provide additional information without decision recommendations to inform operators' unaided decision making.

Methods: Participants selected the optimal uninhabited vehicle (UV) to complete missions. Additional display information and decision recommendations were provided but were not always accurate. The level of additional information (no, medium, high) was manipulated between-subjects, and the provision of recommendations (absent, present) within-subjects.

Results: When decision recommendations were provided, participants made more accurate and faster decisions, and rated the UV system as more usable. However, recommendation provision reduced participants' ability to discriminate UV system information accuracy. Increased additional information led to faster decisions, lower perceived workload, and higher trust and usability ratings but only significantly improved decision (UV selection) accuracy when recommendations were provided.

Conclusion: Individuals scrutinized additional information more when not provided decision recommendations, potentially indicating a higher expected value of processing that information. However, additional information only improved performance when accompanied by recommendations to support decisions.

Application: It is critical to understand the potential differential impact of, and interaction between, additional display information and decision recommendations to design effective transparent automated systems in the modern workplace.