Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review

• Published in: Human factors Vol. 66; no. 1; pp. 180 - 208
• Main Authors: van de Merwe, Koen, Mallam, Steven, Nazir, Salman
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.01.2024; Human Factors and Ergonomics Society
• Subjects: Automation; Awareness; Cognition; Data processing; Data transparency; Human factors; Human performance; Humans; Information processing; Intelligent agents; Literature reviews; Man-machine interfaces; Man-Machine Systems; Operator performance; Proposals; Safety critical; Situational awareness; Supervisory control; Task Performance and Analysis; Transparency; Workload; Workloads; PRISMA; automation transparency; human-automation interaction; information disclosure; seeing into
• ISSN: 0018-7208; 1547-8181; 1547-8181
• DOI: 10.1177/00187208221077804

Objective In this review, we investigate the relationship between agent transparency, Situation Awareness, mental workload, and operator performance for safety critical domains. Background The advancement of highly sophisticated automation across safety critical domains poses a challenge for effective human oversight. Automation transparency is a design principle that could support humans by making the automation’s inner workings observable (i.e., “seeing-into”). However, experimental support for this has not been systematically documented to date. Method Based on the PRISMA method, a broad and systematic search of the literature was performed focusing on identifying empirical research investigating the effect of transparency on central Human Factors variables. Results Our final sample consisted of 17 experimental studies that investigated transparency in a controlled setting. The studies typically employed three human-automation interaction types: responding to agent-generated proposals, supervisory control of agents, and monitoring only. There is an overall trend in the data pointing towards a beneficial effect of transparency. However, the data reveals variations in Situation Awareness, mental workload, and operator performance for specific tasks, agent-types, and level of integration of transparency information in primary task displays. Conclusion Our data suggests a promising effect of automation transparency on Situation Awareness and operator performance, without the cost of added mental workload, for instances where humans respond to agent-generated proposals and where humans have a supervisory role. Application Strategies to improve human performance when interacting with intelligent agents should focus on allowing humans to see into its information processing stages, considering the integration of information in existing Human Machine Interface solutions.