Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management

• Published in: Human factors Vol. 58; no. 3; pp. 401 - 415
• Main Authors: Mercado, Joseph E., Rupp, Michael A., Chen, Jessie Y. C., Barnes, Michael J., Barber, Daniel, Procci, Katelyn
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.05.2016; Human Factors and Ergonomics Society
• Subjects: Adult; Artificial Intelligence; Automation; Calibration; Computer Simulation; Female; Human-computer interaction; Humans; Male; Man-Machine Systems; Task Performance and Analysis; Transparency; Trust; Unmanned aerial vehicles; User-Computer Interface; Young Adult; human–agent teaming; intelligent agent transparency; multi-UxV management
• DOI: 10.1177/0018720815621206
• ISSN: 0018-7208; 1547-8181

Objective: We investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human–agent teaming for multirobot management. Background: Participants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans—a top recommendation and a secondary recommendation—for every mission. Method: A within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander’s intent and intelligence). Operator performance, trust, workload, and usability data were collected. Results: Results indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants’ workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency. Conclusion: Unlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs. Application: The current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.