Automated Task-Time Interventions to Improve Teamwork using Imitation Learning

• Main Authors: Seo, Sangwon, Han, Bing, Unhelkar, Vaibhav
• Format: Journal Article
• Language: English
• Published: 01.03.2023
• Subjects: Computer Science - Artificial Intelligence; Computer Science - Learning; Computer Science - Multiagent Systems
• DOI: 10.48550/arxiv.2303.00413

Effective human-human and human-autonomy teamwork is critical but often challenging to perfect. The challenge is particularly relevant in time-critical domains, such as healthcare and disaster response, where the time pressures can make coordination increasingly difficult to achieve and the consequences of imperfect coordination can be severe. To improve teamwork in these and other domains, we present TIC: an automated intervention approach for improving coordination between team members. Using BTIL, a multi-agent imitation learning algorithm, our approach first learns a generative model of team behavior from past task execution data. Next, it utilizes the learned generative model and team's task objective (shared reward) to algorithmically generate execution-time interventions. We evaluate our approach in synthetic multi-agent teaming scenarios, where team members make decentralized decisions without full observability of the environment. The experiments demonstrate that the automated interventions can successfully improve team performance and shed light on the design of autonomous agents for improving teamwork.