Assessing Team Performance: A Mixed-Methods Analysis Using Interprofessional in situ Simulation

• Published in: The western journal of emergency medicine Vol. 25; no. 4; pp. 557 - 564
• Main Authors: Rider, Ashley C, Williams, Sarah R, Jones, Vivien, Rebagliati, Daniel, Schertzer, Kimberly, Gisondi, Michael A, Sebok-Syer, Stefanie S
• Format: Journal Article
• Language: English
• Published: United States Department of Emergency Medicine, University of California, Irvine School of Medicine 01.07.2024; eScholarship Publishing, University of California
• Subjects: Adult; Clinical Competence; Emergency Department Operations; Emergency Medicine - education; Emergency Service, Hospital; Female; Focus Groups; Humans; Interprofessional Relations; Male; Original Research; Patient Care Team; Patient Simulation; Simulation Training
• DOI: 10.5811/westjem.18012
• ISSN: 1936-9018; 1936-900X

Optimizing the performance of emergency department (ED) teams impacts patient care, but the utility of current, team-based performance assessment tools to comprehensively measure this impact is underexplored. In this study we aimed to 1) evaluate ED team performance using current team-based assessment tools during an interprofessional in situ simulation and 2) identify characteristics of effective ED teams. This mixed-methods study employed case study methodology based on a constructivist paradigm. Sixty-three eligible nurses, technicians, pharmacists, and postgraduate year 2-4 emergency medicine residents at a tertiary academic ED participated in a 10-minute in situ simulation of a critically ill patient. Participants self-rated performance using the (TPOT) 2.0 and completed a brief demographic form. Two raters independently reviewed simulation videos and rated performance using the TPOT 2.0, (TEAM), and (Ottawa GRS). Following simulations, we conducted semi-structured interviews and focus groups with in situ participants. Transcripts were analyzed using thematic analysis. Eighteen team-based simulations took place between January-April 2021. Raters' scores were on the upper end of the tools for the TPOT 2.0 (R1 4.90, SD 0.17; R2 4.53, SD 0.27, IRR [inter-rater reliability] 0.47), TEAM (R1 3.89, SD 0.19; R2 3.58, SD 0.39, IRR 0.73), and Ottawa GRS (R1 6.6, SD 0.56; R2 6.2, SD 0.54, IRR 0.68). We identified six themes from our interview data: team member entrustment; interdependent energy; leadership tone; optimal communication; strategic staffing; and simulation empowering team performance. Current team performance assessment tools insufficiently discriminate among high performing teams in the ED. Emergency department-specific assessments that capture features of entrustability, interdependent energy, and leadership tone may offer a more comprehensive way to assess an individual's contribution to a team's performance.