Use of a 360-degree evaluation in the outpatient setting: the usefulness of nurse, faculty, patient/family, and resident self-evaluation

Faculty have traditionally evaluated resident physician professionalism and interpersonal skills without input from patients, family members, nurses, or the residents themselves. The objective of our study was to use "360-degree evaluations," as suggested by the Accreditation Council for G...

Full description

Saved in:
Bibliographic Details
Published inJournal of graduate medical education Vol. 2; no. 3; pp. 430 - 434
Main Authors Chandler, Nicole, Henderson, Gavin, Park, Brittany, Byerley, Julie, Brown, Wallace D, Steiner, Michael J
Format Journal Article
LanguageEnglish
Published United States The Accreditation Council for Graduate Medical Education 01.09.2010
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:Faculty have traditionally evaluated resident physician professionalism and interpersonal skills without input from patients, family members, nurses, or the residents themselves. The objective of our study was to use "360-degree evaluations," as suggested by the Accreditation Council for Graduate Medical Education (ACGME), to determine if nonfaculty ratings of resident professionalism and interpersonal skills differ from faculty ratings. Pediatrics residents were enrolled in a hospital-based resident continuity clinic during a 5-week period. Patient/families (P/Fs), faculty (MD [doctor of medicine]), nurses (RNs [registered nurses]), and residents themselves (self) completed evaluator-specific evaluations after each clinic session by using a validated 10-item questionnaire with a 5-point Likert scale. The average Likert score was tallied for each questionnaire. Mean Likert scale scores for each type of rater were compared by using analysis of variance, text with pair-wise comparisons when appropriate. Agreement between rater types was measured by using the Pearson correlation. A total of 823 evaluations were completed for 66 residents (total eligible residents, 69; 95% participation). All evaluators scored residents highly (mean Likert score range, 4.4 to 4.9). However, MDs and RNs scored residents higher than did P/Fs (mean scores: MD, 4.77, SD [standard deviation], 0.32; RN, 4.85, SD, 0.30; P/F, 4.53, SD, 0.96; P < .0001). MD and RN scores also were higher than residents' self-evaluation scores, but there was no difference between self-scores and P/F scores (average resident self-score, 4.44, SD, 0.43; P < .0001 compared to MD and RN; P  =  .19 compared to P/F). Correlation coefficients between all combinations of raters ranged from -0.21 to 0.21 and none were statistically significant. Our study found high ratings for resident professionalism and interpersonal skills. However, different members of the health care team rated residents differently, and ratings are not correlated. Our results provide evidence for the potential value of 360-degree evaluations.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1949-8349
1949-8357
DOI:10.4300/JGME-D-10-00013.1