Improving Outcomes on the ABS Certifying Examination: Can Monthly Mock Orals Do It?

• Published in: Journal of surgical education Vol. 65; no. 6; pp. 441 - 444
• Main Authors: Guzman, Edgar, MD, Babakhani, Allen, MD, Maker, Vijay K., MD
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.11.2008
• Subjects: American Board of Surgery Certifying Examination; Certification - methods; Clinical Competence; Communication Skills; Educational Measurement - methods; General Surgery - education; Humans; Illinois; Internship and Residency; Medical Knowledge; mock oral evaluations; pass rates; Professionalism; Program Evaluation; Prospective Studies; residency outcomes; Specialty Boards; Surgery; Surveys and Questionnaires; United States; United States; Illinois; Communication Skills; residency outcomes; American Board of Surgery Certifying Examination; pass rates; Medical Knowledge; mock oral evaluations; Professionalism
• DOI: 10.1016/j.jsurg.2008.04.005
• ISSN: 1931-7204

Purpose First-time pass rates on the American Board of Surgery Certifying Examination (ABSCE) have now become one of the standards of excellence to evaluate residency programs. Our residency program started monthly simulated and critiqued (verbal, written, and video) oral examinations (MSCE) in 2003. The current study explores the outcomes of this intervention. Methods We evaluated ABSCE performance of 48 residents who graduated from a large academic/community program between the years 2001 and 2006 though a prospective study with historical controls. Residents were divided into 2 groups: The intervention group comprised the 2003 to 2006 classes, which underwent MSCE; the historical control group spanned the 2001 and 2002 classes, which did not undergo MSCE. Results in the ABSCE were compared between groups using the Fisher exact test. In addition, the intervention group was queried in relation to the most important aspects of the MSCE as a learning experience through a structured questionnaire. Results A statistically significant improvement (p = 0.038) in ABSCE first-time pass rates was noted in the intervention group. Examinees unanimously asserted they had been helped by the MSCE. Improvements in clinical reasoning and promotion of self-study were the most often cited benefits of the MSCE. Conclusion Monthly simulated and critiqued oral examinations improved the first-time pass rate of the American Board of Surgery Certifying Examination. Additional perceived benefits of this intervention included improvements in clinical reasoning and promotion of self-study.