Pilot evaluation of the Computer-Based Assessment for Sampling Personal Characteristics test

• Published in: The Journal of surgical research Vol. 215; pp. 211 - 218
• Main Authors: Shipper, Edward S., MD, Mazer, Laura M., MD, MS, Merrell, Sylvia Bereknyei, DrPH, MS, Lin, Dana T., MD, FACS, Lau, James N., MD, MHPE, FACS, Melcher, Marc L., MD, PhD, FACS
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.07.2017
• Subjects: Aptitude Tests; Attitude of Health Personnel; California; Faculty, Medical; Feasibility Studies; Female; General Surgery - education; Humans; Internship and Residency - organization & administration; Male; Personal characteristics; Pilot Projects; Resident assessment; Resident attrition; School Admission Criteria; Surgery; Surveys and Questionnaires; Resident attrition; Resident assessment; Personal characteristics
• ISSN: 0022-4804; 1095-8673
• DOI: 10.1016/j.jss.2017.03.054

Abstract Background High attrition rates hint at deficiencies in the resident selection process. The evaluation of personal characteristics representative of success is difficult. Here, we evaluate a novel tool for assessing personal characteristics. Materials and Methods To evaluate feasibility, we used an anonymous voluntary survey questionnaire offered to study participants before and after contact with the CASPer test. To evaluate the CASPer test as a predictor of success, we compared CASPer test assessments of personal characteristics versus traditional faculty assessment of personal characteristics with applicant rank list position. Results All applicants ( n  = 77) attending an in-person interview for general surgery residency, and all faculty interviewers ( n  = 34) who reviewed these applications were invited to participate. Among applicants, 84.4% of respondents (65 of 77) reported that a requirement to complete the CASPer test would have no bearing or would make them more likely to apply to the program (mean = 3.30, standard deviation = 0.96). Among the faculty, 62.5% respondents (10 of 16) reported that the same condition would have no bearing or would make applicants more likely to apply to the program (mean = 3.19, standard deviation = 1.33). The Spearman's rank-order correlation coefficients for the relationships between traditional faculty assessment of personal characteristics and applicant rank list position, and novel CASPer assessment of personal characteristics and applicant rank list position, were −0.45 ( P  = 0.033) and −0.41 ( P  = 0.055), respectively. Conclusions The CASPer test may be feasibly implemented as component of the resident selection process, with the potential to predict applicant rank list position and improve the general surgery resident selection process.