Assessing the validity of the USMLE step 2 clinical knowledge examination through an evaluation of its clinical relevance

• Published in: Academic medicine Vol. 79; no. 10 Suppl; p. S43
• Main Authors: Cuddy, Monica M, Dillon, Gerard F, Clauser, Brian E, Holtzman, Kathleen Z, Margolis, Melissa J, McEllhenney, Suzanne M, Swanson, David B
• Format: Journal Article
• Language: English
• Published: United States 01.10.2004
• Subjects: Clinical Competence - standards; Education, Medical - standards; Educational Measurement - methods; Educational Measurement - standards; Expert Testimony; Female; Humans; Judgment; Licensure, Medical; Male; Reproducibility of Results; United States; United States
• ISSN: 1040-2446
• DOI: 10.1097/00001888-200410001-00013

To assess the validity of the USMLE Step 2 Clinical Knowledge (CK) examination by addressing the degree to which experts view item content as clinically relevant and appropriate for Step 2 CK. Twenty-seven experts were asked to complete three survey questions related to the clinical relevance and appropriateness of 150 Step 2 CK multiple-choice questions. Percentages, reliability estimates, and correlation coefficients were calculated and ordinary least squares regression was used. Results showed that 92% of expert judgments indicated the item content was clinically relevant, 90% indicated the content was appropriate for Step 2 CK, and 85% indicated the content was used in clinical practice. The regression indicated that more difficult items and more frequently used items are considered more appropriate for Step 2 CK. Results suggest that the majority of item content is clinically relevant and appropriate, thus providing validation support for Step 2 CK.