Criterion-Related Validity: Assessing the Value of Subscores

Criterion-related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. C...

Full description

Saved in:
Bibliographic Details
Published inJournal of educational measurement Vol. 52; no. 3; pp. 263 - 279
Main Authors Davison, Mark L., Davenport Jr, Ernest C., Chang, Yu-Feng, Vue, Kory, Su, Shiyang
Format Journal Article
LanguageEnglish
Published Madison Blackwell Publishing Ltd 01.09.2015
National Council on Measurement in Education
Wiley-Blackwell
Wiley Subscription Services, Inc
Subjects
Affirmative Action
Correlation analysis
Criterion Referenced Tests
Culture Fair Tests
Prediction
Reliability
Sample size
Scores
Simulation
Validity
Online AccessGet full text

Cover

More Information
Summary:Criterion-related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. Considerations other than validity and reliability are discussed, including broad societal goals (e.g., affirmative action), fairness, and ties in expected criterion predictions. In simulation data, CPA results were sensitive to subscore correlations, sample size, and the proportion of criterion-related variance accounted for by the subscores. CPA can be a useful component in a thorough subscore evaluation encompassing subscore reliability, validity, distinctiveness, fairness, and broader societal goals.
Bibliography:istex:55174E9D2486959D27BE618B9B4870C5BC7EB067
ArticleID:JEDM12081
ark:/67375/WNG-K4HLBW9V-Z
ISSN:0022-0655
1745-3984
DOI:10.1111/jedm.12081