Evaluating validity properties of 25 race-related scales

• Published in: Behavior research methods Vol. 55; no. 4; pp. 1758 - 1777
• Main Authors: Hester, Neil, Axt, Jordan R., Siemers, Nellie, Hehman, Eric
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2023; Springer Nature B.V
• Subjects: Behavioral Science and Psychology; Cognitive Psychology; Item response theory; Nets; Psychology; Measurement; Latent constructs; Stereotyping; Psychometrics; Prejudice
• ISSN: 1554-3528; 1554-3528
• DOI: 10.3758/s13428-022-01873-w

Racial attitudes, beliefs, and motivations lie at the center of many influential theories of prejudice and discrimination. The extent to which such theories can meaningfully explain behavior hinges on accurate measurement of these latent constructs. We evaluated the validity properties of 25 race-related scales in a sample of 910,066 respondents using various tools, including dynamic fit indices, item response theory, and nomological nets. Despite showing adequate internal reliability, many scales demonstrated poor model fit and had latent score distributions showing clear floor or ceiling effects, results that illustrate deficiencies in these measures’ ability to capture their intended latent construct. Nomological nets further suggested that the theoretical space of “racial prejudice” is crowded with scales that may not capture meaningfully distinct latent constructs. We provide concrete recommendations for both scale selection and scale renovation and outline implications for overlooking measurement issues in the study of prejudice and discrimination.