Kappa Coefficients for Missing Data

• Published in: Educational and psychological measurement Vol. 79; no. 3; pp. 558 - 576
• Main Authors: De Raadt, Alexandra, Warrens, Matthijs J., Bosker, Roel J., Kiers, Henk A. L.
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.06.2019; SAGE PUBLICATIONS, INC
• Subjects: Bias; Comparative Analysis; Data; Educational tests & measurements; Error of Measurement; Interrater Reliability; Kappa coefficient; Missing data; Statistical Analysis; Statistical Bias; nominal ratings; Gwet’s kappa; missing data; listwise deletion; inter-rater reliability; Cohen’s kappa

Cohen’s kappa coefficient is commonly used for assessing agreement between classifications of two raters on a nominal scale. Three variants of Cohen’s kappa that can handle missing data are presented. Data are considered missing if one or both ratings of a unit are missing. We study how well the var...