Effects of rating criteria order on the halo effect in L2 writing assessment: a many-facet Rasch measurement analysis

• Published in: Language Testing in Asia Vol. 10; no. 1; pp. 1 - 23
• Main Author: Kim, Hyunwoo
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 10.11.2020; Springer; Springer Nature B.V; SpringerOpen
• Subjects: Assessment; Bias; Education; Essay Tests; Evaluation Criteria; Foreign Countries; Halo effect; Item Response Theory; Language assessment; Language Education; Many-facet Rasch measurement (MFRM); Measures; Rasch model; Rating criteria order; Rating scale model (RSM); Rating Scales; Ratings & rankings; Scale models; Scoring Rubrics; Second language writing; Second language writing instruction; Second Languages; Testing and Evaluation; Validation studies; Validity; Writing; Writing Evaluation; Writing Tests; South Korea; Asia; Halo effect; Rating criteria order; Rating scale model (RSM); Many-facet Rasch measurement (MFRM)

The halo effect is raters’ undesirable tendency to assign more similar ratings across rating criteria than they should. The impacts of the halo effect on ratings have been studied in rater-mediated L2 writing assessment. Little is known, however, about the extent to which rating criteria order in an...