The impact of collocational proficiency features on expert ratings of L2 English learners’ writing

• Published in: Studies in second language acquisition Vol. 47; no. 1; pp. 336 - 360
• Main Authors: Naismith, Ben, Juffs, Alan
• Format: Journal Article
• Language: English
• Published: New York, USA Cambridge University Press 01.03.2025
• Subjects: accuracy; collocation; collocational proficiency; writing assessment; sophistication
• ISSN: 0272-2631; 1470-1545
• DOI: 10.1017/S0272263125000075

Lexical proficiency is a multifaceted phenomenon that greatly impacts human judgments of writing quality. However, the importance of collocations’ contribution to proficiency assessment has received less attention than that of single words, despite collocations’ essential role in language production. This study, therefore, investigated how aspects of collocational proficiency affect the ratings that examiners give to English learner essays. To do so, collocational features related to sophistication and accuracy were manipulated in a set of argumentative essays. Examiners then rated the texts and provided rationales for their choices. The findings revealed that the use of lower-frequency words significantly and positively impacted the experts’ ratings. When used as part of collocations, such words then provided a small yet significant additional boost to ratings. Notably, there was no significant effect for increased collocational accuracy. These findings suggest that low-frequency words within collocations are particularly salient to examiners and deserving of pedagogic focus.