A mixed Rasch model analysis of multiple profiles in L2 writing

• Published in: Assessing writing Vol. 59; p. 100803
• Main Authors: Effatpanah, Farshad, Baghaei, Purya, Karimi, Mohammad N.
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.01.2024
• Subjects: Item response theory; L2 writing; Linguistic features; Mixed Rasch Model; Multiple profiles; GRM; EDD; ORG; Item response theory; MRM; EFL; ELT; AWE; MA; ANOVA; Multiple profiles; AIC; MNSQ; BIC; MANOVA; CA; CON; L1; L2; CAIC; Mixed Rasch Model; LCA; VOC; 2PL; 3PL; PCA; MFRM; MCH; LCM; Linguistic features; MIRT; RM; LPA; L2 writing
• ISSN: 1075-2935; 1873-5916
• DOI: 10.1016/j.asw.2023.100803

The present study used the Mixed Rasch Model (MRM) to identify multiple profiles in L2 students’ writing with regard to several linguistic features, including content, organization, grammar, vocabulary, and mechanics. To this end, a pool of 500 essays written by English as a foreign language (EFL) students were rated by four experienced EFL teachers using the Empirically-derived Descriptor-based Diagnostic (EDD) checklist. The ratings were subjected to MRM analysis. Two distinct profiles of L2 writers emerged from the sample analyzed including: (a) Sentence-Oriented and (b) Paragraph-Oriented L2 Writers. Sentence-Oriented L2 Writers tend to focus more on linguistic features, such as grammar, vocabulary, and mechanics, at the sentence level and try to utilize these subskills to generate a written text. However, Paragraph-Oriented Writers are inclined to move beyond the boundaries of a sentence and attend to the structure of a whole paragraph using higher-order features such as content and organization subskills. The two profiles were further examined to capture their unique features. Finally, the theoretical and pedagogical implications of the identification of L2 writing profiles and suggestions for further research are discussed. •Diagnosing EFL Learners’ Writing Ability: A Diagnostic Classification Modeling Analysis.•Cognitive Components of Writing in a Second Language: An Analysis with the Linear Logistic Test Model.•Exploring Rater Quality in Rater-Mediated Assessment Using the Non-Parametric Item Characteristic Curve Estimation.•Fitting the Mixed Rasch Model to a Reading Comprehension Test: Identifying Reader Types.•Integrated Writing across Conflicting L2 Texts: The Effects of Prior Beliefs on Perspectivism and Propositional Content.