Comparing and Validating Four Methods for Scoring Mathematics Writing

• Published in: Reading & writing quarterly Vol. 36; no. 2; pp. 157 - 175
• Main Authors: Namkung, Jessica M., Hebert, Michael, Powell, Sarah R., Hoins, Marisa, Bricko, Nicole, Torchia, Meghann
• Format: Journal Article
• Language: English
• Published: Abingdon Routledge 03.03.2020; Taylor & Francis Ltd
• Subjects: Achievement tests; Content Area Writing; Correlation; Curricula; Curriculum Based Assessment; Educational tests & measurements; Elementary School Students; Grade 3; Grade 4; Grade 5; Grammar; Mathematics; Mathematics Instruction; Scoring; Scoring Rubrics; Vocabulary; Writing; Writing Evaluation; Writing Skills
• ISSN: 1057-3569; 1521-0693
• DOI: 10.1080/10573569.2019.1700858

Current mathematics curricula and assessments emphasize students' ability to communicate mathematical reasoning in writing. Limited research exists, however, on what mathematics writing (MW) is and how to assess the quality of MW. Therefore, based on our definition of MW construct, we explored 4 approaches to scoring MW: (a) holistic rubric scoring for overall quality of explanation; (b) analytical rubric scoring across 4 components (i.e., mathematics content, mathematics vocabulary, writing organization, writing grammar); (c) genre-based elements scoring (modified from the scoring form used for the Essay Composition subtest of the Wechsler Individualized Achievement Test); and (d) curriculum-based measurement mathematics-writing sequences (MWS) scoring, including rules for scoring numbers and symbols. Students from 6 classrooms in 3rd-grade, 4th grade, and 5th grade (2 classrooms at each grade level; N = 122) were recruited for the current study. Results indicated all 4 scoring methods were moderately correlated with measures of writing and mathematics. Holistic, analytic, and elements scoring were strongly correlated with each other, with slightly lower correlations for the MWS scoring. Confirmatory factor analysis further demonstrated adequate construct validity. All 4 scoring methods were reliable with an exception of lower reliability for writing components assessed by analytic scoring. Based on the validity, reliability, efficiency, and information provided by each scoring method, we recommend holistic scoring for summative assessments and elements scoring for formative assessments.