Improving mathematics assessment readability: Do large language models help?

• Published in: Journal of computer assisted learning Vol. 39; no. 3; pp. 804 - 822
• Main Authors: Patel, Nirmal, Nagpal, Pooja, Shah, Tirth, Sharma, Aditya, Malvi, Shrey, Lomas, Derek
• Format: Journal Article
• Language: English
• Published: Chichester, UK John Wiley & Sons, Inc 01.06.2023; Wiley; Wiley Subscription Services, Inc
• Subjects: Artificial Intelligence; Authoring; Educational evaluation; Elementary School Mathematics; GPT‐3; Grade 3; Grade 4; Grade 5; Large language models; Mathematical problems; Mathematics Achievement; mathematics assessment; Mathematics education; Mathematics Tests; Quality assessment; Questions; Readability; Reading Comprehension; Reading Skills; Similarity; Students; Teaching methods; text simplification; Word Problems (Mathematics); Words (language)

Background Readability metrics provide us with an objective and efficient way to assess the quality of educational texts. We can use the readability measures for finding assessment items that are difficult to read for a given grade level. Hard‐to‐read math word problems can put some students at a di...