Modeling Item Revisit Behavior: The Hierarchical Speed–Accuracy–Revisits Model

• Published in: Educational and psychological measurement Vol. 81; no. 2; pp. 363 - 387
• Main Authors: Bezirhan, Ummugul, von Davier, Matthias, Grabovsky, Irina
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.04.2021; SAGE PUBLICATIONS, INC
• Subjects: Ability; Accuracy; Bayesian Statistics; Behavior Patterns; Correlation; Educational tests & measurements; Individual Characteristics; Licensing Examinations (Professions); Markov Processes; Monte Carlo Methods; Physicians; Poisson distribution; Reaction Time; Response Style (Tests); Response time; response time; item revisits; hierarchical modeling; Rasch Poisson counts model
• ISSN: 0013-1644; 1552-3888
• DOI: 10.1177/0013164420950556

This article presents a new approach to the analysis of how students answer tests and how they allocate resources in terms of time on task and revisiting previously answered questions. Previous research has shown that in high-stakes assessments, most test takers do not end the testing session early, but rather spend all of the time they were assigned to take the test. Rather than being an indication of speededness, this was found to be caused by test takers’ tendency to revisit previous items even if they already provided answers to all questions. In accordance with this information, the proposed approach models revisit patterns simultaneously with responses and response times to gain a better understanding of the relationship between speed, ability, and revisit tendency. The empirical data analysis revealed that examinees’ tendency to revisit items was strongly related to their speed and subgroups of examinees displayed different test-taking behaviors.