Sequential Reservoir Computing for Log File‐Based Behavior Process Data Analyses

• Published in: Journal of educational measurement
• Main Authors: Xiong, Jiawei, Wang, Shiyu, Tang, Cheng, Liu, Qidi, Sheng, Rufei, Wang, Bowen, Kuang, Huan, Cohen, Allan S., Xiong, Xinhui
• Format: Journal Article
• Language: English
• Published: 13.09.2024
• ISSN: 0022-0655; 1745-3984
• DOI: 10.1111/jedm.12413

Abstract The use of process data in assessment has gained attention in recent years as more assessments are administered by computers. Process data, recorded in computer log files, capture the sequence of examinees' response activities, for example, timestamped keystrokes, during the assessment. Traditional measurement methods are often inadequate for handling this type of data. In this paper, we proposed a sequential reservoir method (SRM) based on a reservoir computing model using the echo state network, with the particle swarm optimization and singular value decomposition as optimization. Designed to regularize features from process data through a computational self‐learning algorithm, this method has been evaluated using both simulated and empirical data. Simulation results suggested that, on one hand, the model effectively transforms action sequences into standardized and meaningful features, and on the other hand, these features are instrumental in categorizing latent behavioral groups and predicting latent information. Empirical results further indicate that SRM can predict assessment efficiency. The features extracted by SRM have been verified as related to action sequence lengths through the correlation analysis. This proposed method enhances the extraction and accessibility of meaningful information from process data, presenting an alternative to existing process data technologies.