Anomaly detection in the course evaluation process: a learning analytics–based approach

• Published in: Interactive technology and smart education Vol. 21; no. 1; pp. 168 - 187
• Main Authors: Vaidya, Anagha, Sharma, Sarika
• Format: Journal Article
• Language: English
• Published: Bingley Emerald Group Publishing Limited 18.01.2024
• Subjects: Academic Achievement; Algorithms; Anomalies; Behavior; Behavioral Objectives; Criteria; Data Analysis; Data mining; Data points; Datasets; Education; Educational objectives; Educational Technology; Learning; Learning analytics; Literature reviews; Machine learning; Mathematical analysis; Medical research; Online instruction; Student Behavior; Students; Teaching Methods; Technology adoption
• ISSN: 1741-5659; 1758-8510
• DOI: 10.1108/ITSE-09-2022-0124

PurposeCourse evaluations are formative and are used to evaluate learnings of the students for a course. Anomalies in the evaluation process can lead to a faulty educational outcome. Learning analytics and educational data mining provide a set of techniques that can be conveniently applied to extensive data collected as part of the evaluation process to ensure remedial actions. This study aims to conduct an experimental research to detect anomalies in the evaluation methods.Design/methodology/approachExperimental research is conducted with scientific approach and design. The researchers categorized anomaly into three categories, namely, an anomaly in criteria assessment, subject anomaly and anomaly in subject marks allocation. The different anomaly detection algorithms are used to educate data through the software R, and the results are summarized in the tables.FindingsThe data points occurring in all algorithms are finally detected as an anomaly. The anomaly identifies the data points that deviate from the data set’s normal behavior. The subject which is consistently identified as anomalous by the different techniques is marked as an anomaly in evaluation. After identification, one can drill down to more details into the title of anomalies in the evaluation criteria.Originality/valueThis paper proposes an analytical model for the course evaluation process and demonstrates the use of actionable analytics to detect anomalies in the evaluation process.