Supporting Skill Assessment in Learning Experiences Based on Serious Games Through Process Mining Techniques

• Published in: International journal of interactive multimedia and artificial intelligence Vol. 8; no. 6; pp. 146 - 159
• Main Authors: Caballero-Hernandez, Juan Antonio, Palomo-Duarte, Manuel, Dodero, Juan Manuel, Gasevic, Dragan
• Format: Journal Article
• Language: English
• Published: IMAI Software 01.06.2024; Universidad Internacional de La Rioja (UNIR)
• Subjects: Analysis; educational data mining; game-based learning; learning analytics; Methods; serious games; Video games
• ISSN: 1989-1660; 1989-1660
• DOI: 10.9781/ijimai.2023.05.002

Learning experiences based on serious games are employed in multiple contexts. Players carry out multiple interactions during the gameplay to solve the different challenges faced. Those interactions can be registered in logs as large data sets providing the assessment process with objective information about the skills employed. Most assessment methods in learning experiences based on serious games rely on manual approaches, which do not scalewell when the amount of data increases. We propose an automated method to analyse students' interactions and assess their skills in learning experiences based on serious games. The method takes into account not only the final model obtained by the student, but also the process followed to obtain it, extracted from game logs. The assessment method groups students according to their in-game errors and in-game outcomes. Then, the models for the most and the least successful students are discovered using process mining techniques. Similarities in their behaviour are analysed through conformance checking techniques to compare all the students with the most successful ones. Finally, the similarities found are quantified to build a classification of the students' assessments. We have employed this method with Computer Science students playing a serious game to solve design problems in a course on databases. The findings show that process mining techniques can palliate the limitations of skill assessment methods in game-based learning experiences. KEYWORDS Educational Process Mining, Game-Based Learning, Learning Analytics, Model Discovery, Serious Games, Skill Assessment.