A review of machine learning in scanpath analysis for passive gaze-based interaction

• Published in: Frontiers in artificial intelligence Vol. 7; p. 1391745
• Main Authors: Mohamed Selim, Abdulrahman, Barz, Michael, Bhatti, Omair Shahzad, Alam, Hasan Md Tusfiqur, Sonntag, Daniel
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Media S.A 05.06.2024
• Subjects: Artificial Intelligence; eye tracking; literature review; machine learning; passive gaze-based interaction; scanpath; passive gaze-based interaction; scanpath; literature review; machine learning; eye tracking
• ISSN: 2624-8212; 2624-8212
• DOI: 10.3389/frai.2024.1391745

The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.