Mouse-cursor Tracking: Simple Scoring Algorithms That Make It Work

• Published in: IEEE transactions on affective computing pp. 1 - 12
• Main Authors: Yamauchi, Takashi, Longmire-Monford, Shanle, Leontyev, Anton, Wang, Kunxia
• Format: Journal Article
• Language: English
• Published: IEEE 2024
• Subjects: Affective computing; and merged PCA; Cognitive load; data coding and scoring methods; Decision making; Delays; Depression; Emotion recognition; Human factors; Mood; Motors; Mouse-cursor tracking; Principal component analysis; Principal Component Analysis (standard; scaled
• ISSN: 1949-3045; 1949-3045
• DOI: 10.1109/TAFFC.2024.3519257

Mouse-cursor tracking, a new action-based measure of behavior, has emerged as one of the promising applications of affective computing. As facial expressions, gaits, electroencephalogram (EEG), and electrodermal activity (EDA) inform the emotions of computer users, the movement of the computer mouse-cursor reveals when people feel anxious, relaxed, attentive, joyful, and sad. However, the mouse tracking analysis has not previously been subject to systematic investigations of psychometric properties. The choice of motor features, experimental manipulations, and data transformation methods is ad hoc. In this study, we evaluate the impact of psychological factors on mouse-based affective computing and propose simple scoring algorithms that incorporate psychometric features such as the frame of reference, habituation, and measurement error. Our results demonstrate that our new dimensionality reduction method, merged PCA, outperforms conventional procedures, improving prediction performance by about 15 − 30%.