Time to Scale: Generalizable Affect Detection for Tens of Thousands of Students across an Entire School Year

We developed generalizable affect detectors using 133,966 instances of 18 affective states collected from 69,174 students who interacted with an online math learning platform called Algebra Nation over the entire school year. To enable scalability and generalizability, we used generic interaction fe...

Full description

Saved in:
Bibliographic Details
Published inGrantee Submission
Main Authors Hutt, Stephen, Grafsgaard, Joseph F, D'Mello, Sidney K
Format Report
LanguageEnglish
Published 01.05.2019
Subjects
Affective Behavior
Algebra
Educational Technology
Generalization
Geometry
Intelligent Tutoring Systems
Learner Engagement
Online Courses
Psychological Patterns
Student Attitudes
Technology Uses in Education
Online AccessGet full text

Cover

More Information
Summary:We developed generalizable affect detectors using 133,966 instances of 18 affective states collected from 69,174 students who interacted with an online math learning platform called Algebra Nation over the entire school year. To enable scalability and generalizability, we used generic interaction features (e.g., viewing a video, taking a quiz), which do not require specialized sensors and are domain- and (to a certain extent) system-independent. We experimented with standard classifiers, recurrent neural networks, and genetically evolved neural networks for affect modeling. Prediction accuracies, quantified with Spearman's rho, were modest and ranged from 0.08 (for surprise) to 0.34 (for happiness) with a mean of 0.25. Our model trained on Algebra students generalized to a different set of Geometry students (n = 28,458) on the same platform. We discuss implications for scaling up affect detection for affect-sensitive online learning environments which aim to improve engagement and learning by detecting and responding to student affect. [Paper presented at the CHI Conference on Human Factors in Computing Systems Proceedings, 2019, Glasgow, Scotland, May 4-9.]