Deep Learning-Based Interactive Dashboard for Enhancing Online Classroom Experience Through Student Emotion Analysis

• Published in: IEEE access Vol. 12; pp. 91140 - 91153
• Main Authors: Ganesan, Priyanka, Kumar Jagatheesaperumal, Senthil, Gobhinath, I., Venkatraman, Vishnu, Gaftandzhieva, Silvia N., Doneva, Rositsa Zh
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Analytical dashboard; classroom monitoring; Dashboards; Data visualization; Deep learning; emotion analysis; Emotions; Face recognition; Feature extraction; Generative adversarial networks; Image reconstruction; Machine learning; Optical flow; Real time; student outcomes; Students; Visualization
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2024.3421282

An interactive analytical dashboard that analyzes students' facial expressions during online lectures is crucial for digital learning platforms. This research addresses the need for educational institutions to analyze individual students' emotions to improve teaching standards. Given the challenge of occluded facial data, we employ a regenerative Generative Adversarial Network (GAN) to reconstruct these occluded regions. Subsequently, the emotions of the students are predicted and analyzed using our proposed interactive dashboard, which incorporates additional inputs such as subject name and teaching faculty. The dashboard visualizes various charts and analytics to support informed decision-making. We validated our deep learning model using the CK+ dataset, achieving notable accuracy in classifying each type of emotion. Our results demonstrate that the model can effectively interpret student emotions, even in the presence of occlusions, thereby providing educators with precise, real-time emotional insights to tailor their teaching methodologies effectively.