Limitations of Disembodied Computer-Generated Voice to Convey Emotion in Multimedia Lessons

• Published in: International journal of human-computer interaction Vol. 41; no. 10; pp. 5881 - 5893
• Main Authors: Zhao, Fangzheng, Mayer, Richard E.
• Format: Journal Article
• Language: English
• Published: Taylor & Francis 19.05.2025
• Subjects: computer-generated voice; emotion; multimedia learning; narrated slideshow; Text-to-speech
• ISSN: 1044-7318; 1532-7590
• DOI: 10.1080/10447318.2024.2371681

The goal of this study was to determine whether learning processes and outcomes are affected by the emotional tone of the computer-generated voice in a narrated slideshow. In a between-subjects design, participants viewed a narrated slideshow on lightning formation involving a computer-generated female (Experiment 1) or male voice (Experiment 2) that displayed happy, content, angry, or sad emotion. On subsequent surveys and post-tests, students could recognize positive or negative emotions conveyed by the female voice but not the male voice. The emotional tone of the instructor's voices had minimal impact on students' ratings of felt emotion during learning, ratings of social connection with the instructor, or scores on retention and transfer tests of learning outcome. The findings highlight the limitations of computer-generated voices to convey emotions that trigger affective, social, and cognitive processes when an onscreen instructor is absent, thereby suggesting a boundary condition for the cognitive-affective model of e-learning.