Expressing and interpreting emotional movements in social games with robots

• Published in: Personal and ubiquitous computing Vol. 14; no. 5; pp. 457 - 467
• Main Authors: Barakova, Emilia I., Lourens, Tino
• Format: Journal Article
• Language: English
• Published: London Springer-Verlag 01.07.2010; Springer Nature B.V
• Subjects: Children; Computer & video games; Computer Science; Games; Human; Mathematical models; Mobile Computing; Movements; Original Article; Personal Computing; Recording; Robots; Three dimensional; User Interfaces and Human Computer Interaction; Autism; Movement analysis; Social training with games; Measuring emotions; Emotion recognition in robots
• ISSN: 1617-4909; 1617-4917
• DOI: 10.1007/s00779-009-0263-2

This paper provides a framework for recording, analyzing and modeling of 3 dimensional emotional movements for embodied game applications. To foster embodied interaction, we need interfaces that can develop a complex, meaningful understanding of intention—both kinesthetic and emotional—as it emerges through natural human movement. The movements are emulated on robots or other devices with sensory-motor features as a part of games that aim improving the social interaction skills of children. The design of an example game platform that is used for training of children with autism is described since the type of the emotional behaviors depends on the embodiment of the robot and the context of the game. The results show that quantitative movement parameters can be matched to emotional state of the embodied agent (human or robot) using the Laban movement analysis. Emotional movements that were emulated on robots using this principle were tested with children in the age group 7–9. The tests show reliable recognition on most of the behaviors.