A Multimodal Database as a Background for Emotional Synthesis, Recognition and Training in E-Learning Systems

• Published in: Affective Computing and Intelligent Interaction pp. 566 - 573
• Main Authors: Anolli, Luigi, Mantovani, Fabrizia, Mortillaro, Marcello, Vescovo, Antonietta, Agliati, Alessia, Confalonieri, Linda, Realdon, Olivia, Zurloni, Valentino, Sacchi, Alessandro
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2005; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Affective Computing; Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Emotion Recognition System; Emotional Speech; Exact sciences and technology; Facial Expression; Interactive Simulation; Software; Man machine system; Cognition; Emotion emotionality; Remote teaching; Teaching; Posture; Interactive system; Relevance; Educational software program; User interface; Facies; Database; Internet; Learning algorithm; Facial expression
• ISBN: 3540296212; 9783540296218
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11573548_73

This paper presents a multimodal database developed within the EU-funded project MYSELF. The project aims at developing an e-learning platform endowed with affective computing capabilities for the training of relational skills through interactive simulations. The database includes data coming from 34 participants and concerning physiological parameters, vocal nonverbal features, facial expression and posture. Ten different emotions were considered (anger, joy, sadness, fear, contempt, shame, guilt, pride, frustration and boredom), ranging from primary to self-conscious emotions of particular relevance in learning process and interpersonal relationships. Preliminary results and analyses are presented, together with directions for future work.