Prediction of asynchronous dimensional emotion ratings from audiovisual and physiological data

• Published in: Pattern recognition letters Vol. 66; pp. 22 - 30
• Main Authors: Ringeval, Fabien, Eyben, Florian, Kroupi, Eleni, Yuce, Anil, Thiran, Jean-Philippe, Ebrahimi, Touradj, Lalanne, Denis, Schuller, Björn
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 15.11.2015
• Subjects: Audiovisual and physiological data; Context-learning long short-term memory recurrent neural networks; Continuous affect analysis; Multi-task learning; Multimodal fusion; Multitime resolution features extraction; Context-learning long short-term memory recurrent neural networks; Multitime resolution features extraction; Audiovisual and physiological data; Continuous affect analysis; Multi-task learning; Multimodal fusion

•We study the relevance of context-learning for handling asynchrony of annotation.•We unite audiovisual and physiological data for continuous affect analysis.•We propose multi-time resolution features extraction from multimodal data.•The use of context-learning allows to include reaction time delay...