Can mood primitives predict apparent personality?

• Published in: International Conference on Affective Computing and Intelligent Interaction and workshops pp. 1 - 8
• Main Authors: Sogancioglu, Gizem, Kaya, Heysem, Salah, Albert Ali
• Format: Conference Proceeding
• Language: English
• Published: IEEE 28.09.2021
• Subjects: Affective computing; arousal; Benchmark testing; Big Five personality traits; Boosting; Linguistics; Mood; mood recognition; multimodal fusion; Predictive models; valence; Visualization
• ISSN: 2156-8111
• DOI: 10.1109/ACII52823.2021.9597444

First impressions play a critical role in shaping social interactions and consequently have a high impact on people's lives. This study presents an explainable system that models apparent personality traits that influence first impressions as a function of automatically predicted arousal, valence and likeability (AVL) scores. To this end, we enrich the ChaLearn Looking at People - First Impressions (LAP-FI) dataset by annotating a portion of it for the AVL dimensions and carry out extensive uni-modal and multimodal experiments by using state-of-the-art acoustic, visual and linguistic features. We propose to use a glass-box model, namely, Explainable Boosting Machine, to model the Big Five personality traits. Our results demonstrate that personality trait impressions can be effectively predicted through the mood and likeability scores of a given video. We show that the proposed model, which is trained on only a few features, not only provides more meaningful explanations but also yields competitive performance (with a 0.09 Mean Absolute Error) compared to the state-of-the-art methods. The annotated benchmark dataset and the scripts to reproduce the results are available at: https://github.com/gizemsogancioglu/mood-project.