GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition

• Published in: IEEE transactions on multimedia Vol. 26; pp. 77 - 89
• Main Authors: Li, Jiang, Wang, Xiaoping, Lv, Guoqing, Zeng, Zhigang
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Acoustics; Context modeling; cross-modal feature complementation; Emotion recognition; Emotion recognition in conversation; Emotions; Graph neural networks; Graph theory; Heterogeneity; Human-computer interface; Machine learning; Message passing; multimodal fusion; Oral communication; Task analysis; Visualization

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph Neural Networks (GNNs) have been widely used in a variety of fie...