Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities

• Published in: Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 12458 - 12468
• Main Authors: Li, Mingcheng, Yang, Dingkang, Zhao, Xiao, Wang, Shuaibing, Wang, Yan, Yang, Kun, Sun, Mingyang, Kou, Dongliang, Qian, Ziyun, Zhang, Lihua
• Format: Conference Proceeding
• Language: English
• Published: IEEE 16.06.2024
• Subjects: Computer vision; Contrastive learning; Correlation; Incomplete multimodal learning; Multimodal sentiment analysis; Prototypes; Refining; Semantics; Sentiment analysis

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause uncertain modality missingness, which drastically degrades the mode...