MF ^-Net: Exploring a Meta-Fuzzy Multimodal Fusion Network for Depression Recognition

• Published in: IEEE transactions on fuzzy systems pp. 1 - 13
• Main Authors: Shen, Jian, Wu, Jinwen, Zhang, Yanan, Zhu, Kexin, Wang, Kang, Hu, Wenbo, Hou, Kechen, Qian, Kun, Zhang, Xiaowei, Hu, Bin
• Format: Journal Article
• Language: English
• Published: IEEE 2025
• Subjects: Adaptation models; Brain modeling; Depression; Depression recognition; Electroencephalography; Feature extraction; Fuzzy Integral; Fuzzy systems; Meta-learning; Metalearning; Multimodal fusion; Physiology; Speech recognition; Training
• ISSN: 1063-6706; 1941-0034
• DOI: 10.1109/TFUZZ.2025.3569888

Depression is a prevalent mental illness that significantly impacts the well-being of individuals and the development of society. The current diagnostic methods are largely subjective and time-consuming. Moreover, the existing machine learning-based depression recognition methods struggle to fully exploit the collaborative benefits between modalities, lack interpretability in their fusion processes, and perform inadequately in few-shot depression recognition tasks. To address these challenges, we propose a meta-fuzzy multimodal fusion network (MF<inline-formula><tex-math notation="LaTeX">^{2}</tex-math></inline-formula>-Net) for depression recognition. This innovative approach integrates physiological signals and behavioral data, employs multiple MLPs to learn the fuzzy measures of single base learners and complementary increments, then constructs all fuzzy measures, and finally achieves an interpretable decision-level fusion process through fuzzy integrals. Furthermore, we incorporate model-agnostic meta-learning for conducting few-shot domain-adaptive training, mitigating the issues related to high individual variability levels and the scarcity of multimodal depression data. Our method demonstrates exceptional classification performance in subject-independent experiments implemented on public datasets; offers a reliable solution for objectively, effectively, and conveniently recognizing depression; and has the potential to promote the clinical applications of rapid intelligent depression diagnosis.