Multi-modal depression detection based on emotional audio and evaluation text

• Published in: Journal of affective disorders Vol. 295; pp. 904 - 913
• Main Authors: Ye, Jiayu, Yu, Yanhong, Wang, Qingxiang, Li, Wentao, Liang, Hu, Zheng, Yunshao, Fu, Gang
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.12.2021
• Subjects: Artificial intelligence; Deep learning; Depression; Multi-modality; Psychiatric/Mental Health; Deep learning; Depression; Artificial intelligence; Multi-modality

•We propose and prove a text reading experiment to make subjects emotions change rapidly.•Features analysis (Low-level audio features, DeepSpectrum features and word vector features).•Our research propose a multimodal fusion method based on DeepSpectrum features and word vector features to detect de...