Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action

• Published in: Frontiers in neurology Vol. 13; p. 905917
• Main Authors: Yu, Yanhong, Li, Wentao, Zhao, Yue, Ye, Jiayu, Zheng, Yunshao, Liu, Xinxin, Wang, Qingxiang
• Format: Journal Article
• Language: English
• Published: Frontiers Media S.A 30.06.2022
• Subjects: deep learning; depression recognition; human skeleton; kinect sensor; Neurology; temporal convolution network
• ISSN: 1664-2295; 1664-2295
• DOI: 10.3389/fneur.2022.905917

Relative limb movement is an important feature in assessing depression. In this study, we looked into whether a skeleton-mimetic task using natural stimuli may help people recognize depression. We innovatively used Kinect V2 to collect participant data. Sequential skeletal data was directly extracted from the original Kinect-3D and tetrad coordinates of the participant's 25 body joints. Two constructed skeletal datasets of whole-body joints (including binary classification and multi classification) were input into the proposed model for depression recognition after data preparation. We improved the temporal convolution network (TCN), creating novel spatial attention dilated TCN (SATCN) network that included a hierarchy of temporal convolution groups with different dilated convolution scales to capture important skeletal features and a spatial attention block for final result prediction. The depression and non-depression groups can be classified automatically with a maximum accuracy of 75.8% in the binary classification task, and 64.3% accuracy in the multi classification dataset to recognize more fine-grained identification of depression severity, according to experimental results. Our experiments and methods based on Kinect V2 can not only identify and screen depression patients but also effectively observe the recovery level of depression patients during the recovery process. For example, in the change from severe depression to moderate or mild depression multi classification dataset.