TSE-CNN: A Two-Stage End-to-End CNN for Human Activity Recognition

• Published in: IEEE journal of biomedical and health informatics Vol. 24; no. 1; pp. 292 - 299
• Main Authors: Huang, Jiahui, Lin, Shuisheng, Wang, Ning, Dai, Guanghai, Xie, Yuxiang, Zhou, Jun
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accelerometers; Accelerometry - methods; Accuracy; Activity recognition; Adult; Artificial neural networks; Background noise; Complexity; Computer applications; end-to-end; Feature extraction; Female; Geriatrics; Gyroscopes; Human Activities - classification; Human activity recognition; Humans; Legged locomotion; Male; Middle Aged; Monitoring; Monitoring, Ambulatory - methods; motion sensor; Movement - physiology; neural network; Neural networks; Neural Networks, Computer; Pattern Recognition, Automated; Power consumption; Rehabilitation; Support vector machines; Training; Voice recognition; Wearable Electronic Devices; Wearable technology; Young Adult
• ISSN: 2168-2194; 2168-2208; 2168-2208
• DOI: 10.1109/JBHI.2019.2909688

Human activity recognition has been widely used in healthcare applications such as elderly monitoring, exercise supervision, and rehabilitation monitoring. Compared with other approaches, sensor-based wearable human activity recognition is less affected by environmental noise and therefore is promising in providing higher recognition accuracy. However, one of the major issues of existing wearable human activity recognition methods is that although the average recognition accuracy is acceptable, the recognition accuracy for some activities (e.g., ascending stairs and descending stairs) is low, mainly due to relatively less training data and complex behavior pattern for these activities. Another issue is that the recognition accuracy is low when the training data from the test subject are limited, which is a common case in real practice. In addition, the use of neural network leads to large computational complexity and thus high power consumption. To address these issues, we proposed a new human activity recognition method with two-stage end-to-end convolutional neural network and a data augmentation method. Compared with the state-of-the-art methods (including neural network based methods and other methods), the proposed methods achieve significantly improved recognition accuracy and reduced computational complexity.