Part Aware Graph Convolution Network with Temporal Enhancement for Skeleton-Based Action Recognition

• Published in: 2023 IEEE International Conference on Image Processing (ICIP) pp. 3255 - 3259
• Main Authors: Huang, Qian, Nie, Yunqing, Li, Xing, Yang, Tianjin
• Format: Conference Proceeding
• Language: English
• Published: IEEE 08.10.2023
• Subjects: Convolution; Convolutional neural networks; Data mining; Focusing; Graph convolution network; Human action recognition; Human activity recognition; Image recognition; Skeleton
• DOI: 10.1109/ICIP49359.2023.10222714

In recent years, skeleton-based human action recognition has attracted broad research interests, and methods based on graph convolution networks have demonstrated excellent performance. However, how to extract the distinguishing spatio-temporal information effectively remains an essential problem. To address the problem, we propose a novel part aware graph convolution network with temporal enhancement, which can adaptively evaluate the activity level of each part of the body in the action sequence and enhance the extraction of temporal information. Considering that the range of motion of body parts in the action sequence is greater than that of joints, we manually divide the five major parts of the body and generate a skeleton sequence with different attention weights by using part-based attention module. Then, a temporal enhanced module is used to model actions with different duration. Experiments show that our method achieves the state-of-the-art performance.