Human pose regression by combining indirect part detection and contextual information

• Published in: Computers & graphics Vol. 85; pp. 15 - 22
• Main Authors: Luvizon, Diogo C., Tabia, Hedi, Picard, David
• Format: Journal Article
• Language: English
• Published: Oxford Elsevier Ltd 01.12.2019; Elsevier Science Ltd; Elsevier
• Subjects: Computer Science; Computer vision; Datasets; Feature maps; Graphical representations; Ground truth; Human pose estimation; Image annotation; Man-machine interfaces; Neural and Evolutionary Computing; Neural nets; Regression; Signal and Image Processing; Source code; Neural nets; Computer vision; Human pose estimation
• ISSN: 0097-8493; 1873-7684
• DOI: 10.1016/j.cag.2019.09.002

•A new human pose regression method from RGB images.•The proposed soft-argmax operation.•Contextual aggregation for refining predictions.•State-of-the-art results on important 2D pose estimation benchmarks among regression methods. [Display omitted] In this paper, we tackle the problem of human pose estimation from still images, which is a very active topic, specially due to its several applications, from image annotation to human-machine interface. We use the soft-argmax function to convert feature maps directly to body joint coordinates, resulting in a fully differentiable framework. Our method is able to learn heat maps representations indirectly, without additional steps of artificial ground truth generation. Consequently, contextual information can be included to the pose predictions in a seamless way. We evaluated our method on two challenging datasets, the Leeds Sports Poses (LSP) and the MPII Human Pose datasets, reaching the best performance among all the existing regression methods. Source code available at: https://github.com/dluvizon/pose-regression.