3D Human pose estimation: A review of the literature and analysis of covariates

• Published in: Computer vision and image understanding Vol. 152; pp. 1 - 20
• Main Authors: Sarafianos, Nikolaos, Boteanu, Bogdan, Ionescu, Bogdan, Kakadiaris, Ioannis A.
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.11.2016
• Subjects: 3D Human pose estimation; Anthropometry; Articulated tracking; Human motion analysis; Human motion analysis; Anthropometry; Articulated tracking; 3D Human pose estimation
• ISSN: 1077-3142; 1090-235X
• DOI: 10.1016/j.cviu.2016.09.002

•Review of the recent literature in 3D human pose estimation from RGB images and videos.•Release of a challenging, publicly available, 3D pose estimation synthetic dataset.•Extensive experimental evaluation of some representative state-of-the-art methods. Estimating the pose of a human in 3D given an image or a video has recently received significant attention from the scientific community. The main reasons for this trend are the ever increasing new range of applications (e.g., human-robot interaction, gaming, sports performance analysis) which are driven by current technological advances. Although recent approaches have dealt with several challenges and have reported remarkable results, 3D pose estimation remains a largely unsolved problem because real-life applications impose several challenges which are not fully addressed by existing methods. For example, estimating the 3D pose of multiple people in an outdoor environment remains a largely unsolved problem. In this paper, we review the recent advances in 3D human pose estimation from RGB images or image sequences. We propose a taxonomy of the approaches based on the input (e.g., single image or video, monocular or multi-view) and in each case we categorize the methods according to their key characteristics. To provide an overview of the current capabilities, we conducted an extensive experimental evaluation of state-of-the-art approaches in a synthetic dataset created specifically for this task, which along with its ground truth is made publicly available for research purposes. Finally, we provide an in-depth discussion of the insights obtained from reviewing the literature and the results of our experiments. Future directions and challenges are identified.