Automatic Calibration of the Fisheye Camera for Egocentric 3D Human Pose Estimation from a Single Image

We propose a method for egocentric 3D human pose estimation from a single image captured by a fisheye camera. The problem of estimating the egocentric 3D pose for a fisheye camera is that images may be subject to strong image distortions (e.g. 2D poses on the image plane that pass through the line o...

Full description

Saved in:
Bibliographic Details
Published inProceedings / IEEE Workshop on Applications of Computer Vision pp. 1771 - 1780
Main Authors Zhang, Yahui, You, Shaodi, Gevers, Theo
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.01.2021
Subjects
Calibration
Cameras
Computer vision
Conferences
Distortion
Pose estimation
Three-dimensional displays
Online AccessGet full text

Cover

More Information
Summary:We propose a method for egocentric 3D human pose estimation from a single image captured by a fisheye camera. The problem of estimating the egocentric 3D pose for a fisheye camera is that images may be subject to strong image distortions (e.g. 2D poses on the image plane that pass through the line of sight of the fisheye lens).Therefore, in this paper, we approach this problem by an automatic calibration module. Given a single image, our network first estimates 3D joint locations of a human in camera coordinates. To alleviate the impact of image distortions on 3D human pose estimation, we then use the automatic calibration to further regularize the 3D predictions. Experimental results demonstrate that the proposed method achieves state-of-the-art performance.
ISSN:2642-9381
DOI:10.1109/WACV48630.2021.00181