GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB

• Published in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition pp. 49 - 59
• Main Authors: Mueller, Franziska, Bernard, Florian, Sotnychenko, Oleksandr, Mehta, Dushyant, Sridhar, Srinath, Casas, Dan, Theobalt, Christian
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2018
• Subjects: Cameras; Pose estimation; Real-time systems; Streaming media; Three-dimensional displays; Tracking; Two dimensional displays

We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Our tracking method combines a convolutional neural network with a kinematic 3D hand model, such that it generalizes well to unseen data, is robust to occlusions and varying camera viewpoi...