Markerless Motion Capture with unsynchronized moving cameras

In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld...

Full description

Saved in:
Bibliographic Details
Published in2009 IEEE Conference on Computer Vision and Pattern Recognition pp. 224 - 231
Main Authors Hasler, Nils, Rosenhahn, Bodo, Thormahlen, Thorsten, Wand, Michael, Gall, Juergen, Seidel, Hans-Peter
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2009
Subjects
Cameras
Computer graphics
Computer vision
Geometry
Hardware
Humans
Image reconstruction
Layout
Streaming media
Surface reconstruction
Online AccessGet full text

Cover

More Information
Summary:In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.
ISBN:1424439922
9781424439928
ISSN:1063-6919
1063-6919
DOI:10.1109/CVPR.2009.5206859