Articulated structure from motion by factorization

• Published in: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) Vol. 2; pp. 1110 - 1115 vol. 2
• Main Authors: Tresadern, P., Reid, I.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2005
• Subjects: Cameras; Computer vision; Humans; Layout; Motion detection; Motion segmentation; Object detection; Shape; Stability; Tracking
• ISBN: 0769523722; 9780769523729
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2005.75

Multibody affine structure from motion (SFM) methods commonly assume independent motion between objects such that the 'measurement matrix' has rank 4k. When multiple views are available, each object is then independently calibrated to a metric co-ordinate frame. However, articulated motion results in a further decrease in rank - a fact that we exploit to detect articulated objects and determine their degrees of freedom using simple linear methods. Furthermore, these objects cannot be recovered and calibrated independently since this violates articulation constraints. We show that articulation constraints can be imposed during factorization and self-calibration to recover consistent 3D structure and motion, from which link lengths and joint angles can be computed. The stability of the method is evaluated using synthetic data for comparison with ground truth and results are also presented for real image sequences.