SmartMocap: Joint Estimation of Human and Camera Motion Using Uncalibrated RGB Cameras

• Published in: IEEE robotics and automation letters Vol. 8; no. 6; pp. 3206 - 3213
• Main Authors: Saini, Nitin, Huang, Chun-Hao P., Black, Michael J., Ahmad, Aamir
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.06.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Biological system modeling; Calibration; Cameras; Coordinates; deep learning for visual perception; Gesture; Ground plane; Human body; human detection and tracking; Human motion; Motion capture; Optimization; posture and facial expressions; Robot vision systems; Sequences; Shape; Trajectory

Markerless human motion capture (mocap) from multiple RGB cameras is a widely studied problem. Existing methods either need calibrated cameras or calibrate them relative to a static camera, which acts as the reference frame for the mocap system. The calibration step has to be done a priori for every...