Ditto: Building Digital Twins of Articulated Objects from Interaction

• Published in: Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 5606 - 5616
• Main Authors: Jiang, Zhenyu, Hsu, Cheng-Chun, Zhu, Yuke
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2022
• Subjects: 3D from multi-view and sensors; Physics-based vision and shape-from-X; Representation learning; Buildings; Estimation; Geometry; Solid modeling; Three-dimensional displays; Virtual environments; Visualization

Digitizing physical objects into the virtual world has the potential to unlock new research and applications in embodied AI and mixed reality. This work focuses on recreating interactive digital twins of real-world articulated objects, which can be directly imported into virtual environments. We int...