Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks

• Published in: arXiv.org
• Main Authors: Pan, Xiaoyu, Mai, Jiaming, Jiang, Xinwei, Tang, Dongxue, Li, Jingxiang, Shao, Tianjia, Zhou, Kun, Jin, Xiaogang, Manocha, Dinesh
• Format: Paper Journal Article
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 28.05.2022
• Subjects: Algorithms; Bones; Computer Science - Computer Vision and Pattern Recognition; Computer Science - Graphics; Computer Science - Learning; Finite element method; Garments; Machine learning; Metric space; Networks; Parameters; Simulation; Stiffness
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2205.01355

We present a learning algorithm that uses bone-driven motion networks to predict the deformation of loose-fitting garment meshes at interactive rates. Given a garment, we generate a simulation database and extract virtual bones from simulated mesh sequences using skin decomposition. At runtime, we separately compute low- and high-frequency deformations in a sequential manner. The low-frequency deformations are predicted by transferring body motions to virtual bones' motions, and the high-frequency deformations are estimated leveraging the global information of virtual bones' motions and local information extracted from low-frequency meshes. In addition, our method can estimate garment deformations caused by variations of the simulation parameters (e.g., fabric's bending stiffness) using an RBF kernel ensembling trained networks for different sets of simulation parameters. Through extensive comparisons, we show that our method outperforms state-of-the-art methods in terms of prediction accuracy of mesh deformations by about 20% in RMSE and 10% in Hausdorff distance and STED. The code and data are available at https://github.com/non-void/VirtualBones.