Learning an intrinsic garment space for interactive authoring of garment animation

• Published in: ACM transactions on graphics Vol. 38; no. 6; pp. 1 - 12
• Main Authors: Wang, Tuanfeng Y., Shao, Tianjia, Fu, Kai, Mitra, Niloy J.
• Format: Journal Article
• Language: English
• Published: New York, NY, USA ACM 08.11.2019
• Subjects: Animation; Computer graphics; Computing methodologies; Machine learning; Machine learning approaches; Neural networks; Shape modeling; interactive garment animation authoring; latent representation; intrinsic garment space
• DOI: 10.1145/3355089.3356512
• ISSN: 0730-0301

Authoring dynamic garment shapes for character animation on body motion is one of the fundamental steps in the CG industry. Established workflows are either time and labor consuming (i.e., manual editing on dense frames with controllers), or lack keyframe-level control (i.e., physically-based simulation). Not surprisingly, garment authoring remains a bottleneck in many production pipelines. Instead, we present a deep-learning-based approach for semi-automatic authoring of garment animation, wherein the user provides the desired garment shape in a selection of keyframes, while our system infers a latent representation for its motion-independent intrinsic parameters (e.g., gravity, cloth materials, etc.). Given new character motions, the latent representation allows to automatically generate a plausible garment animation at interactive rates. Having factored out character motion, the learned intrinsic garment space enables smooth transition between keyframes on a new motion sequence. Technically, we learn an intrinsic garment space with an motion-driven autoencoder network, where the encoder maps the garment shapes to the intrinsic space under the condition of body motions, while the decoder acts as a differentiable simulator to generate garment shapes according to changes in character body motion and intrinsic parameters. We evaluate our approach qualitatively and quantitatively on common garment types. Experiments demonstrate our system can significantly improve current garment authoring workflows via an interactive user interface. Compared with the standard CG pipeline, our system significantly reduces the ratio of required keyframes from 20% to 1 -- 2%.