VITON: An Image-Based Virtual Try-on Network

We present an image-based VIirtual Try-On Network (VITON) without using 3D information in any form, which seamlessly transfers a desired clothing item onto the corresponding region of a person using a coarse-to-fine strategy. Conditioned upon a new clothing-agnostic yet descriptive person representa...

Full description

Saved in:
Bibliographic Details
Published in2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition pp. 7543 - 7552
Main Authors Han, Xintong, Wu, Zuxuan, Wu, Zhe, Yu, Ruichi, Davis, Larry S.
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2018
Subjects
Generators
Shape
Strain
Task analysis
Three-dimensional displays
Two dimensional displays
Online AccessGet full text

Cover

More Information
Summary:We present an image-based VIirtual Try-On Network (VITON) without using 3D information in any form, which seamlessly transfers a desired clothing item onto the corresponding region of a person using a coarse-to-fine strategy. Conditioned upon a new clothing-agnostic yet descriptive person representation, our framework first generates a coarse synthesized image with the target clothing item overlaid on that same person in the same pose. We further enhance the initial blurry clothing area with a refinement network. The network is trained to learn how much detail to utilize from the target clothing item, and where to apply to the person in order to synthesize a photo-realistic image in which the target item deforms naturally with clear visual patterns. Experiments on our newly collected Zalando dataset demonstrate its promise in the image-based virtual try-on task over state-of-the-art generative models.1
ISSN:1063-6919
DOI:10.1109/CVPR.2018.00787