High-quality 3D Clothing Reconstruction and Virtual-Try-On: Pants case

Thanh Tuan Thai, Youngsik Yun, Heejune Ahn

Abstract: Virtual try-on (VTON) is filling the gap between online and offline shopping. This paper extends Cloth3D, which uses top clothing only, and proposes a pipeline for high-resolution virtual try-on for pants based on 3D clothing reconstruction. In-shop pants image is first reconstructed into 3D by finding the SMPL body model fitted to the pants and building the clothing model. Then, the clothing model is reposed to the human reference image and projected to a 2D image to get 3D warped pants. These warped pants and the identities from the reference person image are going through the blending network to get the try-on. Moreover, a target segmentation is also estimated for control input for the blending (in-painting) network. Our experiments and evaluation on a new fashion dataset show natural VTON results for service.