LC-VTON: Length Controllable Virtual Try-On Network

被引:1
|
作者
Yao, Jinliang [1 ,2 ]
Zheng, Haonan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
[2] Zhejiang Key Lab Brain Machine Collaborat Intellig, Hangzhou 310018, Peoples R China
关键词
Virtual try-on; clothing length controllable; conditional semantic generation; generative adversarial network;
D O I
10.1109/ACCESS.2023.3306449
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image-based virtual try-on provides customers with convenient online clothes selections by transferring garments onto a reference person. Despite the emergence of several solutions to generate photo-realistic images and adapt to complex poses, controlling clothing length remains a challenge. We argue that the clothing reconstruction did not consider clothing length information, which results in clothing length being uncontrollable in most virtual try-on methods. To overcome this limitation, a novel clothing-agnostic person representation is proposed, which eliminates clothing information and quantifies clothing length as a numerical value. A new segmentation generator is designed to predict try-on segmentation maps of any length conditioned on this representation. Moreover, we correct two inaccurate labels, which enables our model to utilize clothing length control to generate a wider range of garment interactions in images, such as the top tucked into or worn over the bottom, as well as the top and bottom worn separately without intersecting. Extensive experiments demonstrate that our method achieves the goal of continuous clothing length control and generates photo-realistic images with fine details that outperform most baseline methods in terms of quantitative and qualitative metrics.
引用
收藏
页码:88451 / 88461
页数:11
相关论文
共 50 条
  • [1] WAS-VTON: Warping Architecture Search for Virtual Try-on Network
    Xie, Zhenyu
    Zhang, Xujie
    Zhao, Fuwei
    Dong, Haoye
    Kampffmeyer, Michael C.
    Yan, Haonan
    Liang, Xiaodan
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3350 - 3359
  • [2] DO-VTON: a details-oriented virtual try-on network
    Luo, Weihao
    Zhong, Yueqi
    INTERNATIONAL JOURNAL OF CLOTHING SCIENCE AND TECHNOLOGY, 2023, 35 (04) : 565 - 580
  • [3] UF-VTON: Toward User-Friendly Virtual Try-On Network
    Chang, Yuan
    Peng, Tao
    He, Ruhan
    Hu, Xinrong
    Liu, Junping
    Zhang, Zili
    Jiang, Minghua
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 313 - 321
  • [4] VTON-HF: High Fidelity Virtual Try-on Network via Semantic Adaptation
    Du, Chenghu
    Yu, Feng
    Chen, Yadong
    Jiang, Minghua
    Wei, Xiong
    Peng, Tao
    Hu, Xinrong
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 224 - 231
  • [5] KF-VTON: Keypoints-Driven Flow Based Virtual Try-On Network
    Wu, Zizhao
    Liu, Siyu
    Lu, Peioyan
    Yang, Ping
    Wong, Yongkang
    Gu, Xiaoling
    Kankanhalli, Mohan s.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (09)
  • [6] VTON-SCFA: A Virtual Try-On Network Based on the Semantic Constraints and Flow Alignment
    Du, Chenghu
    Yu, Feng
    Jiang, Minghua
    Hua, Ailing
    Wei, Xiong
    Peng, Tao
    Hu, Xinrong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 777 - 791
  • [7] C-VTON: Context-Driven Image-Based Virtual Try-On Network
    Fele, Benjamin
    Lampe, Ajda
    Peer, Peter
    Struc, Vitomir
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2203 - 2212
  • [8] M3D-VTON: A Monocular-to-3D Virtual Try-On Network
    Zhao, Fuwei
    Xie, Zhenyu
    Kampffmeyer, Michael
    Dong, Haoye
    Han, Songfang
    Zheng, Tianxiang
    Zhang, Tao
    Liang, Xiaodan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13219 - 13229
  • [9] FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on
    Wang, Chenhui
    Chen, Tao
    Chen, Zhihao
    Huang, Zhizhong
    Jiang, Taoran
    Wang, Qi
    Shan, Hongming
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 1362 - 1370
  • [10] DP-VTON: TOWARD DETAIL-PRESERVING IMAGE-BASED VIRTUAL TRY-ON NETWORK
    Chang, Yuan
    Peng, Tao
    He, Ruhan
    Hu, Xinrong
    Liu, Junping
    Zhang, Zili
    Jiang, Minghua
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2295 - 2299