LC-VTON: Length Controllable Virtual Try-On Network

被引:1
|
作者
Yao, Jinliang [1 ,2 ]
Zheng, Haonan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
[2] Zhejiang Key Lab Brain Machine Collaborat Intellig, Hangzhou 310018, Peoples R China
关键词
Virtual try-on; clothing length controllable; conditional semantic generation; generative adversarial network;
D O I
10.1109/ACCESS.2023.3306449
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image-based virtual try-on provides customers with convenient online clothes selections by transferring garments onto a reference person. Despite the emergence of several solutions to generate photo-realistic images and adapt to complex poses, controlling clothing length remains a challenge. We argue that the clothing reconstruction did not consider clothing length information, which results in clothing length being uncontrollable in most virtual try-on methods. To overcome this limitation, a novel clothing-agnostic person representation is proposed, which eliminates clothing information and quantifies clothing length as a numerical value. A new segmentation generator is designed to predict try-on segmentation maps of any length conditioned on this representation. Moreover, we correct two inaccurate labels, which enables our model to utilize clothing length control to generate a wider range of garment interactions in images, such as the top tucked into or worn over the bottom, as well as the top and bottom worn separately without intersecting. Extensive experiments demonstrate that our method achieves the goal of continuous clothing length control and generates photo-realistic images with fine details that outperform most baseline methods in terms of quantitative and qualitative metrics.
引用
收藏
页码:88451 / 88461
页数:11
相关论文
共 50 条
  • [31] IMAGE-BASED VIRTUAL TRY-ON NETWORK WITH STRUCTURAL COHERENCE
    Sun, Feng
    Guo, Jiaming
    Su, Zhuo
    Gao, Chengying
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 519 - 523
  • [32] CAFANet: Cascade Appearance Flow Assemble Network for Virtual Try-On
    Ke, Liang-Ying
    Liao, Jocelyn
    Hsia, Chih-Hsien
    2024 11TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-TAIWAN, ICCE-TAIWAN 2024, 2024, : 505 - 506
  • [33] Image Based Virtual Try-on Network from Unpaired Data
    Neuberger, Assaf
    Borenstein, Eran
    Hilleli, Bar
    Oks, Eduard
    Alpert, Sharon
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5183 - 5192
  • [34] Towards Multi-pose Guided Virtual Try-on Network
    Dong, Haoye
    Liang, Xiaodan
    Shen, Xiaohui
    Wang, Bochao
    Lai, Hanjiang
    Zhu, Jia
    Hu, Zhiting
    Yin, Jian
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9025 - 9034
  • [35] Generative-Adversarial-Network-Based Virtual Try-On Method
    Zhang S.
    Wang Q.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2021, 54 (09): : 925 - 933
  • [36] Multi-Scene Virtual Try-on Network Guided by Attributes
    Lv, Xiaoyang
    Zhang, Bo
    Li, Jie
    Cao, Yangjie
    Yang, Cong
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 161 - 165
  • [37] Size Does Matter: Size-aware Virtual Try-on via Clothing-oriented Transformation Try-on Network
    Chen, Chieh-Yun
    Chen, Yi-Chung
    Shuai, Hong-Han
    Cheng, Wen-Huang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7479 - 7488
  • [38] CloTH-VTON plus : Clothing Three-Dimensional Reconstruction for Hybrid Image-Based Virtual Try-ON
    Minar, Matiur Rahman
    Tuan, Thai Thanh
    Ahn, Heejune
    IEEE ACCESS, 2021, 9 : 30960 - 30978
  • [39] TOAC: Try-On Aligning Conformer for Image-Based Virtual Try-On Alignment
    Wang, Yifei
    Xiang, Wang
    Zhang, Shengjie
    Xue, Dizhan
    Qian, Shengsheng
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT II, 2024, 14474 : 29 - 40
  • [40] Analysis of Application for Virtual Try-on System
    Lu, Pan
    Shan, Yu-Fu
    TEXTILE BIOENGINEERING AND INFORMATICS SYMPOSIUM PROCEEDINGS, VOLS 1-3, 2011, : 1274 - 1279