LC-VTON: Length Controllable Virtual Try-On Network

被引:1
|
作者
Yao, Jinliang [1 ,2 ]
Zheng, Haonan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
[2] Zhejiang Key Lab Brain Machine Collaborat Intellig, Hangzhou 310018, Peoples R China
关键词
Virtual try-on; clothing length controllable; conditional semantic generation; generative adversarial network;
D O I
10.1109/ACCESS.2023.3306449
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image-based virtual try-on provides customers with convenient online clothes selections by transferring garments onto a reference person. Despite the emergence of several solutions to generate photo-realistic images and adapt to complex poses, controlling clothing length remains a challenge. We argue that the clothing reconstruction did not consider clothing length information, which results in clothing length being uncontrollable in most virtual try-on methods. To overcome this limitation, a novel clothing-agnostic person representation is proposed, which eliminates clothing information and quantifies clothing length as a numerical value. A new segmentation generator is designed to predict try-on segmentation maps of any length conditioned on this representation. Moreover, we correct two inaccurate labels, which enables our model to utilize clothing length control to generate a wider range of garment interactions in images, such as the top tucked into or worn over the bottom, as well as the top and bottom worn separately without intersecting. Extensive experiments demonstrate that our method achieves the goal of continuous clothing length control and generates photo-realistic images with fine details that outperform most baseline methods in terms of quantitative and qualitative metrics.
引用
收藏
页码:88451 / 88461
页数:11
相关论文
共 50 条
  • [21] A virtual try-on network with arm region preservation
    Zhang, Xin
    Chen, Jinguang
    Ma, Lili
    Zhang, Kaibing
    APPLIED SOFT COMPUTING, 2025, 175
  • [22] Slot-VTON: subject-driven diffusion-based virtual try-on with slot attention
    Ye, Jianglei
    Wang, Yigang
    Xie, Fengmao
    Wang, Qin
    Gu, Xiaoling
    Wu, Zizhao
    VISUAL COMPUTER, 2024, : 3297 - 3308
  • [23] ST-VTON: Self-supervised vision transformer for image-based virtual try-on
    Chong, Zheng
    Mo, Lingfei
    IMAGE AND VISION COMPUTING, 2022, 127
  • [24] CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Model
    Zeng, Jianhao
    Song, Dan
    Nie, Weizhi
    Tian, Hongshuo
    Wang, Tongtong
    Liu, An-An
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8372 - 8382
  • [25] NL-VTON: a non-local virtual try-on network with feature preserving of body and clothes (vol 11, 19950, 2021)
    Tan, Ze Lin
    Bai, Jing
    Zhang, Shao Min
    Qin, Fei Wei
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [26] VTON-MP: Multi-Pose Virtual Try-On via Appearance Flow and Feature Filtering
    Yu, Feng
    Hua, Ailing
    Du, Chenghu
    Jiang, Minghua
    Wei, Xiong
    Peng, Tao
    Xu, Lijun
    Hu, Xinrong
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2023, 69 (04) : 1101 - 1113
  • [27] VITON: An Image-based Virtual Try-on Network
    Han, Xintong
    Wu, Zuxuan
    Wu, Zhe
    Yu, Ruichi
    Davis, Larry S.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7543 - 7552
  • [28] Virtual Try-on Network With Attribute Transformation and Local Rendering
    Xu, Jun
    Pu, Yuanyuan
    Nie, Rencan
    Xu, Dan
    Zhao, Zhengpeng
    Qian, Wenhua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 2222 - 2234
  • [29] PG-VTON: A Novel Image-Based Virtual Try-On Method via Progressive Inference Paradigm
    Fang, Naiyu
    Qiu, Lemiao
    Zhang, Shuyou
    Wang, Zili
    Hu, Kerui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6595 - 6608
  • [30] SVTON: Simplified Virtual Try-On
    Islam, Tasin
    Miron, Alina
    Liu, XiaoHui
    Li, Yongmin
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 369 - 374