Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

被引:8
|
作者
Wang, Gang [1 ]
Shi, Haibo [1 ]
Chen, Yufei [2 ]
Wu, Bin [3 ]
机构
[1] Shanghai Univ Finance & Econ, Inst Data Sci & Stat, Sch Stat & Management, Shanghai 200433, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, CAD Res Ctr, Shanghai 201804, Peoples R China
[3] Shanghai Univ Finance & Econ, Zhejiang Coll, Jinhua 321013, Peoples R China
基金
中国国家自然科学基金;
关键词
GAN; Image-to-image translation; Dual learning; Cycle consistency;
D O I
10.1007/s10489-022-04389-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cycle consistency conducts generative adversarial networks from aligned image pairs to unpaired training sets and can be applied to various image-to-image translations. However, the accumulation of errors that may occur during image reconstruction can affect the realism and quality of the generated images. To address this, we exploit a novel long and short cycle-consistent loss. This new loss is simple and easy to implement. Our dual-cycle constrained cross-domain image-to-image translation method can handle error accumulation and enforce adversarial learning. When image information is migrated from one domain to another, the cycle consistency-based image reconstruction constraint should be constrained in both short and long cycles to eliminate error accumulation. We adopt the cascading manner with dual-cycle consistency, where the reconstructed image in the first cycle can be cast as the new input to the next cycle. We show a distinct improvement over baseline approaches in most translation scenarios. With extensive experiments on several datasets, the proposed method is superior to several tested approaches.
引用
收藏
页码:17243 / 17259
页数:17
相关论文
共 50 条
  • [31] CSAGAN: Channel and Spatial Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Yang, Rui
    Peng, Chao
    Wang, Chenchao
    Wang, Mengdan
    Chen, Yao
    Zheng, Peng
    Xiong, Neal N.
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 3258 - 3265
  • [32] Multimodal Unsupervised Image-to-Image Translation
    Huang, Xun
    Liu, Ming-Yu
    Belongie, Serge
    Kautz, Jan
    COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 179 - 196
  • [33] Unsupervised Image-to-Image Translation: A Review
    Hoyez, Henri
    Schockaert, Cedric
    Rambach, Jason
    Mirbach, Bruno
    Stricker, Didier
    SENSORS, 2022, 22 (21)
  • [34] Crossing-Domain Generative Adversarial Networks for Unsupervised Multi-Domain Image-to-Image Translation
    Yang, Xuewen
    Xie, Dongliang
    Wang, Xin
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 374 - 382
  • [35] ZstGAN: An adversarial approach for Unsupervised Zero-Shot Image-to-image Translation
    Lin, Jianxin
    Xia, Yingce
    Liu, Sen
    Zhao, Shuxin
    Chen, Zhibo
    NEUROCOMPUTING, 2021, 461 : 327 - 335
  • [36] Unsupervised Generative Adversarial Networks with Cross-model Weight Transfer Mechanism for Image-to-image Translation
    Lai, Xuguang
    Bai, Xiuxiu
    Hao, Yongqiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1814 - 1822
  • [37] On Translation and Reconstruction Guarantees of the Cycle-Consistent Generative Adversarial Networks
    Chakrabarty, Anish
    Das, Swagatam
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [38] Unsupervised Deformable Image Registration Using Cycle-Consistent CNN
    Kim, Boah
    Kim, Jieun
    Lee, June-Goo
    Kim, Dong Hwan
    Park, Seong Ho
    Ye, Jong Chul
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 166 - 174
  • [39] Perceptual Contrastive Generative Adversarial Network based on image warping for unsupervised image-to-image translation
    Huang, Lin-Chieh
    Tsai, Hung-Hsu
    NEURAL NETWORKS, 2023, 166 : 313 - 325
  • [40] Image steganography based on smooth cycle-consistent adversarial learning
    Abdollahi, Behnaz
    Harati, Ahad
    Taherinia, Amir Hossein
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2023, 79