Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

被引:8
|
作者
Wang, Gang [1 ]
Shi, Haibo [1 ]
Chen, Yufei [2 ]
Wu, Bin [3 ]
机构
[1] Shanghai Univ Finance & Econ, Inst Data Sci & Stat, Sch Stat & Management, Shanghai 200433, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, CAD Res Ctr, Shanghai 201804, Peoples R China
[3] Shanghai Univ Finance & Econ, Zhejiang Coll, Jinhua 321013, Peoples R China
基金
中国国家自然科学基金;
关键词
GAN; Image-to-image translation; Dual learning; Cycle consistency;
D O I
10.1007/s10489-022-04389-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cycle consistency conducts generative adversarial networks from aligned image pairs to unpaired training sets and can be applied to various image-to-image translations. However, the accumulation of errors that may occur during image reconstruction can affect the realism and quality of the generated images. To address this, we exploit a novel long and short cycle-consistent loss. This new loss is simple and easy to implement. Our dual-cycle constrained cross-domain image-to-image translation method can handle error accumulation and enforce adversarial learning. When image information is migrated from one domain to another, the cycle consistency-based image reconstruction constraint should be constrained in both short and long cycles to eliminate error accumulation. We adopt the cascading manner with dual-cycle consistency, where the reconstructed image in the first cycle can be cast as the new input to the next cycle. We show a distinct improvement over baseline approaches in most translation scenarios. With extensive experiments on several datasets, the proposed method is superior to several tested approaches.
引用
收藏
页码:17243 / 17259
页数:17
相关论文
共 50 条
  • [41] UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION VIA FAIR REPRESENTATI ON OF GENDER BIAS
    Hwang, Sunhee
    Byun, Hyeran
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1953 - 1957
  • [42] CROSS-SCENE HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON CYCLE-CONSISTENT ADVERSARIAL NETWORKS
    Meng, Zhihao
    Ye, Minchao
    Yao, Futian
    Xiong, Fengchao
    Qian, Yuntao
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1912 - 1915
  • [43] Image-to-Image Translation Using Identical-Pair Adversarial Networks
    Sung, Thai Leang
    Lee, Hyo Jong
    APPLIED SCIENCES-BASEL, 2019, 9 (13):
  • [44] Unsupervised Image-to-Image Translation with Generative Prior
    Yang, Shuai
    Jiang, Liming
    Liu, Ziwei
    Loy, Chen Change
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18311 - 18320
  • [45] Deceiving Image-to-Image Translation Networks for Autonomous Driving With Adversarial Perturbations
    Wang, Lin
    Cho, Wonjune
    Yoon, Kuk-Jin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 1421 - 1428
  • [46] LEVERAGING IMAGE-TO-IMAGE TRANSLATION GENERATIVE ADVERSARIAL NETWORKS FOR FACE AGING
    Pantraki, Evangelia
    Kotropoulos, Constantine
    Lanitis, Andreas
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8370 - 8374
  • [47] Unsupervised Standard Plane Synthesis in Population Cine MRI via Cycle-Consistent Adversarial Networks
    Zhang, Le
    Pereanez, Marco
    Bowles, Christopher
    Piechnik, Stefan K.
    Neubauer, Stefan
    Petersen, Steffen E.
    Frangi, Alejandro F.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 660 - 668
  • [48] Low-Dose CT Image Denoising Using Cycle-Consistent Adversarial Networks
    Li, Zeheng
    Huang, Junzhou
    Yu, Lifeng
    Chi, Yujie
    Jin, Mingwu
    2019 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2019,
  • [49] Edge Sensitive Unsupervised Image-to-Image Translation
    Akkaya, Ibrahim Batuhan
    Halici, Ugur
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [50] DuCaGAN: Unified Dual Capsule Generative Adversarial Network for Unsupervised Image-to-Image Translation
    Shao, Guifang
    Huang, Meng
    Gao, Fengqiang
    Liu, Tundong
    Li, Liduan
    IEEE ACCESS, 2020, 8 : 154691 - 154707