Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

被引:8
|
作者
Wang, Gang [1 ]
Shi, Haibo [1 ]
Chen, Yufei [2 ]
Wu, Bin [3 ]
机构
[1] Shanghai Univ Finance & Econ, Inst Data Sci & Stat, Sch Stat & Management, Shanghai 200433, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, CAD Res Ctr, Shanghai 201804, Peoples R China
[3] Shanghai Univ Finance & Econ, Zhejiang Coll, Jinhua 321013, Peoples R China
基金
中国国家自然科学基金;
关键词
GAN; Image-to-image translation; Dual learning; Cycle consistency;
D O I
10.1007/s10489-022-04389-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cycle consistency conducts generative adversarial networks from aligned image pairs to unpaired training sets and can be applied to various image-to-image translations. However, the accumulation of errors that may occur during image reconstruction can affect the realism and quality of the generated images. To address this, we exploit a novel long and short cycle-consistent loss. This new loss is simple and easy to implement. Our dual-cycle constrained cross-domain image-to-image translation method can handle error accumulation and enforce adversarial learning. When image information is migrated from one domain to another, the cycle consistency-based image reconstruction constraint should be constrained in both short and long cycles to eliminate error accumulation. We adopt the cascading manner with dual-cycle consistency, where the reconstructed image in the first cycle can be cast as the new input to the next cycle. We show a distinct improvement over baseline approaches in most translation scenarios. With extensive experiments on several datasets, the proposed method is superior to several tested approaches.
引用
收藏
页码:17243 / 17259
页数:17
相关论文
共 50 条
  • [1] Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks
    Gang Wang
    Haibo Shi
    Yufei Chen
    Bin Wu
    Applied Intelligence, 2023, 53 : 17243 - 17259
  • [2] Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks
    Li, Minjun
    Huang, Haozhi
    Ma, Lin
    Liu, Wei
    Zhang, Tong
    Jiang, Yugang
    COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 186 - 201
  • [3] Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
    Zhu, Jun-Yan
    Park, Taesung
    Isola, Phillip
    Efros, Alexei A.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2242 - 2251
  • [4] Image-to-image Translation Based on Improved Cycle-consistent Generative Adversarial Network
    Zhang Jinglei
    Hou Yawei
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (05) : 1216 - 1222
  • [5] An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation
    Liu, Yu
    Guo, Yanming
    Chen, Wei
    Lew, Michael S.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 219 - 224
  • [6] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    REMOTE SENSING, 2023, 15 (05)
  • [7] Hyperspectral image shadow compensation via cycle-consistent adversarial networks
    Zhao, Min
    Yan, Longbin
    Chen, Jie
    NEUROCOMPUTING, 2021, 450 : 61 - 69
  • [8] Multi-Constraint Adversarial Networks for Unsupervised Image-to-Image Translation
    Saxena, Divya
    Kulshrestha, Tarun
    Cao, Jiannong
    Cheung, Shing-Chi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1601 - 1612
  • [9] Unsupervised Image-to-Image Translation Networks
    Liu, Ming-Yu
    Breuel, Thomas
    Kautz, Jan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [10] UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation
    Torbunov, Dmitrii
    Huang, Yi
    Yu, Haiwang
    Huang, Jin
    Yoo, Shinjae
    Lin, Meifeng
    Viren, Brett
    Ren, Yihui
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 702 - 712