Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

被引:8
|
作者
Wang, Gang [1 ]
Shi, Haibo [1 ]
Chen, Yufei [2 ]
Wu, Bin [3 ]
机构
[1] Shanghai Univ Finance & Econ, Inst Data Sci & Stat, Sch Stat & Management, Shanghai 200433, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, CAD Res Ctr, Shanghai 201804, Peoples R China
[3] Shanghai Univ Finance & Econ, Zhejiang Coll, Jinhua 321013, Peoples R China
基金
中国国家自然科学基金;
关键词
GAN; Image-to-image translation; Dual learning; Cycle consistency;
D O I
10.1007/s10489-022-04389-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cycle consistency conducts generative adversarial networks from aligned image pairs to unpaired training sets and can be applied to various image-to-image translations. However, the accumulation of errors that may occur during image reconstruction can affect the realism and quality of the generated images. To address this, we exploit a novel long and short cycle-consistent loss. This new loss is simple and easy to implement. Our dual-cycle constrained cross-domain image-to-image translation method can handle error accumulation and enforce adversarial learning. When image information is migrated from one domain to another, the cycle consistency-based image reconstruction constraint should be constrained in both short and long cycles to eliminate error accumulation. We adopt the cascading manner with dual-cycle consistency, where the reconstructed image in the first cycle can be cast as the new input to the next cycle. We show a distinct improvement over baseline approaches in most translation scenarios. With extensive experiments on several datasets, the proposed method is superior to several tested approaches.
引用
收藏
页码:17243 / 17259
页数:17
相关论文
共 50 条
  • [21] Overwater Image Dehazing via Cycle-Consistent Generative Adversarial Network
    Zheng, Shunyuan
    Sun, Jiamin
    Liu, Qinglin
    Qi, Yuankai
    Yan, Jianen
    ELECTRONICS, 2020, 9 (11) : 1 - 19
  • [22] Unsupervised Generative Adversarial Network for Plantar Pressure Image-to-Image Translation
    Ahmadian, Mona
    Beheshti, Mohammad T. H.
    Kalhor, Ahmad
    Shirian, Amir
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2580 - 2583
  • [23] Unsupervised image-to-image translation with multiscale attention generative adversarial network
    Wang, Fasheng
    Zhang, Qing
    Zhao, Qianyi
    Wang, Mengyin
    Sun, Fuming
    APPLIED INTELLIGENCE, 2024, 54 (08) : 6558 - 6578
  • [24] Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening
    Zhou, Huanyu
    Liu, Qingjie
    Weng, Dawei
    Wang, Yunhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [25] Unsupervised Video Summarization With Cycle-Consistent Adversarial LSTM Networks
    Yuan, Li
    Tay, Francis Eng Hock
    Li, Ping
    Feng, Jiashi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2711 - 2722
  • [26] Unified Generative Adversarial Networks for Controllable Image-to-Image Translation
    Tang, Hao
    Liu, Hong
    Sebe, Nicu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8916 - 8929
  • [27] Unsupervised Image-to-Image Translation with Self-Attention Networks
    Kang, Taewon
    Lee, Kwang Hee
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 102 - 108
  • [28] Deep Generative Adversarial Networks for Image-to-Image Translation: A Review
    Alotaibi, Aziz
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 26
  • [29] Thermal Image Calibration and Correction using Unpaired Cycle-Consistent Adversarial Networks
    Rajoli, Hossein
    Afshin, Pouya
    Afghah, Fatemeh
    FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, : 1425 - 1429
  • [30] Millimeter-Wave Image Deblurring via Cycle-Consistent Adversarial Network
    Liu, Huteng
    Wang, Shuoguang
    Jing, Handan
    Li, Shiyong
    Zhao, Guoqiang
    Sun, Houjun
    ELECTRONICS, 2023, 12 (03)