Unsupervised image style transformation of generative adversarial networks based on cyclic consistency

被引:0
|
作者
Wu, Jingyu [1 ]
Sun, Fuming [2 ]
Xu, Rui [3 ]
Lu, Mingyu [1 ]
Zhang, Boyu [1 ]
机构
[1] Dalian Maritime Univ, Coll Artificial Intelligence, Dalian 116026, Peoples R China
[2] Dalian Minzu Univ, Sch Informat & Commun Engn, Dalian 116600, Peoples R China
[3] Changping Lab, Beijing 102200, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised; Image style transformation; Generative adversarial network; Spectral normalization; QUALITY;
D O I
10.1007/s00530-024-01544-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image style transformation is a fascinating and challenging problem in the field of computer vision. The performance of existing image style transfer algorithms is suppressed to some extent due to the lack of sufficient paired datasets. In order to reduce dependence on paired datasets and reduce model structural risk, this paper proposes an unsupervised image style transformation algorithm based on cycle consistency generative adversarial networks. To solve the instability problem of model training, a Spectrum Normalization method is constructed in the discriminator of cycle generative adversarial networks. To improve the performance of the model generator, a Res2Net residual module using the group convolution method is constructed in the network. The network layer can increase the receptive field range of the network layer without increasing the calculation load, and better realize the extraction of multi-scale features. Ablation experiments and comparative experiments are conducted on four datasets with different artistic styles, the experimental results show that the method in this paper has achieved good results in PSNR, SSIM, FID, and KID evaluation metrics, which proves the robustness of the algorithm.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Image Style Transfer Based On Generative Adversarial Network And Feature Transformation For Modern Home Design
    Yue, Guangpeng
    Li, Mingxi
    Zheng, Hongyan
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2025, 28 (02): : 257 - 263
  • [22] Image Inpainting Based on Generative Adversarial Networks
    Jiang, Yi
    Xu, Jiajie
    Yang, Baoqing
    Xu, Jing
    Zhu, Junwu
    IEEE ACCESS, 2020, 8 (08): : 22884 - 22892
  • [23] Restoration of Single Sand-Dust Image Based on Style Transformation and Unsupervised Adversarial Learning
    Ding, Bosheng
    Chen, Huimin
    Xu, Lixin
    Zhang, Ruiheng
    IEEE ACCESS, 2022, 10 : 90092 - 90100
  • [24] Spectral Normalization for Generative Adversarial Networks for Artistic Image Transformation
    Shu, Zhixu
    Zhang, Kewang
    INTERNATIONAL JOURNAL OF DIGITAL MULTIMEDIA BROADCASTING, 2024, 2024
  • [25] Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Sebel, Nicu
    Yan, Yan
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [26] Battery pack consistency modeling based on generative adversarial networks
    Fan, Xinyuan
    Zhang, Weige
    Sun, Bingxiang
    Zhang, Junwei
    He, Xitian
    ENERGY, 2022, 239
  • [27] AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation
    Li, Bing
    Zhu, Yuanlue
    Wang, Yitong
    Lin, Chia-Wen
    Ghanem, Bernard
    Shen, Linlin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4077 - 4091
  • [28] PCSGAN: Perceptual cyclic-synthesized generative adversarial networks for thermal and NIR to visible image transformation
    Babu, Kancharagunta Kishan
    Dubey, Shiv Ram
    NEUROCOMPUTING, 2020, 413 : 41 - 50
  • [29] Unpaired image to image transformation via informative coupled generative adversarial networks
    Ge, Hongwei
    Han, Yuxuan
    Kang, Wenjing
    Sun, Liang
    FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (04)
  • [30] Unpaired image to image transformation via informative coupled generative adversarial networks
    Hongwei Ge
    Yuxuan Han
    Wenjing Kang
    Liang Sun
    Frontiers of Computer Science, 2021, 15