Unsupervised image style transformation of generative adversarial networks based on cyclic consistency

被引:0
|
作者
Wu, Jingyu [1 ]
Sun, Fuming [2 ]
Xu, Rui [3 ]
Lu, Mingyu [1 ]
Zhang, Boyu [1 ]
机构
[1] Dalian Maritime Univ, Coll Artificial Intelligence, Dalian 116026, Peoples R China
[2] Dalian Minzu Univ, Sch Informat & Commun Engn, Dalian 116600, Peoples R China
[3] Changping Lab, Beijing 102200, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised; Image style transformation; Generative adversarial network; Spectral normalization; QUALITY;
D O I
10.1007/s00530-024-01544-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image style transformation is a fascinating and challenging problem in the field of computer vision. The performance of existing image style transfer algorithms is suppressed to some extent due to the lack of sufficient paired datasets. In order to reduce dependence on paired datasets and reduce model structural risk, this paper proposes an unsupervised image style transformation algorithm based on cycle consistency generative adversarial networks. To solve the instability problem of model training, a Spectrum Normalization method is constructed in the discriminator of cycle generative adversarial networks. To improve the performance of the model generator, a Res2Net residual module using the group convolution method is constructed in the network. The network layer can increase the receptive field range of the network layer without increasing the calculation load, and better realize the extraction of multi-scale features. Ablation experiments and comparative experiments are conducted on four datasets with different artistic styles, the experimental results show that the method in this paper has achieved good results in PSNR, SSIM, FID, and KID evaluation metrics, which proves the robustness of the algorithm.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Image Steganography and Style Transformation Based on Generative Adversarial Network
    Li, Li
    Zhang, Xinpeng
    Chen, Kejiang
    Feng, Guorui
    Wu, Deyang
    Zhang, Weiming
    MATHEMATICS, 2024, 12 (04)
  • [2] An unsupervised font style transfer model based on generative adversarial networks
    Zeng, Sihan
    Pan, Zhongliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 5305 - 5324
  • [3] An unsupervised font style transfer model based on generative adversarial networks
    Sihan Zeng
    Zhongliang Pan
    Multimedia Tools and Applications, 2022, 81 : 5305 - 5324
  • [4] CDGAN: Cyclic Discriminative Generative Adversarial Networks for image-to-image transformation
    Babu, Kancharagunta Kishan
    Dubey, Shiv Ram
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 82
  • [5] Image Style Transfer with Generative Adversarial Networks
    Li, Ru
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2950 - 2954
  • [6] CSGAN: Cyclic-Synthesized Generative Adversarial Networks for image-to-image transformation
    Babu, Kancharagunta Kishan
    Dubey, Shiv Ram
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 169
  • [7] Analysis of Guzheng Music Style Transformation Based on Generative Adversarial Networks
    Zhang, Lei
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [8] Unsupervised Image Generation with Infinite Generative Adversarial Networks
    Ying, Hui
    Wang, He
    Shao, Tianjia
    Yang, Yin
    Zhou, Kun
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14264 - 14273
  • [9] An Image Style Diversified Synthesis Method Based on Generative Adversarial Networks
    Yang, Zujian
    Qiu, Zhao
    ELECTRONICS, 2022, 11 (14)
  • [10] Image Style Conversion Model Design Based on Generative Adversarial Networks
    Gong, Ke
    Zhen, Zhu
    IEEE ACCESS, 2024, 12 : 122126 - 122138