Exploring Generative Adversarial Networks for Text-to-Image Generation with Evolution Strategies

被引:0
|
作者
Costa, Victor [1 ]
Lourenco, Nuno [1 ]
Correia, Joao [1 ]
Machado, Penousal [1 ]
机构
[1] Univ Coimbra, CISUC, DEI, Coimbra, Portugal
关键词
evolution strategies; generative adversarial networks; generative models;
D O I
10.1145/3583133.3590549
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text-to-image generation has achieved impressive results, featuring a variety of models trained on extensive datasets comprising text-image pairs. However, some methods depend on pre-trained models, using gradient-based approaches to update latent vectors in the latent space. In this work, we propose the use of Covariance Matrix Adaptation Evolution Strategy to explore the latent space of a Generative Adversarial Network. Our experimental study compares our approach with gradient-based and hybrid strategies, using diverse text inputs for image generation. We adapt an evaluation method that projects the generated samples into a two-dimensional grid to assess the diversity of the distribution. Results evidence that the evolutionary method produces more diverse samples across different grid regions, while the hybrid method combines gradient-based and evolutionary approaches, enhancing result quality.
引用
收藏
页码:271 / 274
页数:4
相关论文
共 50 条
  • [1] Exploring Progress in Text-to-Image Synthesis: An In-Depth Survey on the Evolution of Generative Adversarial Networks
    Habib, Md Ahsan
    Wadud, Md Anwar Hussen
    Patwary, Md Fazlul Karim
    Rahman, Mohammad Motiur
    Mridha, M. F.
    Okuyama, Yuichi
    Shin, Jungpil
    IEEE ACCESS, 2024, 12 : 178401 - 178440
  • [2] DTGAN: Dual Attention Generative Adversarial Networks for Text-to-Image Generation
    Zhang, Zhenxing
    Schomaker, Lambert
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Generative adversarial text-to-image generation with style image constraint
    Zekang Wang
    Li Liu
    Huaxiang Zhang
    Dongmei Liu
    Yu Song
    Multimedia Systems, 2023, 29 : 3291 - 3303
  • [4] Generative adversarial text-to-image generation with style image constraint
    Wang, Zekang
    Liu, Li
    Zhang, Huaxiang
    Liu, Dongmei
    Song, Yu
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3291 - 3303
  • [5] MAGAN: Multi-attention Generative Adversarial Networks for Text-to-Image Generation
    Jia, Xibin
    Mi, Qing
    Dai, Qi
    PATTERN RECOGNITION AND COMPUTER VISION, PT IV, 2021, 13022 : 312 - 322
  • [6] Text-to-image Generation Model Based on Diffusion Wasserstein Generative Adversarial Networks
    Zhao H.
    Li W.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2023, 45 (12): : 4371 - 4381
  • [7] A survey of generative adversarial networks and their application in text-to-image synthesis
    Zeng, Wu
    Zhu, Heng-liang
    Lin, Chuan
    Xiao, Zheng-ying
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (12): : 7142 - 7181
  • [8] TextControlGAN: Text-to-Image Synthesis with Controllable Generative Adversarial Networks
    Ku, Hyeeun
    Lee, Minhyeok
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [9] Text-to-Image Generation with Multiscale Semantic Context-Aware Generative Adversarial Networks
    Dong, Pei
    Wu, Lei
    Meng, Lei
    Meng, Xiangxu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XII, ICIC 2024, 2024, 14873 : 192 - 203
  • [10] Enhanced Text-to-Image Synthesis Conditional Generative Adversarial Networks
    Tan, Yong Xuan
    Lee, Chin Poo
    Neo, Mai
    Lim, Kian Ming
    Lim, Jit Yan
    IAENG International Journal of Computer Science, 2022, 49 (01) : 1 - 7