Artistic Text Effect Transfer with Conditonal Generative Adversarial Network

被引:1
|
作者
Huang, Qirui [1 ]
Zhu, Qiang [2 ]
Zhan, Shu [1 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei, Peoples R China
[2] Tongcheng Teachers Coll, Tongcheng, Peoples R China
关键词
deep learning; image generation; text effect transfer; generative adversarial network;
D O I
10.1109/CACML55074.2022.00037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the wider application of artistic text in real scenes, the artistic text effect transfer has become an increasingly important topic in the field of computer vision. Existing methods either maintain poor structural information or poor effect information, both of which can seriously deteriorate the final result. We propose a conditional generative adversarial network to solve this problem, by alternately training the generator and the discriminator. The structure of the generator is Unet, which is an encoder-decoder with skip connections between the corresponding mirrored layers. We inject the conditional information of the reference effect image into the generator using a simple but effective concatenate strategy. The discriminator, which is conditioned on the generator's input to determine how true its output is. Ideally, the discriminator acts as a loss function and guides the optimization of the generator. Qualitative and quantitative results are performed on TE141k dataset, which demonstrate the proposed network outperforms the existing SOTA models and has good visual results.
引用
收藏
页码:181 / 185
页数:5
相关论文
共 50 条
  • [41] A novel semantic-enhanced generative adversarial network for abstractive text summarization
    Vo, Tham
    SOFT COMPUTING, 2023, 27 (10) : 6267 - 6280
  • [42] Class-Balanced Text to Image Synthesis With Attentive Generative Adversarial Network
    Wang, Min
    Lang, Congyan
    Liang, Liqian
    Lyu, Gengyu
    Feng, Songhe
    Wang, Tao
    IEEE MULTIMEDIA, 2021, 28 (03) : 21 - 31
  • [43] Knowledge-Driven Generative Adversarial Network for Text-to-Image Synthesis
    Peng, Jun
    Zhou, Yiyi
    Sun, Xiaoshuai
    Cao, Liujuan
    Wu, Yongjian
    Huang, Feiyue
    Ji, Rongrong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 (4356-4366) : 4356 - 4366
  • [44] Hierarchically-fused Generative Adversarial Network for text to realistic image synthesis
    Huang, Xin
    Wang, Mingjie
    Gong, Minglun
    2019 16TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2019), 2019, : 73 - 80
  • [45] Weakly Supervised Attention Inference Generative Adversarial Network for Text-to-Image
    Mei, Lingrui
    Ran, Xuming
    Hu, Jin
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1574 - 1578
  • [46] Generative adversarial network based on semantic consistency for text-to-image generation
    Yue Ma
    Li Liu
    Huaxiang Zhang
    Chunjing Wang
    Zekang Wang
    Applied Intelligence, 2023, 53 : 4703 - 4716
  • [47] Generative adversarial network based on semantic consistency for text-to-image generation
    Ma, Yue
    Liu, Li
    Zhang, Huaxiang
    Wang, Chunjing
    Wang, Zekang
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4703 - 4716
  • [48] Multi-Conditional Generative Adversarial Network for Text-to-Video Synthesis
    Zhou R.
    Jiang C.
    Xu Q.
    Li Y.
    Zhang C.
    Song Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (10): : 1567 - 1579
  • [49] Super-Resolution of Text Image Based on Conditional Generative Adversarial Network
    Wang, Yuyang
    Ding, Wenjun
    Su, Feng
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT III, 2018, 11166 : 270 - 281
  • [50] A survey on generative adversarial network-based text-to-image synthesis
    Zhou, Rui
    Jiang, Cong
    Xu, Qingyang
    NEUROCOMPUTING, 2021, 451 : 316 - 336