Improved generative adversarial networks with reconstruction loss

被引:20
|
作者
Li, Yanchun [1 ]
Xiao, Nanfeng [1 ]
Ouyang, Wanli [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Generative adversarial networks (GAN); Image generation; Reconstruction loss; Deep generative model;
D O I
10.1016/j.neucom.2018.10.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple regularization scheme to handle the problem of mode missing and unstable training in the generative adversarial networks (GAN). The key idea is to utilize the visual features learned by the discriminator. We reconstruct the real data by feeding the generator with the real data features extracted by the discriminator. A reconstruction loss is added to the GAN's objective function to enforce the generator can reconstruct from the features of the discriminator, which helps to explicitly guide the generator towards to near the probable configurations of real data. The proposed reconstruction loss improves the performance of GAN, produces higher quality images on different dataset, and can be easily combined with other regularization loss functions such as gradient penalty to improve the performance of various GANs. We conducted experiments on the widespread adopted architecture DCGAN and the complicated ResNet architecture across different datasets, the results of which show the effectiveness and robustness of our proposed method. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:363 / 372
页数:10
相关论文
共 50 条
  • [31] Face Reconstruction from Voice using Generative Adversarial Networks
    Wen, Yandong
    Singh, Rita
    Raj, Bhiksha
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [32] SCATGAN FOR RECONSTRUCTION OF ULTRASOUND SCATTERERS USING GENERATIVE ADVERSARIAL NETWORKS
    Al Bahou, Andrawes
    Tanner, Christine
    Goksel, Orcun
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 1674 - 1677
  • [33] Reconstruction of Iberian ceramic potteries using generative adversarial networks
    Navarro, Pablo
    Cintas, Celia
    Lucena, Manuel
    Manuel Fuertes, Jose
    Segura, Rafael
    Delrieux, Claudio
    Gonzalez-Jose, Rolando
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [34] A Spin Glass Model for the Loss Surfaces of Generative Adversarial Networks
    Baskerville, Nicholas P.
    Keating, Jonathan P.
    Mezzadri, Francesco
    Najnudel, Joseph
    JOURNAL OF STATISTICAL PHYSICS, 2022, 186 (02)
  • [35] Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities
    Qi, Guo-Jun
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) : 1118 - 1140
  • [36] A Spin Glass Model for the Loss Surfaces of Generative Adversarial Networks
    Nicholas P. Baskerville
    Jonathan P. Keating
    Francesco Mezzadri
    Joseph Najnudel
    Journal of Statistical Physics, 2022, 186
  • [37] Loss Functions of Generative Adversarial Networks (GANs): Opportunities and Challenges
    Pan, Zhaoqing
    Yu, Weijie
    Wang, Bosi
    Xie, Haoran
    Sheng, Victor S.
    Lei, Jianjun
    Kwong, Sam
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (04): : 500 - 522
  • [38] Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities
    Guo-Jun Qi
    International Journal of Computer Vision, 2020, 128 : 1118 - 1140
  • [39] Image Denoising via Generative Adversarial Networks with Detail Loss
    Chen, Songkui
    Shi, Daming
    Sadiq, Muhammad
    Zhu, Meilu
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND SYSTEMS (ICISS 2019), 2019, : 261 - 265
  • [40] Improved face super-resolution generative adversarial networks
    Wang, Mengxue
    Chen, Zhenxue
    Wu, Q. M. Jonathan
    Jian, Muwei
    MACHINE VISION AND APPLICATIONS, 2020, 31 (04)