Image Inpainting Based on Generative Adversarial Networks

被引:42
|
作者
Jiang, Yi [1 ,3 ]
Xu, Jiajie [1 ]
Yang, Baoqing [1 ]
Xu, Jing [1 ]
Zhu, Junwu [1 ,2 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Yangzhou 225009, Jiangsu, Peoples R China
[2] Univ Guelph, Dept Comp Sci & Technol, Guelph, ON N1G 2W1, Canada
[3] Shanghai Jiao Tong Univ, State Key Lab Ocean Engn, Shanghai 200240, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
AutoEncoder; image inpainting; skip-connection; stable training; wasserstein GAN;
D O I
10.1109/ACCESS.2020.2970169
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill missing regions of a damaged image with plausibly synthesized content. Existing methods for image inpainting either fill the missing regions by borrowing information from surrounding areas or generating semantically coherent content from region context. They often produce ambiguous or semantically incoherent content when the missing region is large or with complex structures. In this paper, we present an approach for image inpainting. The completion model based on our proposed algorithm contains one generator, one global discriminator, and one local discriminator. The generator is responsible for inpainting the missing area, the global discriminator aims evaluating whether the repair result has global consistency, and the local discriminator is responsible for identifying whether the repair area is correct. The architecture of the generator is an auto-encoder. We use the skip-connection in the generator to improve the prediction power of the model. Also, we use Wasserstein GAN loss to ensure the stability of training. Experiments on CelebA dataset and LFW dataset demonstrate that our proposed model can deal with large-scale missing pixels and generate realistic completion results.
引用
收藏
页码:22884 / 22892
页数:9
相关论文
共 50 条
  • [1] Semantic image inpainting based on Generative Adversarial Networks
    Wu, Chugang
    Xian, Yanhua
    Bai, Junqi
    Jing, Yuancheng
    2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 276 - 280
  • [2] Image Inpainting Using Generative Adversarial Networks
    Luo H.-L.
    Ao Y.
    Yuan P.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (10): : 1891 - 1898
  • [3] An image inpainting method based on generative adversarial networks inversion and autoencoder
    Wang, Yechen
    Song, Bin
    Zhang, Zhiyong
    IET IMAGE PROCESSING, 2024, 18 (04) : 1042 - 1052
  • [4] Multiview Scene Image Inpainting Based on Conditional Generative Adversarial Networks
    Yuan, Zefeng
    Li, Hengyu
    Liu, Jingyi
    Luo, Jun
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (02): : 314 - 323
  • [5] Algorithmfor image inpainting in generative adversarial networks based on gated convolution
    Gao, Jie
    Huo, Zhiyong
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2022, 49 (01): : 216 - 224
  • [6] Irregular mask image inpainting based on progressive generative adversarial networks
    Li, Hong-an
    Hu, Liuqing
    Zhang, Jing
    IMAGING SCIENCE JOURNAL, 2023, 71 (03): : 299 - 312
  • [7] PiiGAN: Generative Adversarial Networks for Pluralistic Image Inpainting
    Cai, Weiwei
    Wei, Zhanguo
    IEEE ACCESS, 2020, 8 (08): : 48451 - 48463
  • [8] Generative Image Inpainting for Retinal Images using Generative Adversarial Networks
    Magister, Lucie Charlotte
    Arandjelovic, Ognjen
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2835 - 2838
  • [9] Attentional coarse -and -fine generative adversarial networks for image inpainting
    Chen, Minyu
    Liu, Zhi
    Ye, Linwei
    Wang, Yang
    NEUROCOMPUTING, 2020, 405 : 259 - 269
  • [10] Face Image Inpainting Using Cascaded Generative Adversarial Networks
    Chen J.-Z.
    Wang J.
    Gong X.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (06): : 910 - 917