Image Inpainting Based on Generative Adversarial Networks

被引:42
|
作者
Jiang, Yi [1 ,3 ]
Xu, Jiajie [1 ]
Yang, Baoqing [1 ]
Xu, Jing [1 ]
Zhu, Junwu [1 ,2 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Yangzhou 225009, Jiangsu, Peoples R China
[2] Univ Guelph, Dept Comp Sci & Technol, Guelph, ON N1G 2W1, Canada
[3] Shanghai Jiao Tong Univ, State Key Lab Ocean Engn, Shanghai 200240, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
AutoEncoder; image inpainting; skip-connection; stable training; wasserstein GAN;
D O I
10.1109/ACCESS.2020.2970169
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill missing regions of a damaged image with plausibly synthesized content. Existing methods for image inpainting either fill the missing regions by borrowing information from surrounding areas or generating semantically coherent content from region context. They often produce ambiguous or semantically incoherent content when the missing region is large or with complex structures. In this paper, we present an approach for image inpainting. The completion model based on our proposed algorithm contains one generator, one global discriminator, and one local discriminator. The generator is responsible for inpainting the missing area, the global discriminator aims evaluating whether the repair result has global consistency, and the local discriminator is responsible for identifying whether the repair area is correct. The architecture of the generator is an auto-encoder. We use the skip-connection in the generator to improve the prediction power of the model. Also, we use Wasserstein GAN loss to ensure the stability of training. Experiments on CelebA dataset and LFW dataset demonstrate that our proposed model can deal with large-scale missing pixels and generate realistic completion results.
引用
收藏
页码:22884 / 22892
页数:9
相关论文
共 50 条
  • [31] The image inpainting algorithm used on multi-scale generative adversarial networks and neighbourhood
    Mo, Jiangchun
    Zhou, Yucai
    AUTOMATIKA, 2020, 61 (04) : 704 - 713
  • [32] Sinogram Inpainting with Generative Adversarial Networks and Shape Priors
    Valat, Emilien
    Farrahi, Katayoun
    Blumensath, Thomas
    TOMOGRAPHY, 2023, 9 (03) : 1137 - 1152
  • [33] Face Inpainting via Nested Generative Adversarial Networks
    Li, Zhijiang
    Zhu, Haonan
    Cao, Liqin
    Mao, Lei
    Zhong, Yanfei
    Ma, Ailong
    IEEE ACCESS, 2019, 7 : 155462 - 155471
  • [34] Learning-Based WiFi Fingerprint Inpainting via Generative Adversarial Networks
    Chan, Yu
    Lin, Pin-Yu
    Tseng, Yu-Yun
    Chen, Jen-Jee
    Tseng, Yu-Chee
    2024 33RD INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS, ICCCN 2024, 2024,
  • [35] Image Inpainting Using Wasserstein Generative Adversarial Imputation Network
    Vasata, Daniel
    Halama, Tomas
    Friedjungova, Magda
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 575 - 586
  • [36] Edge-Guided Generative Adversarial Network for Image Inpainting
    Xu, Shunxin
    Liu, Dong
    Xiong, Zhiwei
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [37] Regionwise Generative Adversarial Image Inpainting for Large Missing Areas
    Ma, Yuqing
    Liu, Xianglong
    Bai, Shihao
    Wang, Lei
    Liu, Aishan
    Tao, Dacheng
    Hancock, Edwin R.
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (08) : 5226 - 5239
  • [38] Single Image Dehazing Based on Generative Adversarial Networks
    Wu, Mengyun
    Li, Bo
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2022, PT II, 2022, 13394 : 460 - 469
  • [39] Multisensor Image Fusion based on Generative Adversarial Networks
    Lebedev, M. A.
    Komarov, D., V
    Vygolov, O. V.
    Vizilter, Yu. V.
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXV, 2019, 11155
  • [40] Image Creation Based on Transformer and Generative Adversarial Networks
    Liu, Hangyu
    Liu, Qicheng
    IEEE ACCESS, 2022, 10 : 108296 - 108306