Image Inpainting Based on Generative Adversarial Networks

被引:42
|
作者
Jiang, Yi [1 ,3 ]
Xu, Jiajie [1 ]
Yang, Baoqing [1 ]
Xu, Jing [1 ]
Zhu, Junwu [1 ,2 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Yangzhou 225009, Jiangsu, Peoples R China
[2] Univ Guelph, Dept Comp Sci & Technol, Guelph, ON N1G 2W1, Canada
[3] Shanghai Jiao Tong Univ, State Key Lab Ocean Engn, Shanghai 200240, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
AutoEncoder; image inpainting; skip-connection; stable training; wasserstein GAN;
D O I
10.1109/ACCESS.2020.2970169
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill missing regions of a damaged image with plausibly synthesized content. Existing methods for image inpainting either fill the missing regions by borrowing information from surrounding areas or generating semantically coherent content from region context. They often produce ambiguous or semantically incoherent content when the missing region is large or with complex structures. In this paper, we present an approach for image inpainting. The completion model based on our proposed algorithm contains one generator, one global discriminator, and one local discriminator. The generator is responsible for inpainting the missing area, the global discriminator aims evaluating whether the repair result has global consistency, and the local discriminator is responsible for identifying whether the repair area is correct. The architecture of the generator is an auto-encoder. We use the skip-connection in the generator to improve the prediction power of the model. Also, we use Wasserstein GAN loss to ensure the stability of training. Experiments on CelebA dataset and LFW dataset demonstrate that our proposed model can deal with large-scale missing pixels and generate realistic completion results.
引用
收藏
页码:22884 / 22892
页数:9
相关论文
共 50 条
  • [21] Face Image Inpainting Algorithm Based on Generative Adversarial Network
    Miao, Yalin
    Jia, Huanhuan
    Liu, Xuemin
    Zhang, Yang
    Zhao, Liyi
    2019 6TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2019), 2019, : 282 - 286
  • [22] Masked Image Inpainting Algorithm Based on Generative Adversarial Nets
    Cao Z.-Y.
    Niu S.-Z.
    Zhang J.-W.
    2018, Beijing University of Posts and Telecommunications (41): : 81 - 86
  • [23] Image inpainting method based on incomplete image samples in generative adversarial network
    Li H.
    Huang H.
    Guo L.
    Li H.
    Chen J.
    Li H.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (10): : 1949 - 1958
  • [24] Improved Semantic Image Inpainting Method with Deep Convolution Generative Adversarial Networks
    Chen, Xiaoning
    Zhao, Jian
    BIG DATA, 2022, 10 (06) : 506 - 514
  • [25] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, : 7621 - 7634
  • [26] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024,
  • [27] Image Inpainting Method Based on Generative Adversary Networks
    Zhang, Zhao
    Yan, He
    Wang, Ping
    Millham, Richard
    He, Renjie
    JOURNAL OF INTERNET TECHNOLOGY, 2024, 25 (06): : 945 - 953
  • [28] Mural inpainting progressive generative adversarial networks based on structure guided
    Chen Y.
    Chen J.
    Tao M.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (06): : 1247 - 1259
  • [29] Image Inpainting using Wasserstein Generative Adversarial Network
    Hua, Peng
    Liu, Xiaohua
    Liu, Ming
    Dong, Liquan
    Hui, Mei
    Zhao, Yuejin
    OPTICS AND PHOTONICS FOR INFORMATION PROCESSING XII, 2018, 10751
  • [30] Image Inpainting via Enhanced Generative Adversarial Network
    Wang, Qiang
    Fan, Huijie
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,