Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
|
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Laplace operator based multi-channel image filters learning
    Liu, Yantao
    Liu, Meng
    Liu, Bin
    Sun, Jingang
    Liu, Xiuping
    JOURNAL OF ADVANCED MECHANICAL DESIGN SYSTEMS AND MANUFACTURING, 2016, 10 (08):
  • [32] Multi-Channel Mapping Image Segmentation Method Based on LDA
    Hu, Qiu-Xia
    Tian, Jie
    He, Dong-Jian
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (04)
  • [33] Single Image Defogging Based on Multi-Channel Convolution MSRCR
    Zhang, Weidong
    Dong, Lili
    Pan, Xipeng
    Zhou, Jingchun
    Qin, Li
    Xu, Wenhai
    IEEE ACCESS, 2019, 7 : 72492 - 72504
  • [34] Multi-channel threshold image denoising based on the wavelet transfom
    Yin, Rui-Xiang
    Zhang, Xiao-Ming
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2001, 29 (05): : 89 - 93
  • [35] Transferring Image-based Edits for Multi-Channel Compositing
    Hennessey, James W.
    Li, Wilmot
    Russell, Bryan
    Shechtman, Eli
    Mitra, Niloy J.
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):
  • [36] Multi-Channel Based Image Processing Scheme for Pneumonia Identification
    Nneji, Grace Ugochi
    Cai, Jingye
    Deng, Jianhua
    Monday, Happy Nkanta
    James, Edidiong Christopher
    Ukwuoma, Chiagoziem Chima
    DIAGNOSTICS, 2022, 12 (02)
  • [37] Saliency prediction based on multi-channel models of visual processing
    Li, Qiang
    MACHINE VISION AND APPLICATIONS, 2023, 34 (04)
  • [38] Saliency prediction based on multi-channel models of visual processing
    Qiang Li
    Machine Vision and Applications, 2023, 34
  • [39] Fair queueing scheduling algorithm for multi-channel based on signal
    Institute of Communication Networks Integrated Technique, Beijing University of Posts and Telecommunications, Beijing 100876, China
    不详
    Beijing Youdian Daxue Xuebao, 2006, 2 (70-73):
  • [40] Research of image inpainting algorithm based on image segmentation
    Ou, Xianfeng
    Yan, Pengcheng
    Hu, Wenjing
    Wu, Jianhui
    Tu, Bing
    Guo, Longyuan
    Peng, Xin
    Zhang, Guoyun
    Wang, Peng
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2018, 18 (03) : 637 - 644