Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
|
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Ancient Painting Inpainting Algorithm Based on Multi-Channel Encoder and Dual Attention
    Zhao L.
    Ji B.
    Xing W.
    Lin H.
    Lin Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (12): : 2814 - 2831
  • [2] Image denoising algorithm based on multi-channel GAN
    Wang H.
    Yang X.
    Jiang Y.
    Wang Z.
    Tongxin Xuebao/Journal on Communications, 2021, 42 (03): : 229 - 237
  • [3] Image inpainting algorithm based on edge reconstruction
    Voronin, V. V.
    Marchuk, V. I.
    Frantc, V. A.
    Egiazarian, K. O.
    PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 659 - +
  • [4] Color image restoration and inpainting via multi-channel total curvature
    Tan, Lu
    Liu, Wanquan
    Pan, Zhenkuan
    APPLIED MATHEMATICAL MODELLING, 2018, 61 : 280 - 299
  • [5] Underwater color image enhancement algorithm based on multi-channel equalization
    Li C.
    Sun Y.
    Yan J.
    Fan T.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2019, 47 (06): : 1 - 5and29
  • [6] A Multi-channel Sensing Order Optimization Algorithm Based on Markov Prediction
    Liu, Yanjie
    Du, Qinghe
    Ren, Pinyi
    2012 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2012,
  • [7] Multi-channel chaotic encryption algorithm for color image based on DNA coding
    Wang, Yujing
    Wu, Chenchen
    Kang, Shouqiang
    Wang, Qingyan
    Mikulovich, V. I.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (25-26) : 18317 - 18342
  • [8] Multi-channel chaotic encryption algorithm for color image based on DNA coding
    Yujing Wang
    Chenchen Wu
    Shouqiang Kang
    Qingyan Wang
    V. I. Mikulovich
    Multimedia Tools and Applications, 2020, 79 : 18317 - 18342
  • [9] An Experimental Study on Image Based Multi-Channel SAR-GMTI Algorithm
    Suwa, Kei
    Yamamoto, Kazuhiko
    Tsuchida, Masayoshi
    Wakayama, Toshio
    Nakamura, Shohei
    Endo, Jun
    Hayashi, Kei
    Hasegawa, Hideki
    Nakano, Yosuke
    CONFERENCE PROCEEDINGS OF 2013 ASIA-PACIFIC CONFERENCE ON SYNTHETIC APERTURE RADAR (APSAR), 2013, : 577 - 580
  • [10] Blind dereverberation algorithm for speech signals based on multi-channel linear prediction
    Delcroix, Marc
    Hikichi, Takafumi
    Miyoshi, Masato
    ACOUSTICAL SCIENCE AND TECHNOLOGY, 2005, 26 (05) : 432 - 439