Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
|
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Low-light image enhancement algorithm based on multi-channel fusion attention network
    Chen Q.
    Gu Y.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (14): : 2111 - 2122
  • [22] Research on digital watermarking embedding algorithm based on multi-channel wavelet transform for color image
    Fu, Wei
    Liao, Xiaoyu
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2010, 31 (04): : 824 - 831
  • [23] Image compression with edge-based inpainting
    Liu, Dong
    Sun, Xiaoyan
    Wu, Feng
    Li, Shipeng
    Zhang, Ya-Qin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (10) : 1273 - 1287
  • [24] EdgeConnect: Structure Guided Image Inpainting using Edge Prediction
    Nazeri, Kamyar
    Ng, Eric
    Joseph, Tony
    Qureshi, Faisal Z.
    Ebrahimi, Mehran
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3265 - 3274
  • [25] Smooth image inpainting by least square oriented edge prediction
    Pallotti, E.
    Capodiferro, L.
    Mangiatordi, F.
    Sita, P.
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS X AND PARALLEL PROCESSING FOR IMAGING APPLICATIONS II, 2012, 8295
  • [26] Generative image inpainting using edge prediction and appearance flow
    Qian Liu
    Hua Ji
    Gang Liu
    Multimedia Tools and Applications, 2022, 81 : 31709 - 31725
  • [27] Generative image inpainting using edge prediction and appearance flow
    Liu, Qian
    Ji, Hua
    Liu, Gang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 31709 - 31725
  • [28] Sonification of multi-channel image data
    Hermann, T
    Nattkemper, TW
    Ritter, H
    Schubert, W
    METMBS'00: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON MATHEMATICS AND ENGINEERING TECHNIQUES IN MEDICINE AND BIOLOGICAL SCIENCES, VOLS I AND II, 2000, : 745 - 750
  • [29] Multi-Channel Quantum Image Scrambling
    Yan, Fei
    Guo, Yiming
    Iliyasu, Abdullah M.
    Jiang, Zhengang
    Yang, Huamin
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2016, 20 (01) : 163 - 170
  • [30] A multi-channel framework for image watermarking
    Zheng, JB
    Feng, DD
    Zhao, RC
    Proceedings of 2005 International Conference on Machine Learning and Cybernetics, Vols 1-9, 2005, : 5099 - 5104