Image inpainting with contextual attention and partial convolution

被引:5
|
作者
Mohite, Tejaswini Adesh [1 ]
Phadke, Gargi S. [1 ]
机构
[1] Ramrao Adik Inst Technol, Dept Instrumentat Engn, Nerul, New Mumbai, India
关键词
Image masking; Convolution Neural Network; Contextual attention; Partial convolution layer;
D O I
10.1109/aisp48273.2020.9073008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image inpainting is a skill developed to recover the damage part of an images. Many researches states that application wise there are various plausible techniques implemented for an image inpainting. By using artificial intelligence here image inpainting is executed. Image inpainting utilizes the contextual attention to fill pixel wise missing region of an image, missing region filling is done by deeply understanding of available known context. Partial convolution plays an important role to reconstruct an image for matching with the realistic images with structures and textures. The work starts with applying various masks on the image and then reconstruction of an image form by applying partial convolution layer. The main difference of this technique cleared from the traditional methods of image inpainting that it is not only reconstruct the image with new content but also specifies and compress structures available in surrounding region whereas other techniques only focuses and borrow textures from the remaining image. This model is trained with two dataset where fully feedforward partial convolution network is experimented. This gives better qualitative image reconstruction because it comprises both the contextual attention and partial convolution method.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] PCNet: partial convolution attention mechanism for image inpainting
    Yan S.
    Zhang X.
    International Journal of Computers and Applications, 2022, 44 (08) : 738 - 745
  • [2] Generative Image Inpainting with Contextual Attention
    Yu, Jiahui
    Lin, Zhe
    Yang, Jimei
    Shen, Xiaohui
    Lu, Xin
    Huang, Thomas S.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5505 - 5514
  • [3] Partial Convolution for Padding, Inpainting, and Image Synthesis
    Liu, Guilin
    Dundar, Aysegul
    Shih, Kevin J.
    Wang, Ting-Chun
    Reda, Fitsum A.
    Sapra, Karan
    Yu, Zhiding
    Yang, Xiaodong
    Tao, Andrew
    Catanzaro, Bryan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6096 - 6110
  • [4] PANORAMIC IMAGE INPAINTING WITH GATED CONVOLUTION AND CONTEXTUAL RECONSTRUCTION LOSS
    Yu, Li
    Gao, Yanjun
    Pakdaman, Farhad
    Gabbouj, Moncef
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4255 - 4259
  • [5] Deep Image Inpainting With Enhanced Normalization and Contextual Attention
    Liu, Jialu
    Gong, Maoguo
    Tang, Zedong
    Qin, A. K.
    Li, Hao
    Jiang, Fenlong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6599 - 6614
  • [6] Image Inpainting Based on Contextual Coherent Attention GAN
    Li, Hong-an
    Hu, Liuqing
    Hua, Qiaozhi
    Yang, Meng
    Li, Xinpeng
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (12)
  • [7] Image Inpainting Based Multi-scale Gated Convolution and Attention
    Jiang, Hualiang
    Ma, Xiaohu
    Yang, Dongdong
    Zhao, Jiaxin
    Shen, Yao
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 407 - 418
  • [8] GCAM: lightweight image inpainting via group convolution and attention mechanism
    Chen, Yuantao
    Xia, Runlong
    Yang, Kai
    Zou, Ke
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 1815 - 1825
  • [9] GCAM: lightweight image inpainting via group convolution and attention mechanism
    Yuantao Chen
    Runlong Xia
    Kai Yang
    Ke Zou
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 1815 - 1825
  • [10] MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting
    Wang, Ning
    Li, Jingyuan
    Zhang, Lefei
    Du, Bo
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3748 - 3754