Image inpainting with contextual attention and partial convolution

被引:5
|
作者
Mohite, Tejaswini Adesh [1 ]
Phadke, Gargi S. [1 ]
机构
[1] Ramrao Adik Inst Technol, Dept Instrumentat Engn, Nerul, New Mumbai, India
关键词
Image masking; Convolution Neural Network; Contextual attention; Partial convolution layer;
D O I
10.1109/aisp48273.2020.9073008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image inpainting is a skill developed to recover the damage part of an images. Many researches states that application wise there are various plausible techniques implemented for an image inpainting. By using artificial intelligence here image inpainting is executed. Image inpainting utilizes the contextual attention to fill pixel wise missing region of an image, missing region filling is done by deeply understanding of available known context. Partial convolution plays an important role to reconstruct an image for matching with the realistic images with structures and textures. The work starts with applying various masks on the image and then reconstruction of an image form by applying partial convolution layer. The main difference of this technique cleared from the traditional methods of image inpainting that it is not only reconstruct the image with new content but also specifies and compress structures available in surrounding region whereas other techniques only focuses and borrow textures from the remaining image. This model is trained with two dataset where fully feedforward partial convolution network is experimented. This gives better qualitative image reconstruction because it comprises both the contextual attention and partial convolution method.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Coherent Semantic Attention for Image Inpainting
    Liu, Hongyu
    Jiang, Bin
    Xiao, Yi
    Yang, Chao
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4169 - 4178
  • [32] MagConv: Mask-Guided Convolution for Image Inpainting
    Yu, Xuexin
    Xu, Long
    Li, Jia
    Ji, Xiangyang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4716 - 4727
  • [33] Generative image inpainting with enhanced gated convolution and Transformers
    Wang, Min
    Lu, Wanglong
    Lyu, Jiankai
    Shi, Kaijie
    Zhao, Hanli
    DISPLAYS, 2022, 75
  • [34] Edge Preserving Convolution-Based Image Inpainting
    Hossein Noori
    Hossein Khodabakhshi Rafsanjani
    Morteza Aien
    Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2022, 46 : 893 - 912
  • [35] Atrous Pyramid Transformer with Spectral Convolution for Image Inpainting
    Huang, Muqi
    Zhang, Lefei
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4674 - 4683
  • [36] Free-Form Image Inpainting with Gated Convolution
    Yu, Jiahui
    Lin, Zhe
    Yang, Jimei
    Shen, Xiaohui
    Lu, Xin
    Huang, Thomas
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4470 - 4479
  • [37] Edge Preserving Convolution-Based Image Inpainting
    Noori, Hossein
    Khodabakhshi Rafsanjani, Hossein
    Aien, Morteza
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2022, 46 (03) : 893 - 912
  • [38] Image Inpainting Algorithm with Diverse Aggregation of Contextual Information
    Li H.
    Chao Y.
    Yu P.
    Li H.
    Zhang Y.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2023, 46 (01): : 19 - 25
  • [39] Image Inpainting with Learnable Bidirectional Attention Maps
    Xie, Chaohao
    Liu, Shaohui
    Li, Chao
    Cheng, Ming-Ming
    Zuo, Wangmeng
    Liu, Xiao
    Wen, Shilei
    Ding, Errui
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8857 - 8866
  • [40] Generative Image Inpainting with Residual Attention Learning
    Wan, Fang
    Zhu, Yuesheng
    Cai, Zehua
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519