Image inpainting with contextual attention and partial convolution

被引:5
|
作者
Mohite, Tejaswini Adesh [1 ]
Phadke, Gargi S. [1 ]
机构
[1] Ramrao Adik Inst Technol, Dept Instrumentat Engn, Nerul, New Mumbai, India
关键词
Image masking; Convolution Neural Network; Contextual attention; Partial convolution layer;
D O I
10.1109/aisp48273.2020.9073008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image inpainting is a skill developed to recover the damage part of an images. Many researches states that application wise there are various plausible techniques implemented for an image inpainting. By using artificial intelligence here image inpainting is executed. Image inpainting utilizes the contextual attention to fill pixel wise missing region of an image, missing region filling is done by deeply understanding of available known context. Partial convolution plays an important role to reconstruct an image for matching with the realistic images with structures and textures. The work starts with applying various masks on the image and then reconstruction of an image form by applying partial convolution layer. The main difference of this technique cleared from the traditional methods of image inpainting that it is not only reconstruct the image with new content but also specifies and compress structures available in surrounding region whereas other techniques only focuses and borrow textures from the remaining image. This model is trained with two dataset where fully feedforward partial convolution network is experimented. This gives better qualitative image reconstruction because it comprises both the contextual attention and partial convolution method.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Image inpainting with aggregated convolution progressive network
    Li, Yang
    Zhai, Jia
    Lu, Wen
    Guo, Haipeng
    Wen, Jiazheng
    Liu, Huanyu
    Li, Junbao
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [22] Rethinking Fast Fourier Convolution in Image Inpainting
    Chu, Tianyi
    Chen, Jiafu
    Sun, Jiakai
    Lian, Shuobin
    Wang, Zhizhong
    Zuo, Zhiwen
    Zhao, Lei
    Xing, Wei
    Lu, Dongming
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 23138 - 23148
  • [23] Image Inpainting with Frequency Domain Wavelet Convolution
    Huang, Jain-Kai
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [24] Generative Image Inpainting with Dilated Deformable Convolution
    Qiu, Zhao
    Yuan, Lin
    Liu, Lihao
    Yuan, Zheng
    Chen, Tao
    Xiao, Zihan
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (06)
  • [25] Image Inpainting in Frequency Domain with Wavelet Convolution
    Huang, Jain-Kai
    Liu, Tsung-Jung
    Liu, Kuan-Hisen
    2022 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN, IEEE ICCE-TW 2022, 2022, : 277 - 278
  • [26] Learning Contextual Transformer Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Zhou, Sanping
    Meng, Deyu
    Wang, Jinjun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2529 - 2538
  • [27] Reconstruction of the Chemical Gas Concentration Distribution Using Partial Convolution-Based Image Inpainting
    Kang, Minjae
    Son, Jungjae
    Lee, Byungheon
    Nam, Hyunwoo
    SENSORS, 2024, 24 (14)
  • [28] Multistage attention network for image inpainting
    Wang, Ning
    Ma, Sihan
    Li, Jingyuan
    Zhang, Yipeng
    Zhang, Lefei
    PATTERN RECOGNITION, 2020, 106
  • [29] Generative Image Inpainting With Attention Propagation
    Cao, Cheng-Rui
    Liu, Wei-Rong
    Shi, Chang-Hong
    Zhang, Hao-Chen
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (05): : 1343 - 1352
  • [30] Hourglass Attention Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Meng, Rongye
    Zhou, Sanping
    Wang, Jinjun
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 483 - 501