Multi-scale gradient attention guidance and adaptive style fusion for image inpainting

被引:1
|
作者
Zhu, Ye [1 ]
Wang, Chao [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Hao, Xiaoke [1 ]
机构
[1] Hebei Univ Technol, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Tianjin 300222, Peoples R China
关键词
Image inpainting; Style transfer; Gradient attention; Multi-scale gradient loss; OBJECT REMOVAL; DIFFUSION;
D O I
10.1016/j.jvcir.2022.103681
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill in the missing regions of damaged images with plausible content. Existing inpainting methods tend to produce ambiguous artifacts and implausible structures. To address the above issues, our method aims to fully utilize the information of known regions to provide style and structural guidance for missing regions. Specifically, the Adaptive Style Fusion (ASF) module reduces artifacts by transferring visual style features from known regions to missing regions. The Gradient Attention Guidance (GAG) module generates accurate structures by aggregating semantic information along gradient boundary regions. In addition, the Multi-scale Attentional Feature Extraction (MAFE) module extracts global contextual information and enhances the representation of image features. The sufficient experimental results on the three datasets demonstrate that our proposed method has superior performance in terms of visual plausibility and structural consistency compared to state-of-the-art inpainting methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Image Inpainting with EMMA Attention and Multi-scale Fusion
    Wei, Yun
    Wang, Lulu
    Wu, Kaijun
    Shan, Hongquan
    Tian, Bin
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2024, 51 (12): : 87 - 97
  • [2] Spatially adaptive multi-scale contextual attention for image inpainting
    Xueting Wang
    Yiyan Chen
    Toshihiko Yamasaki
    Multimedia Tools and Applications, 2022, 81 : 31831 - 31846
  • [3] Spatially adaptive multi-scale contextual attention for image inpainting
    Wang, Xueting
    Chen, Yiyan
    Yamasaki, Toshihiko
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 31831 - 31846
  • [4] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [5] Progressively Multi-Scale Feature Fusion for Image Inpainting
    Wen, Wu
    Li, Tianhao
    Tolba, Amr
    Liu, Ziyi
    Shao, Kai
    MATHEMATICS, 2023, 11 (24)
  • [6] MRS-Net: an image inpainting algorithm with multi-scale residual attention fusion
    Deng, Hongxia
    Qian, Guanyu
    Luo, Dongsheng
    Lv, Xindong
    Liu, Haoqi
    Li, Haifang
    APPLIED INTELLIGENCE, 2023, 53 (07) : 7497 - 7511
  • [7] MRS-Net: an image inpainting algorithm with multi-scale residual attention fusion
    Hongxia Deng
    Guanyu Qian
    Dongsheng Luo
    Xindong Lv
    Haoqi Liu
    Haifang Li
    Applied Intelligence, 2023, 53 : 7497 - 7511
  • [8] Image inpainting via Multi-scale Adaptive Priors
    Wang, Yufeng
    Guo, Dongsheng
    Zhao, Haoru
    Yang, Min
    Zheng, Haiyong
    PATTERN RECOGNITION, 2025, 162
  • [9] Image Inpainting Based Multi-scale Gated Convolution and Attention
    Jiang, Hualiang
    Ma, Xiaohu
    Yang, Dongdong
    Zhao, Jiaxin
    Shen, Yao
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 407 - 418
  • [10] MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting
    Wang, Ning
    Li, Jingyuan
    Zhang, Lefei
    Du, Bo
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3748 - 3754