Multi-scale gradient attention guidance and adaptive style fusion for image inpainting

被引:1
|
作者
Zhu, Ye [1 ]
Wang, Chao [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Hao, Xiaoke [1 ]
机构
[1] Hebei Univ Technol, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Tianjin 300222, Peoples R China
关键词
Image inpainting; Style transfer; Gradient attention; Multi-scale gradient loss; OBJECT REMOVAL; DIFFUSION;
D O I
10.1016/j.jvcir.2022.103681
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill in the missing regions of damaged images with plausible content. Existing inpainting methods tend to produce ambiguous artifacts and implausible structures. To address the above issues, our method aims to fully utilize the information of known regions to provide style and structural guidance for missing regions. Specifically, the Adaptive Style Fusion (ASF) module reduces artifacts by transferring visual style features from known regions to missing regions. The Gradient Attention Guidance (GAG) module generates accurate structures by aggregating semantic information along gradient boundary regions. In addition, the Multi-scale Attentional Feature Extraction (MAFE) module extracts global contextual information and enhances the representation of image features. The sufficient experimental results on the three datasets demonstrate that our proposed method has superior performance in terms of visual plausibility and structural consistency compared to state-of-the-art inpainting methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Mural inpainting with generative adversarial networks based on multi-scale feature and attention fusion
    Chen Y.
    Chen J.
    Tao M.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (02): : 254 - 264
  • [22] Multi-Scale Generative Adversarial Network With Multi-Head External Attention for Image Inpainting
    Chen, Gang
    Feng, Qing
    He, Xiu
    Yao, Jian
    IEEE ACCESS, 2024, 12 : 133456 - 133468
  • [23] Style-aware and multi-scale attention for face image completion
    Liu H.
    Li S.
    Zhu X.
    Sun H.
    Zhang J.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2022, 54 (05): : 49 - 56
  • [24] Structure-Guided Image Inpainting Based on Multi-Scale Attention Pyramid Network
    Gong, Jun
    Luo, Senlin
    Yu, Wenxin
    Nie, Liang
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [25] Adaptive fusion with multi-scale features for interactive image segmentation
    Zongyuan Ding
    Tao Wang
    Quansen Sun
    Hongyuan Wang
    Applied Intelligence, 2021, 51 : 5610 - 5621
  • [26] Multi-scale Adaptive Feature Fusion Hashing for Image Retrieval
    Jiang, Xiangkui
    Hu, Fei
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [27] Adaptive fusion with multi-scale features for interactive image segmentation
    Ding, Zongyuan
    Wang, Tao
    Sun, Quansen
    Wang, Hongyuan
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5610 - 5621
  • [28] Multi-Scale Cost Attention and Adaptive Fusion Stereo Matching Network
    Liu, Zhenguo
    Li, Zhao
    Ao, Wengang
    Zhang, Shaoshuang
    Liu, Wenlong
    He, Yizhi
    ELECTRONICS, 2023, 12 (07)
  • [29] Adaptive feature fusion with attention mechanism for multi-scale target detection
    Moran Ju
    Jiangning Luo
    Zhongbo Wang
    Haibo Luo
    Neural Computing and Applications, 2021, 33 : 2769 - 2781
  • [30] Adaptive feature fusion with attention mechanism for multi-scale target detection
    Ju, Moran
    Luo, Jiangning
    Wang, Zhongbo
    Luo, Haibo
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (07): : 2769 - 2781