Multi-scale gradient attention guidance and adaptive style fusion for image inpainting

被引:1
|
作者
Zhu, Ye [1 ]
Wang, Chao [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Hao, Xiaoke [1 ]
机构
[1] Hebei Univ Technol, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Tianjin 300222, Peoples R China
关键词
Image inpainting; Style transfer; Gradient attention; Multi-scale gradient loss; OBJECT REMOVAL; DIFFUSION;
D O I
10.1016/j.jvcir.2022.103681
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill in the missing regions of damaged images with plausible content. Existing inpainting methods tend to produce ambiguous artifacts and implausible structures. To address the above issues, our method aims to fully utilize the information of known regions to provide style and structural guidance for missing regions. Specifically, the Adaptive Style Fusion (ASF) module reduces artifacts by transferring visual style features from known regions to missing regions. The Gradient Attention Guidance (GAG) module generates accurate structures by aggregating semantic information along gradient boundary regions. In addition, the Multi-scale Attentional Feature Extraction (MAFE) module extracts global contextual information and enhances the representation of image features. The sufficient experimental results on the three datasets demonstrate that our proposed method has superior performance in terms of visual plausibility and structural consistency compared to state-of-the-art inpainting methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] MRASFusion: A multi-scale residual attention infrared and visible image fusion network based on semantic segmentation guidance
    An, Rongsheng
    Liu, Gang
    Qian, Yao
    Xing, Mengliang
    Tang, Haojie
    INFRARED PHYSICS & TECHNOLOGY, 2024, 139
  • [32] Multi-scale image fusion method based on the characteristics of texture and gradient
    Cheng, Quan
    Ma, Junyong
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2014, 54 (07): : 935 - 941
  • [33] Multi-Scale Feature Attention Fusion for Image Splicing Forgery Detection
    Liang, Enji
    Zhang, Kuiyuan
    Hua, Zhongyun
    Jia, Xiaohua
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2025, 21 (01)
  • [34] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    Hu, Bin
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (04) : 608 - 615
  • [35] Image super-resolution reconstruction with multi-scale attention fusion
    Chen, Chun-yi
    Wu, Xin-yi
    Hu, Xiao-juan
    Yu, Hai-yang
    CHINESE OPTICS, 2023, 16 (05) : 1034 - 1044
  • [36] Prompt learning and multi-scale attention for infrared and visible image fusion
    Li, Yanan
    Ji, Qingtao
    Jiao, Shaokang
    INFRARED PHYSICS & TECHNOLOGY, 2025, 145
  • [37] Multi-Scale Mixed Attention Network for CT and MRI Image Fusion
    Liu, Yang
    Yan, Binyu
    Zhang, Rongzhu
    Liu, Kai
    Jeon, Gwanggil
    Yang, Xiaoming
    ENTROPY, 2022, 24 (06)
  • [38] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    Pattern Recognition and Image Analysis, 2021, 31 : 608 - 615
  • [39] HIERARCHICAL TERRAIN ATTENTION AND MULTI-SCALE RAINFALL GUIDANCE FOR FLOOD IMAGE PREDICTION
    Wang, Feifei
    Wang, Yong
    Li, Bing
    Huang, Qidong
    Chen, Shaoqing
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2370 - 2374
  • [40] Multi-scale Adaptive Dual Attention for Image Defocus Blur Detection
    Li, Yue
    Han, Xuechun
    Wang, Wei
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2328 - 2332