Multi-scale gradient attention guidance and adaptive style fusion for image inpainting

被引:1
|
作者
Zhu, Ye [1 ]
Wang, Chao [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Hao, Xiaoke [1 ]
机构
[1] Hebei Univ Technol, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Tianjin 300222, Peoples R China
关键词
Image inpainting; Style transfer; Gradient attention; Multi-scale gradient loss; OBJECT REMOVAL; DIFFUSION;
D O I
10.1016/j.jvcir.2022.103681
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill in the missing regions of damaged images with plausible content. Existing inpainting methods tend to produce ambiguous artifacts and implausible structures. To address the above issues, our method aims to fully utilize the information of known regions to provide style and structural guidance for missing regions. Specifically, the Adaptive Style Fusion (ASF) module reduces artifacts by transferring visual style features from known regions to missing regions. The Gradient Attention Guidance (GAG) module generates accurate structures by aggregating semantic information along gradient boundary regions. In addition, the Multi-scale Attentional Feature Extraction (MAFE) module extracts global contextual information and enhances the representation of image features. The sufficient experimental results on the three datasets demonstrate that our proposed method has superior performance in terms of visual plausibility and structural consistency compared to state-of-the-art inpainting methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Artistic Image Style Conversion Based on Multi-Scale Feature Fusion Network
    Li H.
    Zhu W.
    Informatica (Slovenia), 2024, 48 (10): : 1 - 18
  • [42] MsRAN: a multi-scale residual attention network for multi-model image fusion
    Wang, Jing
    Yu, Long
    Tian, Shengwei
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2022, 60 (12) : 3615 - 3634
  • [43] MsRAN: a multi-scale residual attention network for multi-model image fusion
    Jing Wang
    Long Yu
    Shengwei Tian
    Medical & Biological Engineering & Computing, 2022, 60 : 3615 - 3634
  • [44] AMSIN: An adaptive multi-scale input network for hyperspectral image fusion
    Liu, Cong
    Feng, Jiaqi
    INFRARED PHYSICS & TECHNOLOGY, 2024, 140
  • [45] MULTI-SCALE EXPOSURE FUSION VIA GRADIENT DOMAIN GUIDED IMAGE FILTERING
    Kou, Fei
    Li, Zhengguo
    Wen, Changyun
    Chen, Weihai
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 1105 - 1110
  • [46] Multi-scale recurrent attention gated fusion network for single image dehazing
    Zhang, Xiangfen
    Yang, Shuo
    Zhang, Qingyi
    Yuan, Feiniu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101
  • [47] Underwater Image Enhancement Based on Multi-Scale Feature Fusion and Attention Network
    Liu Y.
    Liu M.
    Lin S.
    Tao Z.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (05): : 685 - 695
  • [48] Multi-scale feature fusion pyramid attention network for single image dehazing
    Liu, Jianlei
    Liu, Peng
    Zhang, Yuanke
    IET IMAGE PROCESSING, 2023, 17 (09) : 2726 - 2735
  • [49] Non-Local and Multi-Scale Mechanisms for Image Inpainting
    He, Xu
    Yin, Yong
    SENSORS, 2021, 21 (09)
  • [50] Multi-scale semantic image inpainting with residual learning and GAN
    Jiao, Libin
    Wu, Hao
    Wang, Haodi
    Bie, Rongfang
    NEUROCOMPUTING, 2019, 331 : 199 - 212