MFMAM: Image inpainting via multi-scale feature module with attention module

被引:59
|
作者
Chen, Yuantao [1 ,2 ]
Xia, Runlong [3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Hunan Univ Informat Technol, Hunan Prov Higher Educ Key Lab Intelligent Sensing, Changsha, Hunan, Peoples R China
[3] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technol Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan Initial New Mat Corp Ltd, Loudi, Hunan, Peoples R China
关键词
Image inpainting; Deep learning; Multi-scale feature; Deep level features; Attention module;
D O I
10.1016/j.cviu.2023.103883
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, most image inpainting algorithms based on deep learning cause information loss when acquiring deep level features. It is not conducive to the image inpainting of texture details and often ignore the image restoration of semantic features, which generates image inpainting results with unreasonable structures. To address those problems, we have proposed improved image inpainting network using multi-scale feature module and improved attention module. Firstly, we propose the multi-scale fusion module based on dilated convolution to reduce information loss during the convolution process by fusing multi-scale features when acquiring image deep level features. Then, the attention module can strengthen the ability of image semantic inpainting and ensure that the proposed model can generate clear texture inpainting results. To ensure the consistency of image inpainting details and styles, the style loss and perceptual loss functions are introduced in the proposed network. The qualitative experimental results on CelebA-HQ, Places2 and Outdoor Scene datasets and common evaluation metrics such as PSNR, SSIM and FID. These metrics can validate the proposed method to be superior to the state-of-the-arts.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Residual Module and Multi-scale Feature Attention Module for Exudate Segmentation
    Peng, Haoyue
    Zheng, Shibao
    Li, Xinzhe
    Yang, Zhao
    2018 INTERNATIONAL CONFERENCE ON SENSOR NETWORKS AND SIGNAL PROCESSING (SNSP 2018), 2018, : 111 - 117
  • [2] Image Inpainting Using Multi-Scale Feature Joint Attention Model
    Lin X.
    Zhou Y.
    Li D.
    Huang W.
    Sheng B.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (08): : 1260 - 1271
  • [3] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [4] Cross-Layer Feature Attention Module for Multi-scale Object Detection
    Zheng, Haotian
    Pang, Cheng
    Lan, Rushi
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2022, PT II, 2022, 1701 : 202 - 210
  • [5] Progressively Multi-Scale Feature Fusion for Image Inpainting
    Wen, Wu
    Li, Tianhao
    Tolba, Amr
    Liu, Ziyi
    Shao, Kai
    MATHEMATICS, 2023, 11 (24)
  • [6] Image Inpainting with EMMA Attention and Multi-scale Fusion
    Wei, Yun
    Wang, Lulu
    Wu, Kaijun
    Shan, Hongquan
    Tian, Bin
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2024, 51 (12): : 87 - 97
  • [7] Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module
    Fu, Haisheng
    Liang, Feng
    Liang, Jie
    Li, BingLin
    Zhang, GuoHe
    Han, JiangNing
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 43 - 47
  • [8] MFFAMM: A Small Object Detection with Multi-Scale Feature Fusion and Attention Mechanism Module
    Qu, Zhong
    Han, Tongqiang
    Yi, Turning
    APPLIED SCIENCES-BASEL, 2022, 12 (18):
  • [9] Heart Sound Classification Based on Multi-Scale Feature Fusion and Channel Attention Module
    Li, Mingzhe
    He, Zhaoming
    Wang, Hao
    BIOENGINEERING-BASEL, 2025, 12 (03):
  • [10] Image Inpainting Based Multi-scale Gated Convolution and Attention
    Jiang, Hualiang
    Ma, Xiaohu
    Yang, Dongdong
    Zhao, Jiaxin
    Shen, Yao
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 407 - 418