Multi-scale strip-shaped convolution attention network for lightweight image super-resolution

被引:0
|
作者
Xu, Ke [1 ]
Pan, Lulu [1 ]
Peng, Guohua [1 ]
Zhang, Wenbo [1 ]
Lv, Yanheng [1 ]
Li, Guo [1 ]
Li, Lingxiao [1 ]
Lei, Le [1 ]
机构
[1] Northwestern Polytech Univ, Sch Math & Stat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Strip convolution; Attention mechanism; Lightweight; Convolutional neural network;
D O I
10.1016/j.image.2024.117166
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Lightweight convolutional neural networks for Single Image Super-Resolution (SISR) have exhibited remarkable performance improvements in recent years. These models achieve excellent performance by relying on attention mechanisms that incorporate square-shaped convolutions to enhance feature representation. However, these approaches still suffer from redundancy which comes from square-shaped convolutional kernels and overlooks the utilization of multi-scale information. In this paper, we propose a novel attention mechanism called Multiscale Strip-shaped convolution Attention (MSA), which utilizes three sets of differently sized depth-wise separable stripe convolution kernels in parallel to replace the redundant square-shaped convolution attention and extract multi-scale features. We also generalize MSA to other lightweight neural network models, and experimental results show that MSA outperforms other convolutional based attention mechanisms. Building upon MSA, we propose an Efficient Feature Extraction Block (EFEB), a lightweight block for SISR. Finally, based on EFEB, we propose a lightweight image super-resolution neural network named Multi-scale Strip-shaped convolution Attention Network (MSAN). Experiments demonstrate that MSAN outperforms existing state-of-the-art lightweight SR methods with fewer parameters and lower computational complexity.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Single image super-resolution based on multi-scale dense attention network
    Gao, Farong
    Wang, Yong
    Yang, Zhangyi
    Ma, Yuliang
    Zhang, Qizhong
    SOFT COMPUTING, 2023, 27 (06) : 2981 - 2992
  • [32] Multi-scale non-local attention network for image super-resolution
    Wu, Xue
    Zhang, Kaibing
    Hu, Yanting
    He, Xin
    Gao, Xinbo
    SIGNAL PROCESSING, 2024, 218
  • [33] Global attention guided multi-scale network for face image super-resolution
    Jinlu Zhang
    Mingliang Liu
    Xiaohang Wang
    Machine Vision and Applications, 2023, 34
  • [34] Global attention guided multi-scale network for face image super-resolution
    Zhang, Jinlu
    Liu, Mingliang
    Wang, Xiaohang
    MACHINE VISION AND APPLICATIONS, 2023, 34 (06)
  • [35] Single image super-resolution based on multi-scale dense attention network
    Farong Gao
    Yong Wang
    Zhangyi Yang
    Yuliang Ma
    Qizhong Zhang
    Soft Computing, 2023, 27 : 2981 - 2992
  • [36] Quaternion attention multi-scale widening network for endoscopy image super-resolution
    Lin, Junyu
    Huang, Guoheng
    Huang, Jun
    Yuan, Xiaochen
    Zeng, Yiwen
    Shi, Cheng
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (07):
  • [37] Fusing multi-scale information in convolution network for MR image super-resolution reconstruction
    Liu, Chang
    Wu, Xi
    Yu, Xi
    Tang, YuanYan
    Zhang, Jian
    Zhou, JiLiu
    BIOMEDICAL ENGINEERING ONLINE, 2018, 17
  • [38] OverNet: Lightweight Multi-Scale Super-Resolution with Overscaling Network
    Behjati, Parichehr
    Rodriguez, Pau
    Mehri, Armin
    Hupont, Isabelle
    Fernandez Tena, Carles
    Gonzalez, Jordi
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2693 - 2702
  • [39] Fusing multi-scale information in convolution network for MR image super-resolution reconstruction
    Chang Liu
    Xi Wu
    Xi Yu
    YuanYan Tang
    Jian Zhang
    JiLiu Zhou
    BioMedical Engineering OnLine, 17
  • [40] Multi-scale Residual Network for Image Super-Resolution
    Li, Juncheng
    Fang, Faming
    Mei, Kangfu
    Zhang, Guixu
    COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 527 - 542