CSINet: A Cross-Scale Interaction Network for Lightweight Image Super-Resolution

被引:3
|
作者
Ke, Gang [1 ,2 ]
Lo, Sio-Long [1 ]
Zou, Hua [3 ]
Liu, Yi-Feng [1 ]
Chen, Zhen-Qiang [1 ]
Wang, Jing-Kai [1 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau 999078, Peoples R China
[2] Dongguan Polytech, Sch Elect Informat, Dongguan 523109, Peoples R China
[3] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
关键词
super-resolution; cross-scale interaction; factorized convolution; efficient large convolutional kernel attention;
D O I
10.3390/s24041135
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, advancements in deep Convolutional Neural Networks (CNNs) have brought about a paradigm shift in the realm of image super-resolution (SR). While augmenting the depth and breadth of CNNs can indeed enhance network performance, it often comes at the expense of heightened computational demands and greater memory usage, which can restrict practical deployment. To mitigate this challenge, we have incorporated a technique called factorized convolution and introduced the efficient Cross-Scale Interaction Block (CSIB). CSIB employs a dual-branch structure, with one branch extracting local features and the other capturing global features. Interaction operations take place in the middle of this dual-branch structure, facilitating the integration of cross-scale contextual information. To further refine the aggregated contextual information, we designed an Efficient Large Kernel Attention (ELKA) using large convolutional kernels and a gating mechanism. By stacking CSIBs, we have created a lightweight cross-scale interaction network for image super-resolution named "CSINet". This innovative approach significantly reduces computational costs while maintaining performance, providing an efficient solution for practical applications. The experimental results convincingly demonstrate that our CSINet surpasses the majority of the state-of-the-art lightweight super-resolution techniques used on widely recognized benchmark datasets. Moreover, our smaller model, CSINet-S, shows an excellent performance record on lightweight super-resolution benchmarks with extremely low parameters and Multi-Adds (e.g., 33.82 dB@Set14 x 2 with only 248 K parameters).
引用
收藏
页数:22
相关论文
共 50 条
  • [1] CFDN: cross-scale feature distillation network for lightweight single image super-resolution
    Mu, Zihan
    Zhu, Ge
    Tang, Jinping
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [2] Hyperspectral Image Super-Resolution Network Based on Cross-Scale Nonlocal Attention
    Li, Shuangliang
    Tian, Yugang
    Wang, Cheng
    Wu, Hongxian
    Zheng, Shaolan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Cross-Scale Residual Network: A General Framework for Image Super-Resolution, Denoising, and Deblocking
    Zhou, Yuan
    Du, Xiaoting
    Wang, Mingfei
    Huo, Shuwei
    Zhang, Yeda
    Kung, Sun-Yuan
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 5855 - 5867
  • [4] High-order cross-scale attention network for single image super-resolution
    Li, Tao
    Dong, Xiucheng
    Luo, Songning
    Fan, Zhiwei
    DIGITAL SIGNAL PROCESSING, 2022, 129
  • [5] GCPAN: an adaptive global cross-scale prior attention network for image super-resolution
    Mingzhu Shi
    Siqi Kong
    Bin Zao
    Muxian Tan
    Neural Computing and Applications, 2023, 35 : 17671 - 17688
  • [6] GCPAN: an adaptive global cross-scale prior attention network for image super-resolution
    Shi, Mingzhu
    Kong, Siqi
    Zao, Bin
    Tan, Muxian
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (24): : 17671 - 17688
  • [7] Cross-scale collaborative network for single image super resolution
    Zhou, Ying
    Zheng, Zhichao
    Sun, Quansen
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [8] Self-Supervised Cross-Scale Nonlocal Attention Network for Blind Image Super-Resolution
    Li, Yinong
    Yu, Jing
    Xiao, Chuangbai
    2024 IEEE 21ST INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SMART SYSTEMS, MASS 2024, 2024, : 527 - 531
  • [9] Scale-Aware Distillation Network for Lightweight Image Super-Resolution
    Lu, Haowei
    Lu, Yao
    Li, Gongping
    Sun, Yanbei
    Wang, Shunzhou
    Li, Yugang
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 128 - 139
  • [10] Remote sensing image super-resolution via cross-scale hierarchical transformer
    Xiao, Yi
    Yuan, Qiangqiang
    He, Jiang
    Zhang, Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (06) : 1914 - 1930