Progressive representation recalibration for lightweight super-resolution

被引:7
|
作者
Wen, Ruimian [1 ]
Yang, Zhijing [1 ]
Chen, Tianshui [1 ]
Li, Hao [1 ]
Li, Kai [2 ]
机构
[1] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Peoples R China
[2] ZEGO, Shenzhen, Peoples R China
关键词
Super-resolution; Lightweight network; Progressive representation recalibration; Channel attention; IMAGE SUPERRESOLUTION; ATTENTION NETWORK;
D O I
10.1016/j.neucom.2022.07.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the lightweight single-image super-resolution (SISR) task has received increasing attention due to the computational complexities and sizes of convolutional neural network (CNN)-based SISR models and the explosive demand in applications on resource-limited edge devices. Current algorithms reduce the number of layers and channels in CNNs to obtain lightweight models for this task. However, these algorithms may reduce the representation ability of the learned features due to information loss, inevi-tably leading to poor performance. In this work, we propose the progressive representation recalibration network (PRRN), a new lightweight SISR network to learn complete and representative feature represen-tations. Specifically, a progressive representation recalibration block (PRRB) is developed to extract useful features from pixel and channel spaces in a two-stage approach. In the first stage, PRRB utilizes pixel and channel information to explore important feature regions. In the second stage, channel attention is fur-ther used to adjust the distribution of important feature channels. In addition, current channel attention mechanisms utilize nonlinear operations that may lead to information loss. In contrast, we design a shal-low channel attention (SCA) mechanism that can learn the importance of each channel in a simpler yet more efficient way. Extensive experiments demonstrate the superiority of the proposed PRRN. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:240 / 250
页数:11
相关论文
共 50 条
  • [21] Image Super-Resolution Via Sparse Representation
    Yang, Jianchao
    Wright, John
    Huang, Thomas S.
    Ma, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (11) : 2861 - 2873
  • [22] Improved Sparse Representation based Super-Resolution
    Kumar, Ravi Ranjan
    Mishra, Deepasikha
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 2265 - 2270
  • [23] Face Super-Resolution by Deep Collaborative Representation
    Lu T.
    Pan L.
    Guan Y.
    Zeng K.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (04): : 596 - 601
  • [24] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    OPTIK, 2022, 255
  • [25] Learning lightweight super-resolution networks with weight pruning
    Jiang, Xinrui
    Wang, Nannan
    Xin, Jingwei
    Xia, Xiaobo
    Yang, Xi
    Gao, Xinbo
    NEURAL NETWORKS, 2021, 144 : 21 - 32
  • [26] Lightweight refined networks for single image super-resolution
    Tong, Jiahui
    Dou, Qingyu
    Yang, Haoran
    Jeon, Gwanggil
    Yang, Xiaomin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3439 - 3458
  • [27] Lightweight Image Super-Resolution with ConvNeXt Residual Network
    Zhang, Yong
    Bai, Haomou
    Bing, Yaxing
    Liang, Xiao
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 9545 - 9561
  • [28] Omni Aggregation Networks for Lightweight Image Super-Resolution
    Wang, Hang
    Chen, Xuanhong
    Ni, Bingbing
    Liu, Yutian
    Liu, Jinfan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22378 - 22387
  • [29] Lightweight subpixel sampling network for image super-resolution
    Zeng, Hongfei
    Wu, Qiang
    Zhang, Jin
    Xia, Haojie
    VISUAL COMPUTER, 2024, 40 (05): : 3781 - 3793
  • [30] LIRSRN: A Lightweight Infrared Image Super-Resolution Network
    Lin, Chun-An
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,