Recurrent feature supplementation network for video super-resolution

被引:0
|
作者
Li, Guo-Fang [1 ]
Zhu, Yong-Gui [2 ]
机构
[1] Commun Univ China, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Commun Univ China, Sch Data Sci & Media Intelligence, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Hsieh; Sun-Yuan; Xu; Li; Video super-resolution; feature supplementation mechanism; temporal grouping; temporal fusion;
D O I
10.1080/02533839.2024.2383573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Efficient aggregation of temporal information is the basis for achieving video super-resolution. Most researchers have employed alignment or propagation to exploit the temporal information of consecutive frames. However, they frequently overlook the centrality of the reference frame in the model reconstruction when using temporal features. Thus, in this paper, we design a novel recurrent feature supplementation network. We divide the temporal information into three parts: surrounding, back propagation and forward propagation, and extract and fuse them separately. A new grouping approach is proposed for extracting features from the reference frame and its surroundings. The backward temporal fusion module and the forward temporal fusion module are designed to aggregate the backward and forward temporal information at a distance. The temporal fusion module is designed to aggregate temporal information from different parts. Moreover, we propose a feature supplementation mechanism to improve the stability of the model. The feature supplement module is devised to improve the utilization of input features and the stability of the model. Experiments demonstrate that our model achieves the state-of-the-art performance.
引用
收藏
页码:888 / 900
页数:13
相关论文
共 50 条
  • [1] Recurrent Feature Updating Network for Video Super-Resolution
    Li, Guofang
    Zhu, Yonggui
    IEEE ACCESS, 2023, 11 : 103476 - 103485
  • [2] Deeply Feature Fused Video Super-resolution Network
    Yang, Jingmin
    Chen, Zhensen
    Xu, Li
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 161 - 164
  • [3] Video Super-Resolution with Regional Focus for Recurrent Network
    Li, Yanghui
    Zhu, Hong
    He, Lixin
    Wang, Dong
    Shi, Jing
    Wang, Jing
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [4] Deep Feature Fusion Network for Compressed Video Super-Resolution
    Yue Wang
    Xiaohong Wu
    Xiaohai He
    Chao Ren
    Tingrong Zhang
    Neural Processing Letters, 2022, 54 : 4427 - 4441
  • [5] Deep Feature Fusion Network for Compressed Video Super-Resolution
    Wang, Yue
    Wu, Xiaohong
    He, Xiaohai
    Ren, Chao
    Zhang, Tingrong
    NEURAL PROCESSING LETTERS, 2022, 54 (05) : 4427 - 4441
  • [6] A Lightweight Recurrent Aggregation Network for Satellite Video Super-Resolution
    Wang, Han
    Li, Shengyang
    Zhao, Manqi
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 685 - 695
  • [7] A Lightweight Recurrent Aggregation Network for Satellite Video Super-Resolution
    Wang, Han
    Li, Shengyang
    Zhao, Manqi
    IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17 : 685 - 695
  • [8] A Lightweight Recurrent Grouping Attention Network for Video Super-Resolution
    Zhu, Yonggui
    Li, Guofang
    SENSORS, 2023, 23 (20)
  • [9] Recurrent Back-Projection Network for Video Super-Resolution
    Haris, Muhammad
    Shakhnarovich, Greg
    Ukita, Norimichi
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3892 - 3901
  • [10] MULTI-STAGE FEATURE ALIGNMENT NETWORK FOR VIDEO SUPER-RESOLUTION
    Suzuki, Keito
    Ikehara, Masaaki
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2001 - 2005