Recurrent feature supplementation network for video super-resolution

被引:0
|
作者
Li, Guo-Fang [1 ]
Zhu, Yong-Gui [2 ]
机构
[1] Commun Univ China, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Commun Univ China, Sch Data Sci & Media Intelligence, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Hsieh; Sun-Yuan; Xu; Li; Video super-resolution; feature supplementation mechanism; temporal grouping; temporal fusion;
D O I
10.1080/02533839.2024.2383573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Efficient aggregation of temporal information is the basis for achieving video super-resolution. Most researchers have employed alignment or propagation to exploit the temporal information of consecutive frames. However, they frequently overlook the centrality of the reference frame in the model reconstruction when using temporal features. Thus, in this paper, we design a novel recurrent feature supplementation network. We divide the temporal information into three parts: surrounding, back propagation and forward propagation, and extract and fuse them separately. A new grouping approach is proposed for extracting features from the reference frame and its surroundings. The backward temporal fusion module and the forward temporal fusion module are designed to aggregate the backward and forward temporal information at a distance. The temporal fusion module is designed to aggregate temporal information from different parts. Moreover, we propose a feature supplementation mechanism to improve the stability of the model. The feature supplement module is devised to improve the utilization of input features and the stability of the model. Experiments demonstrate that our model achieves the state-of-the-art performance.
引用
收藏
页码:888 / 900
页数:13
相关论文
共 50 条
  • [41] Video Super-Resolution via Bidirectional Recurrent Convolutional Networks
    Huang, Yan
    Wang, Wei
    Wang, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 1015 - 1028
  • [42] BFRVSR: A Bidirectional Frame Recurrent Method for Video Super-Resolution
    Xue, Xiongxiong
    Han, Zhenqi
    Tong, Weiqin
    Li, Mingqi
    Liu, Lizhuang
    APPLIED SCIENCES-BASEL, 2020, 10 (23): : 1 - 11
  • [43] Stable Long-Term Recurrent Video Super-Resolution
    Chiche, Benjamin Naoto
    Woiselle, Arnaud
    Frontera-Pons, Joana
    Starck, Jean-Luc
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 827 - 836
  • [44] An Efficient Network Design for Face Video Super-resolution
    Yu, Feng
    Li, He
    Bian, Sige
    Tang, Yongming
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1513 - 1520
  • [45] Recurrent Interaction Network for Stereoscopic Image Super-Resolution
    Zhang, Zhe
    Peng, Bo
    Lei, Jianjun
    Shen, Haifeng
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2048 - 2060
  • [46] Video Super-resolution via Convolution Neural Network
    Wei, Tsung-Hsin
    Chen, Ju-Chin
    2016 3RD INTERNATIONAL CONFERENCE ON GREEN TECHNOLOGY AND SUSTAINABLE DEVELOPMENT (GTSD), 2016, : 168 - 169
  • [47] FM-VSR: Feature Multiplexing Video Super-Resolution for Compressed Video
    He, Gang
    Wu, Shan
    Pei, Simin
    Xu, Li
    Wu, Chang
    Xu, Kepeng
    Li, Yunsong
    IEEE ACCESS, 2021, 9 : 88060 - 88068
  • [48] Dual Bidirectional Feature Enhancement Network for Continuous Space-Time Video Super-Resolution
    Luo, Laigan
    Yi, Benshun
    Wang, Zhongyuan
    He, Zheng
    Zhu, Chao
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2025, 11 : 228 - 236
  • [49] Dual feature enhanced video super-resolution network based on low-light scenarios
    Zhang, Huan
    Cao, Yihao
    Cai, Jianghui
    Cai, Xingjuan
    Zhang, Wensheng
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 115
  • [50] A lightweight distillation recurrent convolution network on FPGA for real-time video super-resolution
    Zheng, Zhaowen
    Huang, Yuqiao
    Chen, Dihu
    MULTIMEDIA SYSTEMS, 2024, 30 (06)