Video Super-Resolution via Residual Learning

被引:25
|
作者
Wang, Wenjun [1 ]
Ren, Chao [1 ]
He, Xiaohai [1 ]
Chen, Honggang [1 ]
Qing, Linbo [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Sichuan, Peoples R China
来源
IEEE ACCESS | 2018年 / 6卷
基金
中国国家自然科学基金;
关键词
Video super-resolution; convolutional neural network; implicit motion compensation; residual block; skip-connection; SINGLE IMAGE SUPERRESOLUTION; MOTION COMPENSATION; INTERPOLATION;
D O I
10.1109/ACCESS.2018.2829908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Convolutional neural networks have been widely applied in many low level vision tasks. In this paper, we propose a video super-resolution (SR) method named enhanced video SR network with residual blocks (EVSR). The proposed EVSR fully exploits spatio-temporal information and can implicitly capture motion relations between consecutive frames. Therefore, unlike conventional methods to video SR, EVSR does not require an explicit motion compensation process. In addition, residual learning framework exhibits excellence in convergence rate and performance improvement. Based on this, residual blocks and long skip-connection with dimension adjustment layer are proposed to predict high-frequency details. Extensive experiments validate the superiority of our approach over state-of-the-art algorithms.
引用
收藏
页码:23767 / 23777
页数:11
相关论文
共 50 条
  • [31] Learning recurrent residual regressors for single image super-resolution
    Zhang, Kaibing
    Wang, Zhen
    Li, Jie
    Gao, Xinbo
    Xiong, Zenggang
    SIGNAL PROCESSING, 2019, 154 : 324 - 337
  • [32] Multiple Residual Learning Network for Single Image Super-Resolution
    Liu, Renhe
    Li, Sumei
    Hou, Chunping
    Lei, Guoqing
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [33] Towards Interpretable Video Super-Resolution via Alternating Optimization
    Cao, Jiezhang
    Liang, Jingyun
    Zhang, Kai
    Wang, Wenguan
    Wang, Qin
    Zhang, Yulun
    Tang, Hao
    Van Gool, Luc
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 393 - 411
  • [34] Video Super-Resolution via Bidirectional Recurrent Convolutional Networks
    Huang, Yan
    Wang, Wei
    Wang, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 1015 - 1028
  • [35] Video Super-Resolution via Dynamic Local Filter Network
    Zhou, Yang
    Liu, Xiaohong
    Chen, Lei
    Zhao, Jiying
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 41 - 45
  • [36] Learning for Unconstrained Space-Time Video Super-Resolution
    Shi, Zhihao
    Liu, Xiaohong
    Li, Chengqi
    Dai, Linhui
    Chen, Jun
    Davidson, Timothy N.
    Zhao, Jiying
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (02) : 345 - 358
  • [37] Video super-resolution based on deep learning: a comprehensive survey
    Liu, Hongying
    Ruan, Zhubo
    Zhao, Peng
    Dong, Chao
    Shang, Fanhua
    Liu, Yuanyuan
    Yang, Linlin
    Timofte, Radu
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (08) : 5981 - 6035
  • [38] Pansharpening via Super-Resolution Iterative Residual Network With a Cross-Scale Learning Strategy
    Chen, Shiyu
    Qi, Hua
    Nan, Ke
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] Learning Trajectory-Aware Transformer for Video Super-Resolution
    Liu, Chengxu
    Yang, Huan
    Fu, Jianlong
    Qian, Xueming
    arXiv, 2022,
  • [40] Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning
    Zhu, Zhiyu
    Hou, Junhui
    Chen, Jie
    Zeng, Huanqiang
    Zhou, Jiantao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1423 - 1438