Deep Feature Fusion Network for Compressed Video Super-Resolution

被引:0
|
作者
Yue Wang
Xiaohong Wu
Xiaohai He
Chao Ren
Tingrong Zhang
机构
[1] Sichuan University,College of Electronics and Information Engineering
来源
Neural Processing Letters | 2022年 / 54卷
关键词
Compression artifacts reduction; Super-resolution; Feature fusion; Ordinary differential equation; Dual attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
The majority of conventional video super-resolution algorithms aim at reconstructing low-resolution videos after down-sampling. However, numerous low-resolution videos will be further compressed to adapt to the limited storage size and transmission bandwidth, leading to further video quality degradation. Significantly, the noise brought by compression often has a strong correlation with the content of the video frame itself. If we super-resolve compressed video frames directly, the noise may be amplified, leading to loss of important information or lower super-resolution performance. To ease those problems, we present an end-to-end deep feature fusion network with ordinary differential equation and dual attention mechanism for joint video compression artifacts reduction and super-resolution. The proposed network commendably enhances the spatial-temporal features fusion of different depths, improves the acquisition of meaningful information ability, and perfects reconstruction quality. In addition, we leverage several skip connections to fuse the captured in-depth feature information and the shallow to prevent information loss. The experimental results show that our proposed method is competent to reduce bit-rate and have excellent quality improvement effectively.
引用
收藏
页码:4427 / 4441
页数:14
相关论文
共 50 条
  • [31] Deep Blind Video Super-resolution
    Pan, Jinshan
    Bai, Haoran
    Dong, Jiangxin
    Zhang, Jiawei
    Tang, Jinhui
    Proceedings of the IEEE International Conference on Computer Vision, 2021, : 4791 - 4800
  • [32] A 'deep' review of video super-resolution
    Gopalakrishnan, Subhadra
    Choudhury, Anustup
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 129
  • [33] MULTI-STAGE FEATURE ALIGNMENT NETWORK FOR VIDEO SUPER-RESOLUTION
    Suzuki, Keito
    Ikehara, Masaaki
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2001 - 2005
  • [34] A Dual-Network Based Super-Resolution for Compressed High Definition Video
    Feng, Longtao
    Zhang, Xinfeng
    Zhang, Xiang
    Wang, Shanshe
    Wang, Ronggang
    Ma, Siwei
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I, 2018, 11164 : 600 - 610
  • [35] Hierarchical feature fusion network for light field spatial super-resolution
    Xiyao Hua
    Minghui Wang
    Boni Su
    Xia Liu
    The Visual Computer, 2023, 39 : 267 - 279
  • [36] Hierarchical feature fusion network for light field spatial super-resolution
    Hua, Xiyao
    Wang, Minghui
    Su, Boni
    Liu, Xia
    VISUAL COMPUTER, 2023, 39 (01): : 267 - 279
  • [37] PFFN: Progressive Feature Fusion Network for Lightweight Image Super-Resolution
    Zhang, Dongyang
    Li, Changyu
    Xie, Ning
    Wang, Guoqing
    Shao, Jie
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3682 - 3690
  • [38] FSFN: feature separation and fusion network for single image super-resolution
    Kai Zhu
    Zhenxue Chen
    Q. M. Jonathan Wu
    Nannan Wang
    Jie Zhao
    Gan Zhang
    Multimedia Tools and Applications, 2021, 80 : 31599 - 31618
  • [39] Efficient Attention Fusion Feature Extraction Network for Image Super-Resolution
    Wang, Tuoran
    Cheng, Na
    Ding, Shijia
    Wang, Hongyu
    ACM International Conference Proceeding Series, 2023, : 35 - 44
  • [40] FSFN: feature separation and fusion network for single image super-resolution
    Zhu, Kai
    Chen, Zhenxue
    Wu, Q. M. Jonathan
    Wang, Nannan
    Zhao, Jie
    Zhang, Gan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (21-23) : 31599 - 31618