Deep Feature Fusion Network for Compressed Video Super-Resolution

被引:0
|
作者
Yue Wang
Xiaohong Wu
Xiaohai He
Chao Ren
Tingrong Zhang
机构
[1] Sichuan University,College of Electronics and Information Engineering
来源
Neural Processing Letters | 2022年 / 54卷
关键词
Compression artifacts reduction; Super-resolution; Feature fusion; Ordinary differential equation; Dual attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
The majority of conventional video super-resolution algorithms aim at reconstructing low-resolution videos after down-sampling. However, numerous low-resolution videos will be further compressed to adapt to the limited storage size and transmission bandwidth, leading to further video quality degradation. Significantly, the noise brought by compression often has a strong correlation with the content of the video frame itself. If we super-resolve compressed video frames directly, the noise may be amplified, leading to loss of important information or lower super-resolution performance. To ease those problems, we present an end-to-end deep feature fusion network with ordinary differential equation and dual attention mechanism for joint video compression artifacts reduction and super-resolution. The proposed network commendably enhances the spatial-temporal features fusion of different depths, improves the acquisition of meaningful information ability, and perfects reconstruction quality. In addition, we leverage several skip connections to fuse the captured in-depth feature information and the shallow to prevent information loss. The experimental results show that our proposed method is competent to reduce bit-rate and have excellent quality improvement effectively.
引用
收藏
页码:4427 / 4441
页数:14
相关论文
共 50 条
  • [41] Fast Video Super-Resolution Reconstruction Method Based on Motion Feature Fusion
    Fu L.
    Sun X.
    Zhao Y.
    Li Z.
    Huang J.
    Wang L.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2019, 32 (11): : 1022 - 1031
  • [42] Dual-Stream Fusion Network for Spatiotemporal Video Super-Resolution
    Tseng, Min-Yuan
    Chen, Yen-Chung
    Lee, Yi-Lun
    Lai, Wei-Sheng
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2683 - 2692
  • [43] Video Super-Resolution with Compensation in Feature Extraction
    Zhou, Yang
    Chen, Lei
    Zhao, Jiying
    2019 IEEE PACIFIC RIM CONFERENCE ON COMMUNICATIONS, COMPUTERS AND SIGNAL PROCESSING (PACRIM), 2019,
  • [44] A NOVEL ALGORITHM OF SUPER-RESOLUTION RECONSTRUCTION FOR COMPRESSED VIDEO
    Xu Zhongqiang Zhu Xiuchang (Information Industry Ministry and Jiangsu Province Key Lab of Image Processing & Image Communication
    Journal of Electronics(China), 2007, (03) : 363 - 368
  • [45] Edge-Oriented Compressed Video Super-Resolution
    Wang, Zheng
    Quan, Guancheng
    He, Gang
    SENSORS, 2024, 24 (01)
  • [46] Super-resolution mosaicing from MPEG compressed video
    Kramer, P
    Hadar, O
    Benois-Pineau, J
    Domenger, JP
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 801 - 804
  • [47] Super-resolution mosaicing from MPEG compressed video
    Kramer, P.
    Hadar, O.
    Benois-Pineau, J.
    Domenger, J. -P.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2007, 22 (10) : 845 - 865
  • [48] Image Super-Resolution Algorithms Based on Deep Feature Differentiation Network
    Cheng D.
    Yuan H.
    Qian J.
    Kou Q.
    Jiang H.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (03): : 1033 - 1042
  • [49] VIDEO SATELLITE IMAGERY SUPER-RESOLUTION VIA A DEEP RESIDUAL NETWORK
    Wu, Jiemin
    He, Zhi
    Zhuo, Li
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2762 - 2765
  • [50] Deeply feature fused video super-resolution network using temporal grouping
    Chen, Zhensen
    Yang, Wenyuan
    Yang, Jingmin
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (07): : 8999 - 9016