Local-Global Dynamic Filtering Network for Video Super-Resolution

被引:1
|
作者
Zhang, Chaopeng [1 ]
Wang, Xingtao [1 ]
Xiong, Ruiqin [2 ]
Fan, Xiaopeng [1 ,3 ]
Zhao, Debin [1 ,3 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[2] Peking Univ, Inst Digital Media, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
[3] Peng Cheng Lab, Shenzhen 519055, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Video super-resolution; alignment; divide-and-donquer; self-calibrated dynamic filtering; long-range dependencies; SUPER RESOLUTION;
D O I
10.1109/TCI.2023.3321980
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Video super-resolution (VSR) has been greatly advanced by the use of deep learning techniques, but the challenge of handling motion variability has remained a bottleneck. Many previous methods have treated motions equally, leading to suboptimal alignment. In this article, we propose a Local-Global Dynamic Filtering Network (LGDFNet) to address this issue. LGDFNet uses a divide-and-conquer strategy to handle motion-varying features, where the overall feature is split into local features and assigned specialized sub-networks to align and fuse them from local to global. To align the features and adaptively aggregate several kernels for calibration, we propose the Self-Calibrated Dynamic Filtering (SCDF) module. Additionally, we introduce the Cross-Attention Feature Fusing (CAFF) module to capture long-range dependencies and fuse each feature. Our extensive experiments on different benchmark datasets demonstrate the effectiveness of LGDFNet, both subjectively and objectively.
引用
收藏
页码:963 / 976
页数:14
相关论文
共 50 条
  • [1] Local-Global Fusion Network for Video Super-Resolution
    Su, Dewei
    Wang, Hua
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    IEEE ACCESS, 2020, 8 : 172443 - 172456
  • [2] Learning a Local-Global Alignment Network for Satellite Video Super-Resolution
    Jin, Xianyu
    He, Jiang
    Xiao, Yi
    Yuan, Qiangqiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [3] Local-Global Temporal Difference Learning for Satellite Video Super-Resolution
    Xiao, Yi
    Yuan, Qiangqiang
    Jiang, Kui
    Jin, Xianyu
    He, Jiang
    Zhang, Liangpei
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (04) : 2789 - 2802
  • [4] Feedback Refined Local-Global Network for Super-Resolution of Hyperspectral Imagery
    Tang, Zhenjie
    Xu, Qing
    Wu, Pengfei
    Shi, Zhenwei
    Pan, Bin
    REMOTE SENSING, 2022, 14 (08)
  • [5] Video Super-Resolution via Dynamic Local Filter Network
    Zhou, Yang
    Liu, Xiaohong
    Chen, Lei
    Zhao, Jiying
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 41 - 45
  • [6] Super-Resolution for Remote Sensing Images via Local-Global Combined Network
    Lei, Sen
    Shi, Zhenwei
    Zou, Zhengxia
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (08) : 1243 - 1247
  • [7] Hyperspectral Image Super-Resolution Network of Local-Global Attention Feature Reuse
    Size, Wang
    Xin, Guan
    Qiang, Li
    ACTA OPTICA SINICA, 2023, 43 (21)
  • [8] Local-Global Feature Fusion Network for Efficient Hyperspectral Image Super-Resolution
    Xu, Jingran
    Zhao, Jiankang
    Cui, Chao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [9] Local-global aggregation transformer for enhanced image super-resolution
    Wu, Yuxiang
    Wang, Xiaoyan
    Gao, Yuzhao
    Liu, Xiaoyan
    Dou, Yan
    DIGITAL SIGNAL PROCESSING, 2025, 161
  • [10] LOCAL-GLOBAL FEATURE AGGREGATION FOR LIGHT FIELD IMAGE SUPER-RESOLUTION
    Wang, Yan
    Lu, Yao
    Wang, Shunzhou
    Zhang, Wenyao
    Wang, Zijian
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2160 - 2164