Learning accurate and enriched features for stereo image super-resolution

被引:0
|
作者
Gao, Hu [1 ]
Dang, Depeng [1 ]
机构
[1] Beijing Normal Univ, Artificial Intelligence, Beijing 100000, Peoples R China
关键词
Stereo image super-resolution; Mixed-scale feature representation; Selective fusion attention module; Fast fourier convolution;
D O I
10.1016/j.patcog.2024.111170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges inaccurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative qualitative evaluations. The code and the pre-trained models will be released at https://github.com/Tombs98/ MSSFNet.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Learning Enriched Features for Image Super Resolution
    Huang, Weiqin
    Li, Xiaorui
    Gu, Yikai
    Du, Xiaofu
    Zhu, Xiancheng
    IEEE ACCESS, 2022, 10 : 113583 - 113597
  • [2] Learning Parallax Attention for Stereo Image Super-Resolution
    Wang, Longguang
    Wang, Yingqian
    Liang, Zhengfa
    Lin, Zaiping
    Yang, Jungang
    An, Wei
    Guo, Yulan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12242 - 12251
  • [3] Deep Bilateral Learning for Stereo Image Super-Resolution
    Xu, Qingyu
    Wang, Longguang
    Wang, Yingqian
    Sheng, Weidong
    Deng, Xinpu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 613 - 617
  • [4] Stereo Image Super-Resolution: A Survey
    Wang Yingqian
    Wang Longguang
    Liang Zhengyu
    An Wei
    Yang Jungang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (18)
  • [5] A Stereo Attention Module for Stereo Image Super-Resolution
    Ying, Xinyi
    Wang, Yingqian
    Wang, Longguang
    Sheng, Weidong
    An, Wei
    Guo, Yulan
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 496 - 500
  • [6] Learning Accurate Features for Super-Resolution Spacecraft ISAR Imaging
    Gao, Hu
    Yang, Jingfan
    Wang, Ning
    Yang, Jing
    Zhang, Ying
    Dang, Depeng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 1
  • [7] Accurate image registration for MAP image super-resolution
    Vrigkas, Michalis
    Nikou, Christophoros
    Kondi, Lisimachos P.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (05) : 494 - 508
  • [8] Learning Epipolar Line Window Attention for Stereo Image Super-Resolution Reconstruction
    Li, Xue
    Zhang, Hongying
    Ye, Zixun
    Huang, Xiaoru
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (02): : 2847 - 2864
  • [9] Perception-Oriented Stereo Image Super-Resolution
    Ma, Chenxi
    Yan, Bo
    Tan, Weimin
    Jiang, Xuhao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2420 - 2428
  • [10] Cross View Capture for Stereo Image Super-Resolution
    Zhu, Xiangyuan
    Guo, Kehua
    Fang, Hui
    Chen, Liang
    Ren, Sheng
    Hu, Bin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3074 - 3086