Learning accurate and enriched features for stereo image super-resolution

被引:0
|
作者
Gao, Hu [1 ]
Dang, Depeng [1 ]
机构
[1] Beijing Normal Univ, Artificial Intelligence, Beijing 100000, Peoples R China
关键词
Stereo image super-resolution; Mixed-scale feature representation; Selective fusion attention module; Fast fourier convolution;
D O I
10.1016/j.patcog.2024.111170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges inaccurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative qualitative evaluations. The code and the pre-trained models will be released at https://github.com/Tombs98/ MSSFNet.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Jointly Texture Enhanced and Stereo Captured Network for Stereo Image Super-Resolution
    Jin, Kangjun
    Wang, Xuejin
    Shao, Feng
    PATTERN RECOGNITION LETTERS, 2023, 167 : 141 - 148
  • [22] Fast and Accurate Image Upscaling with Super-Resolution Forests
    Schulter, Samuel
    Leistner, Christian
    Bischof, Horst
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 3791 - 3799
  • [23] Disparity-constrained stereo endoscopic image super-resolution
    Zhang, Tianyi
    Gu, Yun
    Huang, Xiaolin
    Yang, Jie
    Yang, Guang-Zhong
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (05) : 867 - 875
  • [24] Stereo digital image correlation using binocular super-resolution
    Yin, Zhuoyi
    Yuan, Fang
    Tong, Zixiang
    He, Xiaoyuan
    Yang, Fujun
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [25] A Disparity Feature Alignment Module for Stereo Image Super-Resolution
    Dan, Jiawang
    Qu, Zhaowei
    Wang, Xiaoru
    Gu, Jiahang
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1285 - 1289
  • [26] A Disparity Feature Alignment Module for Stereo Image Super-Resolution
    Dan, Jiawang
    Qu, Zhaowei
    Wang, Xiaoru
    Gu, Jiahang
    IEEE Signal Processing Letters, 2021, 28 : 1285 - 1289
  • [27] Disparity-constrained stereo endoscopic image super-resolution
    Tianyi Zhang
    Yun Gu
    Xiaolin Huang
    Jie Yang
    Guang-Zhong Yang
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 867 - 875
  • [28] Cross Parallax Attention Network for Stereo Image Super-Resolution
    Chen, Canqiang
    Qing, Chunmei
    Xu, Xiangmin
    Dickinson, Patrick
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 202 - 216
  • [29] Single Image Super-Resolution Based on Deep Learning Features and Dictionary Model
    Zhao, Liling
    Sun, Quansen
    Zhang, Zelin
    IEEE ACCESS, 2017, 5 : 17126 - 17135
  • [30] Multiple-Image Super-Resolution Using Deep Learning and Statistical Features
    Nalepa, Jakub
    Hrynczenko, Krzysztof
    Kawulok, Michal
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2020, 2021, 12644 : 261 - 271