Learning accurate and enriched features for stereo image super-resolution

被引:0
|
作者
Gao, Hu [1 ]
Dang, Depeng [1 ]
机构
[1] Beijing Normal Univ, Artificial Intelligence, Beijing 100000, Peoples R China
关键词
Stereo image super-resolution; Mixed-scale feature representation; Selective fusion attention module; Fast fourier convolution;
D O I
10.1016/j.patcog.2024.111170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges inaccurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative qualitative evaluations. The code and the pre-trained models will be released at https://github.com/Tombs98/ MSSFNet.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] IMAGE SUPER-RESOLUTION BY EXTREME LEARNING MACHINE
    An, Le
    Bhanu, Bir
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2209 - 2212
  • [32] Advanced deep learning for image super-resolution
    Shamsolmoali, Pourya
    Sadka, Abdul Hamid
    Zhou, Huiyu
    Yang, Wankou
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 82
  • [33] Deep Learning for Image Super-Resolution: A Survey
    Wang, Zhihao
    Chen, Jian
    Hoi, Steven C. H.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3365 - 3387
  • [34] VIDEO SUPER-RESOLUTION FOR MIXED RESOLUTION STEREO
    Jain, Ankit K.
    Nguyen, Truong Q.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 962 - 966
  • [35] NLSIT: A NON-LOCAL STEREO INTERACTION TRANSFORMER FOR STEREO IMAGE SUPER-RESOLUTION
    Cao, Huiyun
    Huang, Wenqi
    Yang, Wenming
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3965 - 3969
  • [36] Customizing Super-Resolution Framework According to Image Features
    Yuan, Ninghui
    Liu, Jingyu
    Wang, Qiong
    Shen, Li
    2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 1189 - 1196
  • [37] Super-resolution reconstruction of single image for latent features
    Wang, Xin
    Yan, Jing-Ke
    Cai, Jing-Ye
    Deng, Jian-Hua
    Qin, Qin
    Cheng, Yao
    COMPUTATIONAL VISUAL MEDIA, 2024, 10 (06) : 1219 - 1239
  • [38] Coarse-to-Fine Cross-View Interaction Based Accurate Stereo Image Super-Resolution Network
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    Zhang, Wenlin
    Hou, Yonghong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7321 - 7334
  • [39] Fast and Accurate Image Super-Resolution Using A Combined Loss
    Xu, Jinchang
    Zhao, Yu
    Dong, Yuan
    Bai, Hongliang
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1093 - 1099
  • [40] Deep Learning based Frameworks for Image Super-Resolution and Noise-Resilient Super-Resolution
    Sharma, Manoj
    Chaudhury, Santanu
    Lall, Brejesh
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 744 - 751