Learning accurate and enriched features for stereo image super-resolution

被引:0
|
作者
Gao, Hu [1 ]
Dang, Depeng [1 ]
机构
[1] Beijing Normal Univ, Artificial Intelligence, Beijing 100000, Peoples R China
关键词
Stereo image super-resolution; Mixed-scale feature representation; Selective fusion attention module; Fast fourier convolution;
D O I
10.1016/j.patcog.2024.111170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges inaccurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative qualitative evaluations. The code and the pre-trained models will be released at https://github.com/Tombs98/ MSSFNet.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Lightweight and Accurate Recursive Fractal Network for Image Super-Resolution
    Li, Juncheng
    Yuan, Yiting
    Mei, Kangfu
    Fang, Faming
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3814 - 3823
  • [42] An Accurate and Lightweight Method for Human Body Image Super-Resolution
    Liu, Yunan
    Zhang, Shanshan
    Xu, Jie
    Yang, Jian
    Tai, Yu-Wing
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 2888 - 2897
  • [43] Adaptive Modulation and Rectangular Convolutional Network for Stereo Image Super-Resolution
    Wang, Xiumei
    Li, Tianmeng
    Hui, Zheng
    Cheng, Peitao
    PATTERN RECOGNITION LETTERS, 2022, 161 : 122 - 129
  • [44] Lightweight Stereo Image Super-Resolution Using modified Parallax Attention
    Govind, Smriti
    Pradeep, R.
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2025,
  • [45] Multi-orientation depthwise extraction for stereo image super-resolution
    Xiangyang Fan
    Renjia Ye
    Feifan Cai
    Jinhua Liu
    Yuhang Li
    Liting Huang
    Youdong Ding
    Signal, Image and Video Processing, 2023, 17 : 4087 - 4095
  • [46] CVGSR: Stereo image Super-Resolution with Cross-View guidance *
    Chen, Wenfei
    Ni, Shijia
    Shao, Feng
    DISPLAYS, 2024, 83
  • [47] NTIRE 2022 Challenge on Stereo Image Super-Resolution: Methods and Results
    Wang, Longguang
    Guo, Yulan
    Wang, Yingqian
    Li, Juncheng
    Gu, Shuhang
    Timofte, Radu
    Chen, Liangyu
    Chu, Xiaojie
    Yu, Wenqing
    Jin, Kai
    Wei, Zeqiang
    Guo, Sha
    Yang, Angulia
    Zhou, Xiuzhuang
    Guo, Guodong
    Dai, Bin
    Peng, Feiyue
    Xiao, Huaxin
    Yan, Shen
    Liu, Yuxiang
    Cai, Hanxiao
    Cao, Pu
    Nie, Yang
    Yang, Lu
    Song, Qing
    Hu, Xiaotao
    Xu, Jun
    Xu, Mai
    Jing, Junpeng
    Deng, Xin
    Xing, Qunliang
    Qiao, Minglang
    Guan, Zhenyu
    Guo, Wenlong
    Peng, Chenxu
    Chen, Zan
    Chen, Junyang
    Li, Hao
    Chen, Junbin
    Li, Weijie
    Yang, Zhijing
    Li, Gen
    Li, Aijin
    Sun, Lei
    Zhang, Dafeng
    Liu, Shizhuo
    Zhang, Jiangtao
    Qu, Yanyun
    Yang, Hao-Hsiang
    Huang, Zhi-Kai
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 905 - 918
  • [48] Efficient Hybrid Feature Interaction Network for Stereo Image Super-Resolution
    Song, Jianwen
    Sowmya, Arcot
    Sun, Changming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10094 - 10105
  • [49] Multi-orientation depthwise extraction for stereo image super-resolution
    Fan, Xiangyang
    Ye, Renjia
    Cai, Feifan
    Liu, Jinhua
    Li, Yuhang
    Huang, Liting
    Ding, Youdong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (08) : 4087 - 4095
  • [50] TBNet: Stereo Image Super-Resolution with Multi-Scale Attention
    Zhu, Jiyang
    Han, Xue
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2023, 32 (18)