Adaptive Kernel Convolutional Stereo Matching Recurrent Network

被引:0
|
作者
Wang, Jiamian [1 ,2 ]
Sun, Haijiang [1 ]
Jia, Ping [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt, Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
stereo matching; GRU; adaptive; matching attention;
D O I
10.3390/s24227386
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For binocular stereo matching techniques, the most advanced method currently is using an iterative structure based on GRUs. Methods in this class have shown high performance on both high-resolution images and standard benchmarks. However, simply replacing cost aggregation with a GRU iterative method leads to the original cost volume for disparity calculation lacking non-local geometric and contextual information. Based on this, this paper proposes a new GRU iteration-based adaptive kernel convolution deep recurrent network architecture for stereo matching. This paper proposes a kernel convolution-based adaptive multi-scale pyramid pooling (KAP) module that fully considers the spatial correlation between pixels and adds new matching attention (MAR) to refine the matching cost volume before inputting it into the iterative network for iterative updates, enhancing the pixel-level representation ability of the image and improving the overall generalization ability of the network. At present, the AKC-Stereo network proposed in this paper has a higher improvement than the basic network. On the Sceneflow dataset, the EPE of AKC-Stereo reaches 0.45, which is 0.02 higher than the basic network. On the KITTI 2015 dataset, the AKC-Stereo network outperforms the base network by 5.6% on the D1-all metric.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation
    Li, Jiankun
    Wang, Peisen
    Xiong, Pengfei
    Cai, Tao
    Yan, Ziwei
    Yang, Lei
    Liu, Jiangyu
    Fan, Haoqiang
    Liu, Shuaicheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16242 - 16251
  • [2] Convolutional neural network and adaptive guided image filter based stereo matching
    Wen, Sihan
    2017 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2017, : 473 - 478
  • [3] A Convolutional Attention Residual Network for Stereo Matching
    Huang, Guangyi
    Gong, Yongyi
    Xu, Qingzhen
    Wattanachote, Kanoksak
    Zeng, Kun
    Luo, Xiaonan
    IEEE ACCESS, 2020, 8 : 50828 - 50842
  • [4] Stereo Matching Based on Convolutional Neural Network
    Xiao Jinsheng
    Tian Hong
    Zou Wentao
    Tong Le
    Lei Junfeng
    ACTA OPTICA SINICA, 2018, 38 (08)
  • [5] Adaptive slice stereo matching network
    Li, Han
    Gou, Guohua
    Zhang, Hao
    Wang, Xuanhao
    Ye, Yang
    Sui, Haigang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)
  • [6] Hourglass cascaded recurrent stereo matching network
    Yuan, Tuming
    Hu, Jiancheng
    Ou, Shuangjiang
    Yang, Weijia
    Hei, Yafang
    IMAGE AND VISION COMPUTING, 2024, 147
  • [7] Computing the Stereo Matching Cost with a Convolutional Neural Network
    Zbontar, Jure
    LeCun, Yann
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1592 - 1599
  • [8] Stereo Matching Using Gabor Convolutional Neural Network
    Liu, Zhendong
    Hu, Qinglei
    Liu, Jiachen
    Zhang, Baochang
    2018 11TH INTERNATIONAL WORKSHOP ON HUMAN FRIENDLY ROBOTICS (HFR), 2018, : 48 - 53
  • [9] Using convolutional neural network for matching cost computation in stereo matching
    Denisov, Aleksei
    Wang, Yan
    Zhdanov, Andrey
    Bykovskii, Sergei
    AI IN OPTICS AND PHOTONICS (AOPC 2019), 2019, 11342
  • [10] Stereo matching algorithm based on improved convolutional neural network
    Zhu, S. P.
    Xu, H.
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2018, 123 : 40 - 40