Adaptive Kernel Convolutional Stereo Matching Recurrent Network

被引:0
|
作者
Wang, Jiamian [1 ,2 ]
Sun, Haijiang [1 ]
Jia, Ping [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt, Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
stereo matching; GRU; adaptive; matching attention;
D O I
10.3390/s24227386
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For binocular stereo matching techniques, the most advanced method currently is using an iterative structure based on GRUs. Methods in this class have shown high performance on both high-resolution images and standard benchmarks. However, simply replacing cost aggregation with a GRU iterative method leads to the original cost volume for disparity calculation lacking non-local geometric and contextual information. Based on this, this paper proposes a new GRU iteration-based adaptive kernel convolution deep recurrent network architecture for stereo matching. This paper proposes a kernel convolution-based adaptive multi-scale pyramid pooling (KAP) module that fully considers the spatial correlation between pixels and adds new matching attention (MAR) to refine the matching cost volume before inputting it into the iterative network for iterative updates, enhancing the pixel-level representation ability of the image and improving the overall generalization ability of the network. At present, the AKC-Stereo network proposed in this paper has a higher improvement than the basic network. On the Sceneflow dataset, the EPE of AKC-Stereo reaches 0.45, which is 0.02 higher than the basic network. On the KITTI 2015 dataset, the AKC-Stereo network outperforms the base network by 5.6% on the D1-all metric.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Recurrent convolutional model based on gated spiking neural P system for stereo matching networks
    Chenggang Guo
    Hong Peng
    Jun Wang
    Applied Intelligence, 2023, 53 : 29570 - 29584
  • [32] An efficient and accurate multi-level cascaded recurrent network for stereo matching
    Zhong, Ziyu
    Yang, Xiuze
    Pan, Xiubian
    Guan, Wei
    Liang, Ke
    Li, Jing
    Liao, Xiaolan
    Wang, Shuo
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [33] Stereo Matching Network Based on Multi-Stage Fusion and Recurrent Aggregation
    Zhang R.
    Ren G.
    Li Q.
    Duan Z.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2021, 49 (06): : 77 - 87and99
  • [34] CONVOLUTIONAL COST AGGREGATION FOR ROBUST STEREO MATCHING
    Jeong, Somi
    Kim, Seungryong
    Ham, Bumsub
    Sohn, Kwanghoon
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2523 - 2527
  • [35] Adaptive Graph Fusion Convolutional Recurrent Network for Traffic Forecasting
    Xu, Yan
    Lu, Yu
    Ji, Changtao
    Zhang, Qiyuan
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (13) : 11465 - 11475
  • [36] MC-DCNN: Dilated Convolutional Neural Network for Computing Stereo Matching Cost
    Liu, Xiao
    Luo, Ye
    Ye, Yu
    Lu, Jianwei
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT III, 2017, 10636 : 249 - 259
  • [37] End-to-end dense stereo matching based on full convolutional neural network
    Kang J.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2022, 51 (05): : 785
  • [38] Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matching
    Pang, Jiahao
    Sun, Wenxiu
    Ren, Jimmy S. J.
    Yang, Chengxi
    Yan, Qiong
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 878 - 886
  • [39] An end-to-end stereo matching algorithm based on improved convolutional neural network
    Liu, Yan
    Lv, Bingxue
    Wang, Yuheng
    Huang, Wei
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (06) : 7787 - 7803
  • [40] Lightweight multi-scale convolutional neural network for real time stereo matching
    Xue, Yanbing
    Zhang, Doudou
    Li, Leida
    Li, Shiyin
    Wang, Yuxin
    IMAGE AND VISION COMPUTING, 2022, 124