Depth estimation using an improved stereo network

被引:1
|
作者
Xu, Wanpeng [1 ]
Zou, Ling [3 ]
Wu, Lingda [1 ]
Qi, Yue [2 ]
Qian, Zhaoyong [1 ]
机构
[1] Space Engn Univ, Sci & Technol Complex Elect Syst Simulat Lab, Beijing 101416, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Beijing Film Acad, Digital Media Sch, Beijing 100088, Peoples R China
基金
中国国家自然科学基金;
关键词
Monocular depth estimation; Self-supervised; Image reconstruction; TP391; 4;
D O I
10.1631/FITEE.2000676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-supervised depth estimation approaches present excellent results that are comparable to those of the fully supervised approaches, by employing view synthesis between the target and reference images in the training data. ResNet, which serves as a backbone network, has some structural deficiencies when applied to downstream fields, because its original purpose was to cope with classification problems. The low-texture area also deteriorates the performance. To address these problems, we propose a set of improvements that lead to superior predictions. First, we boost the information flow in the network and improve the ability to learn spatial structures by improving the network structures. Second, we use a binary mask to remove the pixels in low-texture areas between the target and reference images to more accurately reconstruct the image. Finally, we input the target and reference images randomly to expand the dataset and pre-train it on ImageNet, so that the model obtains a favorable general feature representation. We demonstrate state-of-the-art performance on an Eigen split of the KITTI driving dataset using stereo pairs.
引用
收藏
页码:777 / 789
页数:13
相关论文
共 50 条
  • [21] ACCURATE DEPTH ESTIMATION USING STRUCTURED LIGHT AND PASSIVE STEREO DISPARITY ESTIMATION
    Li, Qiang
    Biswas, Moyuresh
    Pickering, Mark R.
    Frater, Michael R.
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 969 - 972
  • [22] Unifying Flow, Stereo and Depth Estimation
    Xu, Haofei
    Zhang, Jing
    Cai, Jianfei
    Rezatofighi, Hamid
    Yu, Fisher
    Tao, Dacheng
    Geiger, Andreas
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13941 - 13958
  • [23] Normal Assisted Stereo Depth Estimation
    Kusupati, Uday
    Cheng, Shuo
    Chen, Rui
    Su, Hao
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2186 - 2196
  • [24] ARAI-MVSNet: A multi-view stereo depth estimation network with adaptive depth range and depth interval
    Zhang, Song
    Xu, Wenjia
    Wei, Zhiwei
    Zhang, Lili
    Wang, Yang
    Liu, Junyi
    PATTERN RECOGNITION, 2023, 144
  • [25] Augmenting Depth Estimation from Deep Convolutional Neural Network using Multi-Spectral Photometric Stereo
    Luo, Yisong
    Jiao, Hengchao
    Qi, Lin
    Dong, Junyu
    Zhang, Shu
    Yu, Hui
    2017 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTED, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2017,
  • [26] Real-time Stereo Matching for Depth Estimation Using GPU
    Cheng, Fang-Hsuan
    Huang, Kuan-Yu
    2015 8TH INTERNATIONAL CONFERENCE ON UBI-MEDIA COMPUTING (UMEDIA) CONFERENCE PROCEEDINGS, 2015, : 3 - 6
  • [27] Event-Based Stereo Depth Estimation Using Belief Propagation
    Xie, Zhen
    Chen, Shengyong
    Orchard, Garrick
    FRONTIERS IN NEUROSCIENCE, 2017, 11
  • [28] Deflection Estimation Methods of Structure Using Active Stereo Depth Camera
    Shin, Soojung
    Lee, Donghwan
    Cha, Gichun
    Joon, Yu Byoung
    Park, Seunghee
    JOURNAL OF THE KOREAN SOCIETY FOR NONDESTRUCTIVE TESTING, 2020, 40 (02) : 103 - 111
  • [29] Unsupervised Learning for Stereo Depth Estimation using Efficient Correspondence Matching
    Wenbin, Hui
    Sei-Ichiro, Kamata
    2021 5TH INTERNATIONAL CONFERENCE ON ADVANCES IN IMAGE PROCESSING, ICAIP 2021, 2021, : 30 - 34
  • [30] Robust skin microrelief depth estimation using a mobile stereo system
    Moon, Cho-, I
    Lee, Onseok
    Choi, Min-Hyung
    SKIN RESEARCH AND TECHNOLOGY, 2022, 28 (06) : 815 - 826