Depth estimation using an improved stereo network

被引:1
|
作者
Xu, Wanpeng [1 ]
Zou, Ling [3 ]
Wu, Lingda [1 ]
Qi, Yue [2 ]
Qian, Zhaoyong [1 ]
机构
[1] Space Engn Univ, Sci & Technol Complex Elect Syst Simulat Lab, Beijing 101416, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Beijing Film Acad, Digital Media Sch, Beijing 100088, Peoples R China
基金
中国国家自然科学基金;
关键词
Monocular depth estimation; Self-supervised; Image reconstruction; TP391; 4;
D O I
10.1631/FITEE.2000676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-supervised depth estimation approaches present excellent results that are comparable to those of the fully supervised approaches, by employing view synthesis between the target and reference images in the training data. ResNet, which serves as a backbone network, has some structural deficiencies when applied to downstream fields, because its original purpose was to cope with classification problems. The low-texture area also deteriorates the performance. To address these problems, we propose a set of improvements that lead to superior predictions. First, we boost the information flow in the network and improve the ability to learn spatial structures by improving the network structures. Second, we use a binary mask to remove the pixels in low-texture areas between the target and reference images to more accurately reconstruct the image. Finally, we input the target and reference images randomly to expand the dataset and pre-train it on ImageNet, so that the model obtains a favorable general feature representation. We demonstrate state-of-the-art performance on an Eigen split of the KITTI driving dataset using stereo pairs.
引用
收藏
页码:777 / 789
页数:13
相关论文
共 50 条
  • [31] Stereo depth estimation using synchronous optimization with segment based regularization
    Aydin, Tarkan
    Akgul, Yusuf Sinan
    PATTERN RECOGNITION LETTERS, 2010, 31 (15) : 2389 - 2396
  • [32] Depth estimation using multiwavelet analysis based stereo vision approach
    Bhatti, Asim
    Nahavandi, Saeid
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2008, 6 (03) : 481 - 497
  • [33] A Lightweight Real-time Stereo Depth Estimation Network with Dynamic Upsampling Modules
    Deng, Yong
    Xiao, Jimin
    Zhou, Steven Zhiying
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 701 - 710
  • [34] Efficient Edge-Preserving Multi-View Stereo Network for Depth Estimation
    Su, Wanjuan
    Tao, Wenbing
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 2348 - 2356
  • [35] Light-weight network for real-time adaptive stereo depth estimation
    Gan, Wanshui
    Wong, Pak Kin
    Yu, Guokuan
    Zhao, Rongchen
    Vong, Chi Man
    NEUROCOMPUTING, 2021, 441 : 118 - 127
  • [36] Surface Depth Estimation From Multiview Stereo Satellite Images With Distribution Contrast Network
    Chen, Ziyang
    Li, Wenting
    Cui, Zhongwei
    Zhang, Yongjun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17837 - 17845
  • [37] Unsupervised Deep Event Stereo for Depth Estimation
    Uddin, S. M. Nadim
    Ahmed, Soikat Hasan
    Jung, Yong Ju
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7489 - 7504
  • [38] DEEP STEREO CONFIDENCE PREDICTION FOR DEPTH ESTIMATION
    Kim, Sunok
    Min, Dongbo
    Ham, Bumsub
    Kim, Seungryong
    Sohn, Kwanghoon
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 992 - 996
  • [39] Depth estimation with a panoramic stereo imaging system
    Tian, Yanbing
    Bai, Jian
    Huang, Zhi
    Guangxue Xuebao/Acta Optica Sinica, 2013, 33 (06):
  • [40] Motion-stereo integration for depth estimation
    Strecha, C
    Van Gool, L
    COMPUTER VISION - ECCV 2002, PT II, 2002, 2351 : 170 - 185