SABV-Depth: A biologically inspired deep learning network for monocular depth estimation

被引:10
|
作者
Wang, Junfan [1 ,2 ]
Chen, Yi [1 ,2 ]
Dong, Zhekang [1 ,2 ,3 ]
Gao, Mingyu [1 ,2 ]
Lin, Huipin [1 ,2 ]
Miao, Qiheng [4 ]
机构
[1] Hangzhou Dianzi Univ, Sch Elect Informat, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Prov Key Lab Equipment Elect, Hangzhou 310018, Zhejiang, Peoples R China
[3] Zhejiang Univ, Dept Elect Engn, Hangzhou 310027, Zhejiang, Peoples R China
[4] Zhejiang Huaruijie Technol Co Ltd, Hangzhou 310051, Zhejiang, Peoples R China
关键词
Depth estimation; Biological vision; Mapping relationship; Self -attention mechanism; VISION; MODEL; CONSCIOUSNESS;
D O I
10.1016/j.knosys.2023.110301
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Monocular depth estimation makes it possible for machines to perceive the real world. The prediction performance of the depth estimation network based on deep learning will be affected due to the depth of the deep network and the locality of convolution operations. The imitation of the biological visual system and its functional structure is becoming a research hotspot. In this paper, we study the interpretability relationship between the biological visual system and the monocular depth estimation network. By concretizing the attention mechanism in biological vision, we propose a monocular depth estimation network based on the self-attention mechanism, named SABV-Depth, which can improve prediction accuracy. Inspired by the biological visual interaction mechanism, we focus on the information transfer between each module of the network and improve the information retention ability, and enable the network to output a depth map with rich object information and detailed information. Further, a decoder module with an inner-connection is proposed to recover depth maps with sharp edge contours. Our method is experimentally validated on the KITTI dataset and NYU Depth V2 dataset. The results show that compared with other works, the proposed method improves prediction accuracy. Meanwhile, the depth map has more object information and detail information, and a better edge information processing effect. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND
引用
收藏
页数:14
相关论文
共 50 条
  • [11] A Deep Joint Network for Monocular Depth Estimation Based on Pseudo-Depth Supervision
    Tan, Jiahai
    Gao, Ming
    Duan, Tao
    Gao, Xiaomei
    MATHEMATICS, 2023, 11 (22)
  • [12] Monocular Depth Estimation of Noncooperative Spacecraft Based on Deep Learning
    Zhao, Erxun
    Zhang, Yang
    Gao, Jingmin
    JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2023, 20 (06): : 334 - 342
  • [13] Progress in Deep Learning Based Monocular Image Depth Estimation
    Li Yang
    Chen Xiuwan
    Wang Yuan
    Liu Maolin
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (19)
  • [14] A Biologically Inspired Approach for Robot Depth Estimation
    Martinez-Martin, Ester
    del Pobil, Angel P.
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
  • [15] DTTNet: Depth Transverse Transformer Network for Monocular Depth Estimation
    Kamath, Shreyas K. M.
    Rajeev, Srijith
    Panetta, Karen
    Agaian, Sos S.
    MULTIMODAL IMAGE EXPLOITATION AND LEARNING 2022, 2022, 12100
  • [16] A geometry-aware deep network for depth estimation in monocular endoscopy
    Yang, Yongming
    Shao, Shuwei
    Yang, Tao
    Wang, Peng
    Yang, Zhuo
    Wu, Chengdong
    Liu, Hao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 122
  • [17] BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth Estimation
    Tang, Qi
    Cong, Runmin
    Sheng, Ronghui
    He, Lingzhi
    Zhang, Dan
    Zhao, Yao
    Kwong, Sam
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2148 - 2157
  • [18] Transfer2Depth: Dual Attention Network With Transfer Learning for Monocular Depth Estimation
    Yeh, Chia-Hung
    Huang, Yao-Pao
    Lin, Chih-Yang
    Chang, Chuan-Yu
    IEEE ACCESS, 2020, 8 : 86081 - 86090
  • [19] On deep learning techniques to boost monocular depth estimation for autonomous navigation
    Mendes, Raul de Queiroz
    Ribeiro, Eduardo Godinho
    Rosa, Nicolas dos Santos
    Grassi, Valdir, Jr.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 136
  • [20] Monocular depth estimation network with single-pixel depth guidance
    Lee, Hongjae
    Park, Jinbum
    Jeong, Wooseok
    Jung, Seung-won
    OPTICS LETTERS, 2023, 48 (03) : 594 - 597