SABV-Depth: A biologically inspired deep learning network for monocular depth estimation

被引:10
|
作者
Wang, Junfan [1 ,2 ]
Chen, Yi [1 ,2 ]
Dong, Zhekang [1 ,2 ,3 ]
Gao, Mingyu [1 ,2 ]
Lin, Huipin [1 ,2 ]
Miao, Qiheng [4 ]
机构
[1] Hangzhou Dianzi Univ, Sch Elect Informat, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Prov Key Lab Equipment Elect, Hangzhou 310018, Zhejiang, Peoples R China
[3] Zhejiang Univ, Dept Elect Engn, Hangzhou 310027, Zhejiang, Peoples R China
[4] Zhejiang Huaruijie Technol Co Ltd, Hangzhou 310051, Zhejiang, Peoples R China
关键词
Depth estimation; Biological vision; Mapping relationship; Self -attention mechanism; VISION; MODEL; CONSCIOUSNESS;
D O I
10.1016/j.knosys.2023.110301
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Monocular depth estimation makes it possible for machines to perceive the real world. The prediction performance of the depth estimation network based on deep learning will be affected due to the depth of the deep network and the locality of convolution operations. The imitation of the biological visual system and its functional structure is becoming a research hotspot. In this paper, we study the interpretability relationship between the biological visual system and the monocular depth estimation network. By concretizing the attention mechanism in biological vision, we propose a monocular depth estimation network based on the self-attention mechanism, named SABV-Depth, which can improve prediction accuracy. Inspired by the biological visual interaction mechanism, we focus on the information transfer between each module of the network and improve the information retention ability, and enable the network to output a depth map with rich object information and detailed information. Further, a decoder module with an inner-connection is proposed to recover depth maps with sharp edge contours. Our method is experimentally validated on the KITTI dataset and NYU Depth V2 dataset. The results show that compared with other works, the proposed method improves prediction accuracy. Meanwhile, the depth map has more object information and detail information, and a better edge information processing effect. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Multi-scale depth classification network for monocular depth estimation
    Yang, Yi
    Tian, Lihua
    Li, Chen
    Zhang, Botong
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
  • [22] Dynamic Guided Network for Monocular Depth Estimation
    Xing, Xiaoxia
    Cai, Yinghao
    Wang, Yanqing
    Lu, Tao
    Yang, Yiping
    Wen, Dayong
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5459 - 5465
  • [23] Bidirectional Attention Network for Monocular Depth Estimation
    Aich, Shubhra
    Vianney, Jean Marie Uwabeza
    Islam, Md Amirul
    Kaur, Mannat
    Liu, Bingbing
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11746 - 11752
  • [24] Monocular Depth Estimation Based on Unsupervised Learning
    Liu, Wan
    Sun, Yan
    Wang, XuCheng
    Yang, Lin
    Zheng, Zhenrong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [25] Depth estimation from single monocular images using deep hybrid network
    Aleksei Grigorev
    Feng Jiang
    Seungmin Rho
    Worku J. Sori
    Shaohui Liu
    Sergey Sai
    Multimedia Tools and Applications, 2017, 76 : 18585 - 18604
  • [26] Depth estimation from single monocular images using deep hybrid network
    Grigorev, Aleksei
    Jiang, Feng
    Rho, Seungmin
    Sori, Worku J.
    Liu, Shaohui
    Sai, Sergey
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (18) : 18585 - 18604
  • [27] D-Net: A Generalised and Optimised Deep Network for Monocular Depth Estimation
    Thompson, Joshua Luke
    Phung, Son Lam
    Bouzerdoum, Abdesselam
    IEEE ACCESS, 2021, 9 : 134543 - 134555
  • [28] Multi-scale Deep CNN Network for Unsupervised Monocular Depth Estimation
    Wan Yingcai
    Fang Lijing
    Zhao Qiankun
    2019 9TH IEEE ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER 2019), 2019, : 475 - 479
  • [29] Survey on Monocular Depth Estimation for Unmanned Aerial Vehicles using Deep Learning
    Florea, Horatiu
    Nedevschi, Sergiu
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, ICCP, 2022, : 319 - 326
  • [30] Deep Learning-Based Stereopsis and Monocular Depth Estimation Techniques: A Review
    Lahiri, Somnath
    Ren, Jing
    Lin, Xianke
    VEHICLES, 2024, 6 (01): : 305 - 351