Saliency Driven Monocular Depth Estimation Based on Multi-scale Graph Convolutional Network

被引:0
|
作者
Wu, Dunquan [1 ]
Chen, Chenglizhao [1 ,2 ,3 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao, Peoples R China
[2] Shandong Prov Key Lab Distributed Comp Software N, Jinan, Peoples R China
[3] China Univ Petr East China, Coll Comp Sci & Technol, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
Monocular Depth Estimation; Multi-scale Graph Convolutional Network; Saliency Detection;
D O I
10.1007/978-981-99-8546-3_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Monocular depth estimation is a fundamental and crucial task in computer vision that enables scene understanding from a single image. This paper proposes a novel approach for saliency-driven monocular depth estimation based on a multi-scale Graph Convolutional Network (GCN). Our method utilizes saliency information to guide the depth estimation process and employs a multi-scale GCN to capture local and global contextual cues. The proposed framework constructs a graph structure using RGB images to represent the relationships between image regions. We designed a multi-scale feature fusion module called DS Fusion, by applying GCN at multiple scales, our method effectively integrates depth features and saliency features to predict accurate depth maps. Extensive experiments conducted on KITTI and NYU datasets demonstrate the superior performance of our approach compared to state-of-the-art techniques. Additionally, we perform indepth analysis of the network architecture and discuss the impact of saliency cues on depth estimation accuracy. Our proposed method showcases the potential of combining saliency information and GCN in monocular depth estimation, contributing to the progress of scene understanding and depth perception from a single image.
引用
收藏
页码:445 / 456
页数:12
相关论文
共 50 条
  • [21] Multi-Scale Graph Convolutional Network With Spectral Graph Wavelet Frame
    Shen, Yangmei
    Dai, Wenrui
    Li, Chenglin
    Zou, Junni
    Xiong, Hongkai
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2021, 7 : 595 - 610
  • [22] Swin-Depth: Using Transformers and Multi-Scale Fusion for Monocular-Based Depth Estimation
    Cheng, Zeyu
    Zhang, Yi
    Tang, Chengkai
    IEEE SENSORS JOURNAL, 2021, 21 (23) : 26912 - 26920
  • [23] Monocular endoscopy images depth estimation with multi-scale residual fusion
    Liu, Shiyuan
    Fan, Jingfan
    Yang, Yun
    Xiao, Deqiang
    Ai, Danni
    Song, Hong
    Wang, Yongtian
    Yang, Jian
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 169
  • [24] Head Pose Estimation Based on Multi-Scale Convolutional Neural Network
    Liang Lingyu
    Zhang Tiantian
    He Wei
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (13)
  • [25] Spatiotemporal Graph Convolutional Network for Multi-Scale Traffic Forecasting
    Wang, Yi
    Jing, Changfeng
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (02)
  • [26] Graph convolutional neural network for multi-scale feature learning
    Edwards, Michael
    Xie, Xianghua
    Palmer, Robert, I
    Tam, Gary K. L.
    Alcock, Rob
    Roobottom, Carl
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 194
  • [27] Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding
    Zhang, Zhaoli
    Li, Zhifei
    Liu, Hai
    Xiong, Neal N.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) : 2335 - 2347
  • [28] HIGH QUALITY MONOCULAR DEPTH ESTIMATION VIA A MULTI-SCALE NETWORK AND A DETAIL-PRESERVING OBJECTIVE
    Jiang, Hualie
    Huang, Rui
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1920 - 1924
  • [29] Deep Multi-scale Convolutional Neural Network Method for Depth Estimation from a Single Image
    Ma, Zhaowei
    Niu, Yifeng
    Hu, Jia
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 3984 - 3988
  • [30] Multi-label image recognition based on adaptive multi-scale graph convolutional network
    Wang X.-S.
    Rong X.-L.
    Cheng Y.-H.
    Chen Z.-S.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (07): : 1737 - 1744