Monocular Depth Distribution Alignment with Low Computation

被引:0
|
作者
Sheng, Fei [1 ]
Xue, Feng [1 ]
Chang, Yicong [1 ]
Liang, Wenteng [1 ]
Ming, Anlong [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
关键词
D O I
10.1109/ICRA46639.2022.9811937
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance of monocular depth estimation generally depends on the amount of parameters and computational cost. It leads to a large accuracy contrast between light-weight networks and heavy-weight networks, which limits their application in the real world. In this paper, we model the majority of accuracy contrast between them as the difference of depth distribution, which we call 'Distribution drift'. To this end, a distribution alignment network (DANet) is proposed. We firstly design a pyramid scene transformer (PST) module to capture inter-region interaction in multiple scales. By perceiving the difference of depth features between every two regions, DANet tends to predict a reasonable scene structure, which fits the shape of distribution to ground truth. Then, we propose a local-global optimization (LGO) scheme to realize the supervision of global range of scene depth. Thanks to the alignment of depth distribution shape and scene depth range, DANet sharply alleviates the distribution drift, and achieves a comparable performance with prior heavy-weight methods, but uses only 1% floating-point operations per second (FLOPs) of them. The experiments on two datasets, namely the widely used NYUDv2 dataset and the more challenging iBims-1 dataset, demonstrate the effectiveness of our method. The source code is available at https://github.com/YiLiM1/DANet.
引用
收藏
页码:6548 / 6555
页数:8
相关论文
共 50 条
  • [1] Monocular Depth Estimation on Adverse Weathers With Curriculum Domain Distribution Alignment
    Zhang, Jiehua
    Li, Liang
    Yan, Chenggang
    Ke, Wei
    Gong, Yihong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 178 - 194
  • [2] Monocular alignment in different depth planes
    Shimono, K
    Wade, NJ
    VISION RESEARCH, 2002, 42 (09) : 1127 - 1135
  • [3] Monocular alignment in different depth planes
    Shimono, K.
    PERCEPTION, 1999, 28 : 135 - 136
  • [4] Out-of-Distribution Detection for Monocular Depth Estimation
    Hornauer, Julia
    Holzbock, Adrian
    Belagiannis, Vasileios
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1911 - 1921
  • [5] Monocular Depth Estimation Method Based on Plane Coefficient Representation with Adaptive Depth Distribution
    Wang Jiajun
    Liu Yue
    Wu Yuhui
    Sha Hao
    Wang Yongtian
    ACTA OPTICA SINICA, 2023, 43 (14)
  • [6] MONOCULAR DEPTH PERCEPTION
    COLENBRANDER, MC
    OPHTHALMOLOGICA, 1949, 117 (06) : 358 - 360
  • [7] Subjective Refraction - Monocular Alignment
    von Livonius, Bettina
    AUGENHEILKUNDE UP2DATE, 2021, 11 (03) : 195 - 200
  • [8] Sparse depth densification for monocular depth estimation
    Zhen Liang
    Tiyu Fang
    Yanzhu Hu
    Yingjian Wang
    Multimedia Tools and Applications, 2024, 83 : 14821 - 14838
  • [9] Compiling Low Depth Circuits for Practical Secure Computation
    Buescher, Niklas
    Holzer, Andreas
    Weber, Alina
    Katzenbeisser, Stefan
    COMPUTER SECURITY - ESORICS 2016, PT II, 2016, 9879 : 80 - 98
  • [10] Inverse depth to depth conversion for monocular SLAM
    Civera, Javier
    Davison, Andrew J.
    Montiel, J. M. M.
    PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-10, 2007, : 2778 - +