Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

被引:71
|
作者
Yang, Lihe [1 ]
Kang, Bingyi [2 ]
Huang, Zilong [2 ]
Xu, Xiaogang [3 ,4 ]
Feng, Jiashi [2 ]
Zhao, Hengshuang [1 ]
机构
[1] HKU, Hong Kong, Peoples R China
[2] Tiktok, Beijing 9, Peoples R China
[3] CUHK, Hong Kong, Peoples R China
[4] ZJU, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52733.2024.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents Depth Anything(1), a highly practical solution for robust monocular depth estimation. Without pursuing novel technical modules, we aim to build a simple yet powerful foundation model dealing with any images under any circumstances. To this end, we scale up the dataset by designing a data engine to collect and automatically annotate large-scale unlabeled data (similar to 62M), which significantly enlarges the data coverage and thus is able to reduce the generalization error. We investigate two simple yet effective strategies that make data scaling-up promising. First, a more challenging optimization target is created by leveraging data augmentation tools. It compels the model to actively seek extra visual knowledge and acquire robust representations. Second, an auxiliary supervision is developed to enforce the model to inherit rich semantic priors from pre-trained encoders. We evaluate its zero-shot capabilities extensively, including six public datasets and randomly captured photos. It demonstrates impressive generalization ability (Figure 1). Further, through fine-tuning it with metric depth information from NYUv2 and KITTI, new SOTAs are set. Our better depth model also results in a better depth-conditioned ControlNet. Our models are released here.
引用
收藏
页码:10371 / 10381
页数:11
相关论文
共 50 条
  • [1] Improving shift-reduce constituency parsing with large-scale unlabeled data
    Zhu, Muhua
    Zhu, Jingbo
    Wang, Huizhen
    NATURAL LANGUAGE ENGINEERING, 2015, 21 (01) : 113 - 138
  • [2] FGSS: Federated global self-supervised framework for large-scale unlabeled data
    Zhang, Chen
    Xie, Zixuan
    Yu, Bin
    Wen, Chao
    Xie, Yu
    APPLIED SOFT COMPUTING, 2023, 143
  • [3] Large-Scale Data Challenges in Future Power Grids
    Yin, Jian
    Sharma, Poorva
    Gorton, Ian
    Akyol, Bora
    2013 IEEE SEVENTH INTERNATIONAL SYMPOSIUM ON SERVICE-ORIENTED SYSTEM ENGINEERING (SOSE 2013), 2013, : 324 - 328
  • [4] Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieval
    Liang, Yu
    Zhang, Shiliang
    Li, Kenli
    Wang, Xiaoyu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Large-Scale Object Mining for Object Discovery from Unlabeled Video
    Osep, Aljosa
    Voigtlaender, Paul
    Luiten, Jonathon
    Breuers, Stefan
    Leibe, Bastian
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5502 - 5508
  • [6] Large-scale Monocular Depth Estimation in the Wild
    Haji-Esmaeili, Mohammad M.
    Montazer, Gholamali
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [7] Large-scale data visualization
    Ma, KL
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2001, 21 (04) : 22 - 23
  • [8] Increasing Large-Scale Data Center Capacity by Statistical Power Control
    Wang, Guosai
    Wang, Shuhao
    Luo, Bing
    Shi, Weisong
    Zhu, Yinghang
    Yang, Wenjun
    Hu, Dianming
    Huang, Longbo
    Jin, Xin
    Xu, Wei
    PROCEEDINGS OF THE ELEVENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, (EUROSYS 2016), 2016,
  • [9] Bayesian power-spectrum inference for large-scale structure data
    Jasche, Jens
    Kitaura, Francisco S.
    Wandelt, Benjamin D.
    Ensslin, Torsten A.
    MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2010, 406 (01) : 60 - 85
  • [10] Analysis of data collection efficiency in large-scale power line network
    1600, CESER Publications, Post Box No. 113, Roorkee, 247667, India (49):