Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

被引:71
|
作者
Yang, Lihe [1 ]
Kang, Bingyi [2 ]
Huang, Zilong [2 ]
Xu, Xiaogang [3 ,4 ]
Feng, Jiashi [2 ]
Zhao, Hengshuang [1 ]
机构
[1] HKU, Hong Kong, Peoples R China
[2] Tiktok, Beijing 9, Peoples R China
[3] CUHK, Hong Kong, Peoples R China
[4] ZJU, Hangzhou, Peoples R China
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2024年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52733.2024.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents Depth Anything(1), a highly practical solution for robust monocular depth estimation. Without pursuing novel technical modules, we aim to build a simple yet powerful foundation model dealing with any images under any circumstances. To this end, we scale up the dataset by designing a data engine to collect and automatically annotate large-scale unlabeled data (similar to 62M), which significantly enlarges the data coverage and thus is able to reduce the generalization error. We investigate two simple yet effective strategies that make data scaling-up promising. First, a more challenging optimization target is created by leveraging data augmentation tools. It compels the model to actively seek extra visual knowledge and acquire robust representations. Second, an auxiliary supervision is developed to enforce the model to inherit rich semantic priors from pre-trained encoders. We evaluate its zero-shot capabilities extensively, including six public datasets and randomly captured photos. It demonstrates impressive generalization ability (Figure 1). Further, through fine-tuning it with metric depth information from NYUv2 and KITTI, new SOTAs are set. Our better depth model also results in a better depth-conditioned ControlNet. Our models are released here.
引用
收藏
页码:10371 / 10381
页数:11
相关论文
共 50 条
  • [31] Large-Scale Web Data Analysis
    Leskovec, Jure
    IEEE INTELLIGENT SYSTEMS, 2011, 26 (01) : 11 - 11
  • [32] Large-Scale Pooled Data and Beyond
    Metoki, Hirohito
    JOURNAL OF ATHEROSCLEROSIS AND THROMBOSIS, 2016, 23 (06) : 671 - 672
  • [33] DATA ENTRY FOR LARGE-SCALE ACCOUNTING
    VOSE, M
    DATA PROCESSING, 1972, 14 (02): : 112 - &
  • [34] New power conditioner for large-scale power systems
    Takano, Tomohiro, 1600, Sumitomo Electric Industries Ltd.
  • [35] Large-scale wind power farms as power plants
    Gjengedal, T
    WIND ENERGY, 2005, 8 (03) : 361 - 373
  • [36] Pelican: Power Scheduling for QoS in Large-scale Data Centers with Heterogeneous Workloads
    Luo, Bing
    Chen, Wei
    Liu, Xingxing
    Li, Xiaozhong
    Zhang, Lifei
    Shi, Weisong
    2019 TENTH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2019,
  • [37] Analysis of Smart Meter Data and Impacts on Large-scale Power Distribution Networks
    Bajagain, Surendra
    Dubey, Anamika
    2023 IEEE BELGRADE POWERTECH, 2023,
  • [38] Visualization of Large-Scale Power Plant Control Data Based on Condition Division
    Ji L.
    Chen Z.
    Huang K.
    Zhao N.
    Kong Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (02): : 229 - 240
  • [39] Assessing Large-Scale Power Relations among Locations from Mobility Data
    De Oliveira, Lucas Santos
    Vaz-de-Melo, Pedro O. S.
    Viana, Aline Carneiro
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2022, 16 (02)
  • [40] Scalable and Data Privacy Conserving Controller Tuning for Large-Scale Power Networks
    Mesanovic, Amer
    Munz, Ulrich
    Findeisen, Rolf
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (02) : 696 - 711