Charting the Landscape of Multi-view Stereo: An In-Depth Exploration of Deep Learning Techniques

被引:0
|
作者
Zhou, Zhe [1 ,2 ]
Liu, Xiaozhang [1 ]
Tang, Xiangyan [1 ,2 ]
机构
[1] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Hainan, Peoples R China
[2] Hainan Blockchain Technol Engn Res Ctr, Haikou 570228, Hainan, Peoples R China
来源
基金
中国国家自然科学基金; 海南省自然科学基金;
关键词
Multi-view Stereo; Disparity Estimation; 3D Reconstruction; Deep Learning;
D O I
10.1007/978-981-97-4387-2_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Constructing a three-dimensional (3D) representation entails forming a 3D depiction of an object or scene using 2D images or a variety of data sources. It has gained substantial attention due to its versatile applications in virtual reality, augmented reality, medicine, cultural heritage preservation, intelligent transportation, and autonomous driving. Advancements in computational power, deep learning, and sensor technology have markedly improved the quality and efficiency of 3D reconstruction. Modern hardware and software tools have made it more practical. Nevertheless, the interpretability challenges have contributed to the ongoing evolution of deep learning approaches in 3D reconstruction. This paper provides an overview of the latest developments in a prominent 3D reconstruction method, Multi-View Stereo (MVS) deep learning. Notably, the application of 3D reconstruction in security-related scenarios is currently a hot topic. In intelligent transportation and autonomous driving, it enhances traffic safety and navigation accuracy by modeling road and traffic conditions. In medicine, it improves surgical safety through surgical navigation and virtual surgical simulation. In cultural heritage preservation, it aids in digital conservation and artifact security monitoring. The potential of 3D reconstruction in security applications is substantial, promising future research and innovation. In summary, 3D reconstruction holds promise in various application domains, including security. Ongoing advancements in deep learning and related technologies are expected to drive innovative applications in a broader range of security fields.
引用
收藏
页码:152 / 165
页数:14
相关论文
共 50 条
  • [1] Learning Depth for Multi-View Stereo with Adversarial Training
    Wang, Liang
    Fan, Deqiao
    Li, Jianshu
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1674 - 1679
  • [2] Learning Descriptor, Confidence, and Depth Estimation in Multi-view Stereo
    Choi, Sungil
    Kim, Seungryong
    Park, Kihong
    Sohn, Kwanghoon
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 389 - 395
  • [3] Multi-view stereo algorithms based on deep learning: a survey
    Huang, Hongbo
    Yan, Xiaoxu
    Zheng, Yaolin
    He, Jiayu
    Xu, Longfei
    Qin, Dechun
    Multimedia Tools and Applications, 2025, 84 (06) : 2877 - 2908
  • [4] Multi-view stereo in the Deep Learning Era: A comprehensive revfiew
    Wang, Xiang
    Wang, Chen
    Liu, Bing
    Zhou, Xiaoqing
    Zhang, Liang
    Zheng, Jin
    Bai, Xiao
    DISPLAYS, 2021, 70
  • [5] Self-supervised Learning of Depth Inference for Multi-view Stereo
    Yang, Jiayu
    Alvarez, Jose M.
    Liu, Miaomiao
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7522 - 7530
  • [6] Continuous Depth Estimation for Multi-view Stereo
    Liu, Yebin
    Cao, Xun
    Dai, Qionghai
    Xu, Wenli
    CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 2121 - 2128
  • [7] Learning a Multi-View Stereo Machine
    Kar, Abhishek
    Hane, Christian
    Malik, Jitendra
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [8] Review of multi-view stereo reconstruction methods based on deep learning
    Yan H.
    Xu F.
    Huang L.
    Liu C.
    Lin C.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (16): : 2444 - 2464
  • [9] DDL-MVS: Depth Discontinuity Learning for Multi-View Stereo Networks
    Ibrahimli, Nail
    Ledoux, Hugo
    Kooij, Julian F. P.
    Nan, Liangliang
    REMOTE SENSING, 2023, 15 (12)
  • [10] Learning Inverse Depth Regression for Multi-View Stereo with Correlation Cost Volume
    Xu, Qingshan
    Tao, Wenbing
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12508 - 12515