Charting the Landscape of Multi-view Stereo: An In-Depth Exploration of Deep Learning Techniques

被引:0
|
作者
Zhou, Zhe [1 ,2 ]
Liu, Xiaozhang [1 ]
Tang, Xiangyan [1 ,2 ]
机构
[1] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Hainan, Peoples R China
[2] Hainan Blockchain Technol Engn Res Ctr, Haikou 570228, Hainan, Peoples R China
来源
基金
中国国家自然科学基金; 海南省自然科学基金;
关键词
Multi-view Stereo; Disparity Estimation; 3D Reconstruction; Deep Learning;
D O I
10.1007/978-981-97-4387-2_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Constructing a three-dimensional (3D) representation entails forming a 3D depiction of an object or scene using 2D images or a variety of data sources. It has gained substantial attention due to its versatile applications in virtual reality, augmented reality, medicine, cultural heritage preservation, intelligent transportation, and autonomous driving. Advancements in computational power, deep learning, and sensor technology have markedly improved the quality and efficiency of 3D reconstruction. Modern hardware and software tools have made it more practical. Nevertheless, the interpretability challenges have contributed to the ongoing evolution of deep learning approaches in 3D reconstruction. This paper provides an overview of the latest developments in a prominent 3D reconstruction method, Multi-View Stereo (MVS) deep learning. Notably, the application of 3D reconstruction in security-related scenarios is currently a hot topic. In intelligent transportation and autonomous driving, it enhances traffic safety and navigation accuracy by modeling road and traffic conditions. In medicine, it improves surgical safety through surgical navigation and virtual surgical simulation. In cultural heritage preservation, it aids in digital conservation and artifact security monitoring. The potential of 3D reconstruction in security applications is substantial, promising future research and innovation. In summary, 3D reconstruction holds promise in various application domains, including security. Ongoing advancements in deep learning and related technologies are expected to drive innovative applications in a broader range of security fields.
引用
收藏
页码:152 / 165
页数:14
相关论文
共 50 条
  • [11] Deep Multi-View Stereo Gone Wild
    Darmon, Francois
    Bascle, Benedicte
    Devaux, Jean-Clement
    Monasse, Pascal
    Aubry, Mathieu
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 484 - 493
  • [12] Adaptive depth estimation for pyramid multi-view stereo
    Liao, Jie
    Fu, Yanping
    Yan, Qingan
    Luo, Fei
    Xiao, Chunxia
    COMPUTERS & GRAPHICS-UK, 2021, 97 : 268 - 278
  • [13] MVSNet: Depth Inference for Unstructured Multi-view Stereo
    Yao, Yao
    Luo, Zixin
    Li, Shiwei
    Fang, Tian
    Quan, Long
    COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 785 - 801
  • [14] REVISED DEPTH MAP ESTIMATION FOR MULTI-VIEW STEREO
    Yao, Yao
    Zhu, Hao
    Nie, Yongming
    Ji, Xiaoli
    Cao, Xun
    2014 INTERNATIONAL CONFERENCE ON 3D IMAGING (IC3D), 2014,
  • [15] Multi-View Guided Multi-View Stereo
    Poggi, Matteo
    Conti, Andrea
    Mattoccia, Stefano
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 8391 - 8398
  • [16] MVS2: Deep Unsupervised Multi-view Stereo with Multi-View Symmetry
    Dai, Yuchao
    Zhu, Zhidong
    Rao, Zhibo
    Li, Bo
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 1 - 8
  • [17] Multi-View Stereo and Depth Priors Guided NeRF for View Synthesis
    Deng, Wang
    Zhang, Xuetao
    Guo, Yu
    Lu, Zheng
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3922 - 3928
  • [18] Sparse prior guided deep multi-view stereo
    Qi, Yuhang
    Su, Wanjuan
    Xu, Qingshan
    Tao, Wenbing
    COMPUTERS & GRAPHICS-UK, 2022, 107 : 1 - 9
  • [19] Semi-supervised Deep Multi-view Stereo
    Xu, Hongbin
    Chen, Weitao
    Liu, Yang
    Zhou, Zhipeng
    Xiao, Haihong
    Sun, Baigui
    Xie, Xuansong
    Kang, Wenxiong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4616 - 4625
  • [20] Rethinking Depth Estimation for Multi-View Stereo: A Unified Representation
    Peng, Rui
    Wang, Rongjie
    Wang, Zhenyu
    Lai, Yawen
    Wang, Ronggang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8635 - 8644