Charting the Landscape of Multi-view Stereo: An In-Depth Exploration of Deep Learning Techniques

被引:0
|
作者
Zhou, Zhe [1 ,2 ]
Liu, Xiaozhang [1 ]
Tang, Xiangyan [1 ,2 ]
机构
[1] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Hainan, Peoples R China
[2] Hainan Blockchain Technol Engn Res Ctr, Haikou 570228, Hainan, Peoples R China
来源
基金
中国国家自然科学基金; 海南省自然科学基金;
关键词
Multi-view Stereo; Disparity Estimation; 3D Reconstruction; Deep Learning;
D O I
10.1007/978-981-97-4387-2_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Constructing a three-dimensional (3D) representation entails forming a 3D depiction of an object or scene using 2D images or a variety of data sources. It has gained substantial attention due to its versatile applications in virtual reality, augmented reality, medicine, cultural heritage preservation, intelligent transportation, and autonomous driving. Advancements in computational power, deep learning, and sensor technology have markedly improved the quality and efficiency of 3D reconstruction. Modern hardware and software tools have made it more practical. Nevertheless, the interpretability challenges have contributed to the ongoing evolution of deep learning approaches in 3D reconstruction. This paper provides an overview of the latest developments in a prominent 3D reconstruction method, Multi-View Stereo (MVS) deep learning. Notably, the application of 3D reconstruction in security-related scenarios is currently a hot topic. In intelligent transportation and autonomous driving, it enhances traffic safety and navigation accuracy by modeling road and traffic conditions. In medicine, it improves surgical safety through surgical navigation and virtual surgical simulation. In cultural heritage preservation, it aids in digital conservation and artifact security monitoring. The potential of 3D reconstruction in security applications is substantial, promising future research and innovation. In summary, 3D reconstruction holds promise in various application domains, including security. Ongoing advancements in deep learning and related technologies are expected to drive innovative applications in a broader range of security fields.
引用
收藏
页码:152 / 165
页数:14
相关论文
共 50 条
  • [21] Uncertainty Guided Multi-View Stereo Network for Depth Estimation
    Su, Wanjuan
    Xu, Qingshan
    Tao, Wenbing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7796 - 7808
  • [22] FADE: Feature Aggregation for Depth Estimation With Multi-View Stereo
    Yang, Hsiao-Chien
    Chen, Po-Heng
    Chen, Kuan-Wen
    Lee, Chen-Yi
    Chen, Yong-Sheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6590 - 6600
  • [23] Bundled Depth-Map Merging for Multi-View Stereo
    Li, Jianguo
    Li, Eric
    Chen, Yurong
    Xu, Lin
    Zhang, Yimin
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 2769 - 2776
  • [24] Recurrent Multi-view Stereo Depth Inference with Pyramid of Images
    Wang, Xiaobao
    Dong, Enzeng
    Tong, Jigang
    Sun, Zhe
    Li, Wenyu
    Duan, Feng
    PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 259 - 263
  • [25] Depth Estimation in Multi-View Stereo Based on Image Pyramid
    Xu, Hanfei
    Cai, Yangang
    Wang, Ronggang
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 345 - 349
  • [26] Multi-View Stereo via Geometric Expansion and Depth Refinement
    Liu, Tao
    Yuan, Ding
    Zhao, Hongwei
    Yin, Jihao
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 555 - 560
  • [27] Unbalanced Multi-view Deep Learning
    Xu, Cai
    Li, Zehui
    Guan, Ziyu
    Zhao, Wei
    Song, Xiangyu
    Wu, Yue
    Li, Jianxin
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3051 - 3059
  • [28] Deep Multi-View Concept Learning
    Xu, Cai
    Guan, Ziyu
    Zhao, Wei
    Niu, Yunfei
    Wang, Quan
    Wang, Zhiheng
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2898 - 2904
  • [29] Deep Multi-View Learning to Rank
    Cao, Guanqun
    Iosifidis, Alexandros
    Gabbouj, Moncef
    Raghavan, Vijay
    Gottumukkala, Raju
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (04) : 1426 - 1438
  • [30] On Deep Multi-View Representation Learning
    Wang, Weiran
    Arora, Raman
    Livescu, Karen
    Bilmes, Jeff
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 1083 - 1092