NeRF FOR HERITAGE 3D RECONSTRUCTION

被引:20
|
作者
Mazzacca, G. [1 ,2 ]
Karami, A. [1 ]
Rigon, S. [1 ]
Farella, E. M. [1 ]
Trybala, P. [1 ]
Remondino, F. [1 ]
机构
[1] Bruno Kessler Fdn FBK, 3D Opt Metrol 3DOM Unit, Trento, Italy
[2] Univ Udine, Dept Math Comp Sci & Phys, Udine, Italy
关键词
Neural Radiance Field; Heritage; 3D; Photogrammetry; AI;
D O I
10.5194/isprs-archives-XLVIII-M-2-2023-1051-2023
中图分类号
K85 [文物考古];
学科分类号
0601 ;
摘要
Conventional or learning-based 3D reconstruction methods from images have clearly shown their potential for 3D heritage documentation. Nevertheless, Neural Radiance Field (NeRF) approaches are recently revolutionising the way a scene can be rendered or reconstructed in 3D from a set of oriented images. Therefore the paper wants to review some of the last NeRF methods applied to various cultural heritage datasets collected with smartphone videos, touristic approaches or reflex cameras. Firstly several NeRF methods are evaluated. It turned out that Instant-NGP and Nerfacto methods achieved the best outcomes, outperforming all other methods significantly. Successively qualitative and quantitative analyses are performed on various datasets, revealing the good performances of NeRF methods, in particular for areas with uniform texture or shining surfaces, as well as for small datasets of lost artefacts. This is for sure opening new frontiers for 3D documentation, visualization and communication purposes of digital heritage. [GRAPHICS] .
引用
收藏
页码:1051 / 1058
页数:8
相关论文
共 50 条
  • [1] INVESTIGATION ON THE USE OF NeRF FOR HERITAGE 3D DENSE RECONSTRUCTION FOR INTERIOR SPACES
    Murtiyoso, A.
    Markiewicz, J.
    Karwel, A. K.
    Kot, P.
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 115 - 121
  • [2] INITIAL ASSESSMENT ON THE USE OF STATE-OF-THE-ART NeRF NEURAL NETWORK 3D RECONSTRUCTION FOR HERITAGE DOCUMENTATION
    Murtiyoso, A.
    Grussenmeyer, P.
    29TH CIPA SYMPOSIUM DOCUMENTING, UNDERSTANDING, PRESERVING CULTURAL HERITAGE. HUMANITIES AND DIGITAL TECHNOLOGIES FOR SHAPING THE FUTURE, VOL. 48-M-2, 2023, : 1113 - 1118
  • [3] A Critical Analysis of NeRF-Based 3D Reconstruction
    Remondino, Fabio
    Karami, Ali
    Yan, Ziyang
    Mazzacca, Gabriele
    Rigon, Simone
    Qin, Rongjun
    REMOTE SENSING, 2023, 15 (14)
  • [4] 3D Reconstruction from 3D Cultural Heritage Models
    Callet, Patrick
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8355 : 135 - 142
  • [5] A monocular thoracoscopic 3D scene reconstruction framework based on NeRF
    Han, Juntao
    Zhang, Ziming
    Tan, Wenjun
    Wang, Yufei
    Li, Mingxiao
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2025,
  • [6] Evaluation of NeRF Techniques in 3D Reconstruction with Remote Sensing Imagery
    Ma, Jun
    Ji, Shunping
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 147 - 156
  • [7] SUP-NeRF: A Streamlined Unification of Pose Estimation and NeRF for Monocular 3D Object Reconstruction
    Guo, Yuliang
    Kumar, Abhinav
    Zhao, Cheng
    Wang, Ruoyu
    Huang, Xinyu
    Ren, Liu
    COMPUTER VISION - ECCV 2024, PT LXIX, 2025, 15127 : 37 - 53
  • [8] NERFBK: A HOLISTIC DATASET FOR BENCHMARKING NERF-BASED 3D RECONSTRUCTION
    Yan, Z.
    Mazzacca, G.
    Rigon, S.
    Farella, E. M.
    Trybala, P.
    Remondino, F.
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 219 - 226
  • [9] Comparative Evaluation of NeRF Algorithms on Single Image Dataset for 3D Reconstruction
    Condorelli, Francesca
    Perticarini, Maurizio
    MID-TERM SYMPOSIUM THE ROLE OF PHOTOGRAMMETRY FOR A SUSTAINABLE WORLD, VOL. 48-2, 2024, : 73 - 79
  • [10] A 3D reconstruction platform for complex plants using OB-NeRF
    Wu, Sixiao
    Hu, Changhao
    Tian, Boyuan
    Huang, Yuan
    Yang, Shuo
    Li, Shanjun
    Xu, Shengyong
    FRONTIERS IN PLANT SCIENCE, 2025, 16