Comparative Evaluation of NeRF Algorithms on Single Image Dataset for 3D Reconstruction

被引:0
|
作者
Condorelli, Francesca [1 ]
Perticarini, Maurizio [2 ]
机构
[1] Free Univ Bozen, Bolzano, Italy
[2] Univ Padua, Padua, Italy
来源
MID-TERM SYMPOSIUM THE ROLE OF PHOTOGRAMMETRY FOR A SUSTAINABLE WORLD, VOL. 48-2 | 2024年
关键词
NeRF; 3D Reconstruction; Single-Images; Cultural Heritage; Videogames Environment;
D O I
10.5194/isprs-archives-XLVIII-2-2024-73-2024
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The reconstruction of three-dimensional scenes from a single image represents a significant challenge in computer vision, particularly in the context of cultural heritage digitisation, where datasets may be limited or of poor quality. This paper addresses this challenge by conducting a study of the latest and most advanced algorithms for single-image 3D reconstruction, with a focus on applications in cultural heritage conservation. Exploiting different single-image datasets, the research evaluates the strengths and limitations of various artificial intelligence-based algorithms, in particular Neural Radiance Fields (NeRF), in reconstructing detailed 3D models from limited visual data. The study includes experiments on scenarios such as inaccessible or non-existent heritage sites, where traditional photogrammetric methods fail. The results demonstrate the effectiveness of NeRF-based approaches in producing accurate, high-resolution reconstructions suitable for visualisation and metric analysis. The results contribute to advancing the understanding of NeRFbased approaches in handling single-image inputs and offer insights for real-world applications such as object location and immersive content generation.
引用
收藏
页码:73 / 79
页数:7
相关论文
共 50 条
  • [1] NERFBK: A HOLISTIC DATASET FOR BENCHMARKING NERF-BASED 3D RECONSTRUCTION
    Yan, Z.
    Mazzacca, G.
    Rigon, S.
    Farella, E. M.
    Trybala, P.
    Remondino, F.
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 219 - 226
  • [2] EndoAbS dataset: Endoscopic abdominal stereo image dataset for benchmarking 3D stereo reconstruction algorithms
    Penza, Veronica
    Ciullo, Andrea S.
    Moccia, Sara
    Mattos, Leonardo S.
    De Momi, Elena
    INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2018, 14 (05):
  • [3] NeRF FOR HERITAGE 3D RECONSTRUCTION
    Mazzacca, G.
    Karami, A.
    Rigon, S.
    Farella, E. M.
    Trybala, P.
    Remondino, F.
    29TH CIPA SYMPOSIUM DOCUMENTING, UNDERSTANDING, PRESERVING CULTURAL HERITAGE. HUMANITIES AND DIGITAL TECHNOLOGIES FOR SHAPING THE FUTURE, VOL. 48-M-2, 2023, : 1051 - 1058
  • [4] Evaluation of NeRF Techniques in 3D Reconstruction with Remote Sensing Imagery
    Ma, Jun
    Ji, Shunping
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 147 - 156
  • [5] Unmanned aerial image dataset: Ready for 3D reconstruction
    Shahbazi, Mozhdeh
    Menard, Patrick
    Sohn, Gunho
    Theau, Jerome
    DATA IN BRIEF, 2019, 25
  • [6] 3D Reconstruction from A Single Image
    Ping, Guiju
    Wang, Han
    PROCEEDINGS OF THE IEEE 2019 9TH INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) ROBOTICS, AUTOMATION AND MECHATRONICS (RAM) (CIS & RAM 2019), 2019, : 47 - 52
  • [7] A QUANTITATIVE EVALUATION FOR 3D FACE RECONSTRUCTION ALGORITHMS
    Le, Vuong
    Hu, Yuxiao
    Huang, Thomas S.
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1269 - 1272
  • [8] Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
    Chen, Hansheng
    Gu, Jiatao
    Chen, Anpei
    Tian, Wei
    Tu, Zhuowen
    Liu, Lingjie
    Su, Hao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 2416 - 2425
  • [9] Comparative analysis of tissue reconstruction algorithms for 3D histology
    Kartasalo, Kimmo
    Latonen, Leena
    Vihinen, Jorma
    Visakorpi, Tapio
    Nykter, Matti
    Ruusuvuori, Pekka
    BIOINFORMATICS, 2018, 34 (17) : 3013 - 3021
  • [10] Research on 3D Reconstruction Based on a Single Image
    Yu Yong-yan
    Wang Zhi-jian
    PROGRESS IN MEASUREMENT AND TESTING, PTS 1 AND 2, 2010, 108-111 : 3 - 10