Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

被引:1
|
作者
Liu, Zhuohao [1 ]
Xu, Zixuan [1 ]
Diao, Changyu [2 ,3 ]
Xing, Wei [1 ]
Lu, Dongming [1 ,3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Cultural Heritage Inst, Hangzhou 310027, Peoples R China
[3] Zhejiang Univ, State Admin Cultural Heritage, Key Sci Res Base Digital Conservat Cave Temples, Hangzhou, Peoples R China
关键词
Multi-view 3D reconstruction; Benchmark; Realistic synthetic dataset; Yungang Grotto;
D O I
10.1117/12.2557481
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Benchmarking multi-view 3D reconstruction using synthetic images is a supplement for the traditional ways. The ground-truth data of synthetic benchmarks can be easily recorded in simulation and have a high accuracy. However, synthetic images from artificial scenes are usually lack of geometry and texture details. We propose a framework to build realistic synthetic benchmarks for real-world scenes. Real photos are also taken around the scenes. The key step of our approach is to transfer the image properties of the real photos to corresponding synthetic images, followed by a validation step to verify their similarity. Based on the proposed framework, we construct the Yungang Grotto dataset for large-scale multi-view 3D reconstruction, in which the largest scene is up to four thousand images, and the benchmarking results of a prevalent reconstruction pipeline on our dataset are also presented.
引用
收藏
页数:7
相关论文
共 50 条
  • [11] Fast and Accurate 3D Reconstruction of Plants Using MVSNet and Multi-View Images
    Chen, Zhen
    Lv, Hui
    Lou, Lu
    Doonan, John H.
    ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, 2022, 1409 : 390 - 399
  • [12] 3D ear reconstruction attempts: Using multi-view
    Liu, Heng
    Yan, Jingqi
    Zhang, David
    INTELLIGENT COMPUTING IN SIGNAL PROCESSING AND PATTERN RECOGNITION, 2006, 345 : 578 - 583
  • [13] 3D Reconstruction for Multi-view Objects
    Yu, Jun
    Yin, Wenbin
    Hu, Zhiyi
    Liu, Yabin
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 106
  • [14] Multi-view 3D Reconstruction with Transformers
    Wang, Dan
    Cui, Xinrui
    Chen, Xun
    Zou, Zhengxia
    Shi, Tianyang
    Salcudean, Septimiu
    Wang, Z. Jane
    Ward, Rabab
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5702 - 5711
  • [15] Approach to 3D reconstruction of calcareous sand using 2D images of multi-view
    Hu Cong
    Long Zhi-lin
    Kuang Du-min
    Gong Zhao-mao
    Yu Piao-yi
    Xu Guo-bin
    ROCK AND SOIL MECHANICS, 2022, 43 (03) : 761 - 768
  • [16] NeuFace: Realistic 3D Neural Face Rendering from Multi-view Images
    Zheng, Mingwu
    Zhang, Haiyu
    Yang, Hongyu
    Huang, Di
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16868 - 16877
  • [17] Multi-view scans alignment for 3D spherical mosaicing in large-scale unstructured environments
    Craciun, Daniela
    Paparoditis, Nicolas
    Schmitt, Francis
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2010, 114 (11) : 1248 - 1263
  • [18] 3D Reconstruction of Line Features Using Multi-view Acoustic Images in Underwater Environment
    Ngoc Trung Mai
    Woo, Hanwool
    Ji, Yonghoon
    Tamura, Yusuke
    Yamashita, Atsushi
    Asama, Hajime
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2017, : 312 - 317
  • [19] Cortical Volumetry using 3D Reconstruction of Metacarpal Bone from Multi-view Images
    Jayakar, Avinash D.
    Sambath, Gautham
    Areeckal, Anu Shaju
    David, Sumam S.
    2018 IEEE RECENT ADVANCES IN INTELLIGENT COMPUTATIONAL SYSTEMS (RAICS), 2018, : 79 - 83
  • [20] Multi-View Images 3D Reconstruction based on Spatial Geometric Constraint
    Liu, Haibo
    PROCEEDINGS OF THE 2016 2ND WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS, 2016, 81 : 1217 - 1220