Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

被引:1
|
作者
Liu, Zhuohao [1 ]
Xu, Zixuan [1 ]
Diao, Changyu [2 ,3 ]
Xing, Wei [1 ]
Lu, Dongming [1 ,3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Cultural Heritage Inst, Hangzhou 310027, Peoples R China
[3] Zhejiang Univ, State Admin Cultural Heritage, Key Sci Res Base Digital Conservat Cave Temples, Hangzhou, Peoples R China
关键词
Multi-view 3D reconstruction; Benchmark; Realistic synthetic dataset; Yungang Grotto;
D O I
10.1117/12.2557481
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Benchmarking multi-view 3D reconstruction using synthetic images is a supplement for the traditional ways. The ground-truth data of synthetic benchmarks can be easily recorded in simulation and have a high accuracy. However, synthetic images from artificial scenes are usually lack of geometry and texture details. We propose a framework to build realistic synthetic benchmarks for real-world scenes. Real photos are also taken around the scenes. The key step of our approach is to transfer the image properties of the real photos to corresponding synthetic images, followed by a validation step to verify their similarity. Based on the proposed framework, we construct the Yungang Grotto dataset for large-scale multi-view 3D reconstruction, in which the largest scene is up to four thousand images, and the benchmarking results of a prevalent reconstruction pipeline on our dataset are also presented.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Multi-View 3D Face Reconstruction in the Wild Using Siamese Networks
    Ramon, Eduard
    Escur, Janna
    Giro-i-Nieto, Xavier
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3096 - 3100
  • [42] Multi-view 3D reconstruction and modeling of the unknown 3D scenes using genetic algorithms
    Mostafa Merras
    Abderrahim Saaidi
    Nabil El Akkad
    Khalid Satori
    Soft Computing, 2018, 22 : 6271 - 6289
  • [43] MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation
    Chen, Liangjian
    Lin, Shih-Yao
    Xie, Yusheng
    Lin, Yen-Yu
    Xie, Xiaohui
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 836 - 845
  • [44] A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images
    Ito, Shuya
    Ito, Koichi
    Aoki, Takafumi
    Tsuchida, Masaru
    COMPUTER VISION - ACCV 2016 WORKSHOPS, PT II, 2017, 10117 : 236 - 247
  • [45] Multi-view 3D reconstruction and modeling of the unknown 3D scenes using genetic algorithms
    Merras, Mostafa
    Saaidi, Abderrahim
    El Akkad, Nabil
    Satori, Khalid
    SOFT COMPUTING, 2018, 22 (19) : 6271 - 6289
  • [46] 3D wireframe model reconstruction of buildings from multi-view images using neural implicit fields
    Fan, Weiwei
    Liu, Xinyi
    Zhang, Yongjun
    Wei, Dong
    Guo, Haoyu
    Yue, Dongdong
    AUTOMATION IN CONSTRUCTION, 2025, 174
  • [47] 3D Image reconstruction using C-dual attention network from multi-view images
    Kamble, Tanaji Umaji
    Mahajan, Shrinivas Padmakar
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (02)
  • [48] 3D Reconstruction of Under Water Coral Reef Images Using Low Cost Multi-View Cameras
    Andono, Pulung Nurtantio
    Yuniarno, Eko Mulyanto
    Hariadj, Mochamad
    Venus, Valentijn
    2012 INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS (ICMCS), 2012, : 803 - 808
  • [49] Registration of multi-view apical 3D echocardiography images
    Mulder, H. W.
    van Stralen, M.
    van der Zwaan, H. B.
    Leung, K. Y. E.
    Bosch, J. G.
    Pluim, J. P. W.
    MEDICAL IMAGING 2011: IMAGE PROCESSING, 2011, 7962
  • [50] Overview of 3D Reconstruction Methods Based on Multi-view
    Li, Mengxin
    Zheng, Dai
    Zhang, Rui
    Yin, Jiadi
    Tian, Xiangqian
    2015 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS IHMSC 2015, VOL II, 2015,