Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

被引:1
|
作者
Liu, Zhuohao [1 ]
Xu, Zixuan [1 ]
Diao, Changyu [2 ,3 ]
Xing, Wei [1 ]
Lu, Dongming [1 ,3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Cultural Heritage Inst, Hangzhou 310027, Peoples R China
[3] Zhejiang Univ, State Admin Cultural Heritage, Key Sci Res Base Digital Conservat Cave Temples, Hangzhou, Peoples R China
关键词
Multi-view 3D reconstruction; Benchmark; Realistic synthetic dataset; Yungang Grotto;
D O I
10.1117/12.2557481
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Benchmarking multi-view 3D reconstruction using synthetic images is a supplement for the traditional ways. The ground-truth data of synthetic benchmarks can be easily recorded in simulation and have a high accuracy. However, synthetic images from artificial scenes are usually lack of geometry and texture details. We propose a framework to build realistic synthetic benchmarks for real-world scenes. Real photos are also taken around the scenes. The key step of our approach is to transfer the image properties of the real photos to corresponding synthetic images, followed by a validation step to verify their similarity. Based on the proposed framework, we construct the Yungang Grotto dataset for large-scale multi-view 3D reconstruction, in which the largest scene is up to four thousand images, and the benchmarking results of a prevalent reconstruction pipeline on our dataset are also presented.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Multi-sensor large-scale dataset for multi-view 3D reconstruction
    Voynov, Oleg
    Bobrovskikh, Gleb
    Karpyshev, Pavel
    Galochkin, Saveliy
    Ardelean, Andrei-Timotei
    Bozhenko, Arseniy
    Karmanova, Ekaterina
    Kopanev, Pavel
    Labutin-Rymsho, Yaroslav
    Rakhimov, Ruslan
    Safin, Aleksandr
    Serpiva, Valerii
    Artemov, Alexey
    Burnaev, Evgeny
    Tsetserukou, Dzmitry
    Zorin, Denis
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21392 - 21403
  • [2] Distributed Refinement of Large-Scale 3D Mesh for Accurate Multi-View Reconstruction
    Luo, Qing
    Li, Yao
    Qi, Yue
    2018 8TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV), 2018, : 58 - 61
  • [3] Large-Scale 3D Reconstruction from Multi-View Imagery: A Comprehensive Review
    Luo, Haitao
    Zhang, Jinming
    Liu, Xiongfei
    Zhang, Lili
    Liu, Junyi
    REMOTE SENSING, 2024, 16 (05)
  • [4] Distrubted Generation of Large-scale 3D Dense Point Cloud for Accurate Multi-View Reconstruction
    Wang, Xijing
    Li, Yao
    Wang, Chen
    Qi, Yue
    2019 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV), 2019, : 82 - 86
  • [5] Photo-realistic 3D head modeling using multi-view images
    Lee, TY
    Lin, PH
    Yang, TH
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2004, PT 2, 2004, 3044 : 713 - 720
  • [6] RoScenes: A Large-Scale Multi-view 3D Dataset for Roadside Perception
    Zhu, Xiaosu
    Sheng, Hualian
    Cai, Sijia
    Deng, Bing
    Yang, Shaopeng
    Liang, Qiao
    Chen, Ken
    Gao, Lianli
    Song, Jingkuan
    Ye, Jieping
    COMPUTER VISION - ECCV 2024, PT XLI, 2025, 15099 : 331 - 347
  • [7] MVImgNet: A Large-scale Dataset of Multi-view Images
    Yu, Xianggang
    Xu, Mutian
    Zhang, Yidan
    Liu, Haolin
    Ye, Chongjie
    Wu, Yushuang
    Yan, Zizheng
    Zhu, Chenming
    Xiong, Zhangyang
    Liang, Tianyou
    Chen, Guanying
    Cui, Shuguang
    Han, Xiaoguang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9150 - 9161
  • [8] Efficient Multi-View 3D Dense Matching for Large-Scale Aerial Images Using a Divide-and- Conquer Scheme
    Xue, Junshi
    Chen, Xiangning
    Yi, Hui
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 2610 - 2615
  • [9] UTexGen: High-quality texture reconstruction for large-scale scenes using multi-view images
    Kim, Hye-Sun
    Ban, Yun-Ji
    Park, Chang-Joon
    ETRI JOURNAL, 2024,
  • [10] Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation
    Robert, Damien
    Vallet, Bruno
    Landrieu, Loic
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5565 - 5574