Real-time volume rendering with octree-based implicit surface representation

被引:0
|
作者
Li, Jiaze [1 ]
Zhang, Luo [1 ]
Hu, Jiangbei [1 ,2 ]
Zhang, Zhebin [3 ]
Sun, Hongyu [3 ]
Song, Gaochao [4 ]
He, Ying [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[2] Dalian Univ Technol, Int Sch Informat Sci & Engn, Dalian, Liaoning, Peoples R China
[3] InnoPeak Technol Inc, Bellevue, WA USA
[4] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
关键词
Neural rendering; Implicit surfaces; Octrees; Real-time volume rendering;
D O I
10.1016/j.cagd.2024.102322
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent breakthroughs in neural radiance fields have significantly advanced the field of novel view synthesis and 3D reconstruction from multi -view images. However, the prevalent neural volume rendering techniques often suffer from long rendering time and require extensive network training. To address these limitations, recent initiatives have explored explicit voxel representations of scenes to expedite training. Yet, they often fall short in delivering accurate geometric reconstructions due to a lack of effective 3D representation. In this paper, we propose an octree-based approach for the reconstruction of implicit surfaces from multi -view images. Leveraging an explicit, network -free data structure, our method substantially increases rendering speed, achieving real-time performance. Moreover, our reconstruction technique yields surfaces with quality comparable to state-of-the-art network -based learning methods. The source code and data can be downloaded from https://github .com /LaoChui999 /Octree -VolSDF.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Octree-based obstacle representation and registration for real-time
    Kim, Jaewoong
    Kim, Daesik
    Seo, Junghyun
    Lee, Sukhan
    Park, Yeonchool
    ICMIT 2007: MECHATRONICS, MEMS, AND SMART MATERIALS, PTS 1 AND 2, 2008, 6794
  • [2] Neurosurgical simulation system with Octree-based implicit volume modeling
    Shimizu, Mayumi
    Itano, Tomoya
    Nakamura, Yasuaki
    WMSCI 2005: 9TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL 4, 2005, : 421 - 426
  • [3] Octree-based implicit agglomeration multigrid method
    Pan, DZ
    Chao, MJ
    AIAA JOURNAL, 1999, 37 (08) : 1002 - 1005
  • [4] Real-time volume rendering
    Kaufman, A
    Dachille, F
    Chen, B
    Bitter, I
    Kreeger, K
    Zhang, N
    Tang, Q
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2000, 11 (01) : 44 - 52
  • [5] An octree-based multiresolution approach supporting interactive rendering of very large volume data sets
    Pinskiy, D
    Brugger, E
    Childs, H
    Hamann, B
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS AND TECHNOLOGY, VOLS I AND II, 2001, : 16 - 22
  • [6] Real-time flame simulation based on volume rendering
    Sun, Jin-guang
    Yang, Xin-nian
    Li, Yang
    Wang, Jun-tao
    MECHANICAL AND ELECTRONICS ENGINEERING III, PTS 1-5, 2012, 130-134 : 2643 - 2646
  • [7] Real-time accelerators for volume rendering
    Kaufman, A
    Pfister, H
    Knittel, G
    Hesser, J
    Goble, JC
    VISUALIZATION '96, PROCEEDINGS, 1996, : 445 - 447
  • [8] Real-time volume rendering systems
    Dolgovesov, BS
    Shevtsov, MY
    Proceedings of the Second IASTED International Multi-Conference on Automation, Control, and Information Technology - Software Engineering, 2005, : 104 - 107
  • [9] Architectures for real-time volume rendering
    Pfister, H
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 1999, 15 (01): : 1 - 9
  • [10] Octree-based approach to real-time collision-free path planning for robot manipulator.
    Hamada, K
    Hori, Y
    AMC '96-MIE - 1996 4TH INTERNATIONAL WORKSHOP ON ADVANCED MOTION CONTROL, PROCEEDINGS, VOLS 1 AND 2, 1996, : 705 - 710