Geometry-Guided Neural Implicit Surface Reconstruction

被引:0
|
作者
Li, Keqiang [1 ,2 ]
Wu, Huaiyu [1 ]
Zhao, Mingyang [3 ]
Fang, Qihang [1 ,2 ]
Yang, Jian [1 ,2 ]
Zhang, Ao [1 ,2 ]
Shen, Zhen [1 ]
Xiong, Gang [1 ]
Wang, Fei-Yue [4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Hong Kong Inst Sci & Innovat, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
来源
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Surface reconstruction; Image reconstruction; Rendering (computer graphics); Three-dimensional displays; Image color analysis; Accuracy; Surface treatment; Explicit geometry constraints; multiview images; neural implicit learning; surface reconstruction; PARADIGM; SCENES;
D O I
10.1109/TCSS.2024.3416313
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiview 3-D reconstruction holds considerable promise across a wide applications in social manufacturing. Conducting in-depth research on precise and robust multiview 3-D reconstruction holds the potential to significantly empower the domain of social manufacturing. Recently, there has been a burgeoning interest in the domain of neural implicit surfaces learning through volume rendering for the purpose of multiview reconstruction without 3-D supervision. Conventional approaches often overlook explicit multiview geometry constraints, resulting in shortcomings in generating consistent surface reconstructions and recovering fine details. To solve this, we propose geometry-guided neural implicit surface (GG-NeuS), a geometry-guided neural implicit surfaces learning method for multiview surface reconstruction. Our model places a stronger emphasis on maintaining geometry consistency, significantly enhancing the quality of reconstruction. First, we enforce multiview geometry constraints on the surface points by locating the zero-level set of signed distance function (SDF). Second, we incorporate normal cues, predicted by general-purpose monocular estimators, to substantially recover fine geometric details. Additionally, we introduce a voxel-based surface reconstruction methodology that strikes an optimal balance between training time and reconstruction quality. Through comprehensive qualitative and quantitative experiments and analyses, we demonstrate that GG-NeuS successfully reconstructs fine-grained surface details and achieves superior surface reconstruction quality than state-of-the-art approaches.
引用
收藏
页码:7898 / 7908
页数:11
相关论文
共 50 条
  • [41] 3D Dense Geometry-Guided Facial Expression Synthesis by Adversarial Learning
    Bodur, Rumeysa
    Bhattarai, Binod
    Kim, Tae-Kyun
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2391 - 2400
  • [42] 3D Point Cloud Attribute Compression Using Geometry-Guided Sparse Representation
    Gu, Shuai
    Hou, Junhui
    Zeng, Huanqiang
    Yuan, Hui
    Ma, Kai-Kuang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 796 - 808
  • [43] Implicit meshes for surface reconstruction
    Ilic, S
    Fua, P
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (02) : 328 - 333
  • [44] NeuDA: Neural Deformable Anchor for High-Fidelity Implicit Surface Reconstruction
    Cai, Bowen
    Huang, Jinchi
    Jia, Ronglei
    Lv, Chengfei
    Fu, Huan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8476 - 8485
  • [45] Geometry-guided progressive lossless 3D mesh coding with octree (OT) decomposition
    Peng, JL
    Kuo, CCJ
    ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 609 - 616
  • [46] Implicit geometry neural network for mesh generation
    Xu, Ran
    Lyu, Hongqiang
    Yu, Jian
    Bao, Chenyu
    Wang, Hongfei
    Liu, Yufei
    Liu, Xuejun
    CHINESE JOURNAL OF AERONAUTICS, 2025, 38 (04)
  • [47] Geometry-guided semantic segmentation for post-earthquake buildings using optical remote sensing images
    Wang, Yu
    Jing, Xin
    Xu, Yang
    Cui, Liangyi
    Zhang, Qiangqiang
    Li, Hui
    EARTHQUAKE ENGINEERING & STRUCTURAL DYNAMICS, 2023, 52 (11): : 3392 - 3413
  • [48] Category-Level 6D Pose Estimation Using Geometry-Guided Instance-Aware Prior and Multi-Stage Reconstruction
    Nie, Tong
    Ma, Jie
    Zhao, Yuehua
    Fan, Ziming
    Wen, Junjie
    Sun, Mengxuan
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04) : 2381 - 2388
  • [49] Neural Implicit Surface Evolution
    Novello, Tiago
    da Silva, Vinicius
    Schardong, Guilherme
    Schirmer, Luiz
    Lopes, Helio
    Velho, Luiz
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14233 - 14243
  • [50] G2RL: Geometry-Guided Representation Learning for Facial Action Unit Intensity Estimation
    Fan, Yingruo
    Lin, Zhaojiang
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 731 - 737