Geometry-Guided Neural Implicit Surface Reconstruction

被引:0
|
作者
Li, Keqiang [1 ,2 ]
Wu, Huaiyu [1 ]
Zhao, Mingyang [3 ]
Fang, Qihang [1 ,2 ]
Yang, Jian [1 ,2 ]
Zhang, Ao [1 ,2 ]
Shen, Zhen [1 ]
Xiong, Gang [1 ]
Wang, Fei-Yue [4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Hong Kong Inst Sci & Innovat, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
来源
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Surface reconstruction; Image reconstruction; Rendering (computer graphics); Three-dimensional displays; Image color analysis; Accuracy; Surface treatment; Explicit geometry constraints; multiview images; neural implicit learning; surface reconstruction; PARADIGM; SCENES;
D O I
10.1109/TCSS.2024.3416313
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiview 3-D reconstruction holds considerable promise across a wide applications in social manufacturing. Conducting in-depth research on precise and robust multiview 3-D reconstruction holds the potential to significantly empower the domain of social manufacturing. Recently, there has been a burgeoning interest in the domain of neural implicit surfaces learning through volume rendering for the purpose of multiview reconstruction without 3-D supervision. Conventional approaches often overlook explicit multiview geometry constraints, resulting in shortcomings in generating consistent surface reconstructions and recovering fine details. To solve this, we propose geometry-guided neural implicit surface (GG-NeuS), a geometry-guided neural implicit surfaces learning method for multiview surface reconstruction. Our model places a stronger emphasis on maintaining geometry consistency, significantly enhancing the quality of reconstruction. First, we enforce multiview geometry constraints on the surface points by locating the zero-level set of signed distance function (SDF). Second, we incorporate normal cues, predicted by general-purpose monocular estimators, to substantially recover fine geometric details. Additionally, we introduce a voxel-based surface reconstruction methodology that strikes an optimal balance between training time and reconstruction quality. Through comprehensive qualitative and quantitative experiments and analyses, we demonstrate that GG-NeuS successfully reconstructs fine-grained surface details and achieves superior surface reconstruction quality than state-of-the-art approaches.
引用
收藏
页码:7898 / 7908
页数:11
相关论文
共 50 条
  • [21] OmniAvatar: Geometry-Guided Controllable 3D Head Synthesis
    Xu, Hongyi
    Song, Guoxian
    Jiang, Zihang
    Zhang, Jianfeng
    Shi, Yichun
    Liu, Jing
    Ma, Wanchun
    Feng, Jiashi
    Luo, Linjie
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12814 - 12824
  • [22] Geometry-guided computation of 3D electrostatics for large biomolecules
    Hao, Xuejun
    Varshney, Amitabh
    COMPUTER AIDED GEOMETRIC DESIGN, 2006, 23 (06) : 545 - 557
  • [23] Geometry-Guided Point Generation for 3D Object Detection
    Wang, Kai
    Zhou, Mingliang
    Lin, Qing
    Niu, Guanglin
    Zhang, Xiaowei
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 136 - 140
  • [24] Geometry-Guided Domain Generalization for Monocular 3D Object Detection
    Yang, Fan
    Chen, Hui
    He, Yuwei
    Zhao, Sicheng
    Zhang, Chenghao
    Ni, Kai
    Ding, Guiguang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6467 - 6476
  • [25] Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
    Yariv, Lior
    Kasten, Yoni
    Moran, Dror
    Galun, Meirav
    Atzmon, Matan
    Basri, Ronen
    Lipman, Yaron
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [26] NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction
    Wang, Yusen
    Li, Zongcheng
    Jiang, Yu
    Zhou, Kaixuan
    Cao, Tuo
    Fu, Yanping
    Xiao, Chunxia
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (06):
  • [27] Fusing the Old with the New: Learning Relative Camera Pose with Geometry-Guided Uncertainty
    Zhuang, Bingbing
    Chandraker, Manmohan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 32 - 42
  • [28] ANISE: Assembly-Based Neural Implicit Surface Reconstruction
    Petrov, Dmitry
    Gadelha, Matheus
    Mech, Radomir
    Kalogerakis, Evangelos
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4514 - 4526
  • [29] HIVE: HIerarchical Volume Encoding for Neural Implicit Surface Reconstruction
    Gu, Xiaodong
    Yuan, Weihao
    Li, Heng
    Dong, Zilong
    Tan, Ping
    arXiv,
  • [30] Geo-Net: Geometry-Guided Pretraining for Tooth Point Cloud Segmentation
    Liu, Y.
    Liu, X.
    Yang, C.
    Yang, Y.
    Chen, H.
    Yuan, Y.
    JOURNAL OF DENTAL RESEARCH, 2024, 103 (13) : 1358 - 1364