Geometry-Guided Neural Implicit Surface Reconstruction

被引:0
|
作者
Li, Keqiang [1 ,2 ]
Wu, Huaiyu [1 ]
Zhao, Mingyang [3 ]
Fang, Qihang [1 ,2 ]
Yang, Jian [1 ,2 ]
Zhang, Ao [1 ,2 ]
Shen, Zhen [1 ]
Xiong, Gang [1 ]
Wang, Fei-Yue [4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Hong Kong Inst Sci & Innovat, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
来源
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Surface reconstruction; Image reconstruction; Rendering (computer graphics); Three-dimensional displays; Image color analysis; Accuracy; Surface treatment; Explicit geometry constraints; multiview images; neural implicit learning; surface reconstruction; PARADIGM; SCENES;
D O I
10.1109/TCSS.2024.3416313
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiview 3-D reconstruction holds considerable promise across a wide applications in social manufacturing. Conducting in-depth research on precise and robust multiview 3-D reconstruction holds the potential to significantly empower the domain of social manufacturing. Recently, there has been a burgeoning interest in the domain of neural implicit surfaces learning through volume rendering for the purpose of multiview reconstruction without 3-D supervision. Conventional approaches often overlook explicit multiview geometry constraints, resulting in shortcomings in generating consistent surface reconstructions and recovering fine details. To solve this, we propose geometry-guided neural implicit surface (GG-NeuS), a geometry-guided neural implicit surfaces learning method for multiview surface reconstruction. Our model places a stronger emphasis on maintaining geometry consistency, significantly enhancing the quality of reconstruction. First, we enforce multiview geometry constraints on the surface points by locating the zero-level set of signed distance function (SDF). Second, we incorporate normal cues, predicted by general-purpose monocular estimators, to substantially recover fine geometric details. Additionally, we introduce a voxel-based surface reconstruction methodology that strikes an optimal balance between training time and reconstruction quality. Through comprehensive qualitative and quantitative experiments and analyses, we demonstrate that GG-NeuS successfully reconstructs fine-grained surface details and achieves superior surface reconstruction quality than state-of-the-art approaches.
引用
收藏
页码:7898 / 7908
页数:11
相关论文
共 50 条
  • [1] A Geometry-Guided Deep Learning Technique for CBCT Reconstruction
    Lu, K.
    Ren, L.
    Yin, F.
    MEDICAL PHYSICS, 2021, 48 (06)
  • [2] A geometry-guided deep learning technique for CBCT reconstruction
    Lu, Ke
    Ren, Lei
    Yin, Fang-Fang
    PHYSICS IN MEDICINE AND BIOLOGY, 2021, 66 (15):
  • [3] Geometry-guided Feature Learning and Fusion for Indoor Scene Reconstruction
    Yin, Ruihong
    Karaoglu, Sezer
    Gevers, Theo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3629 - 3638
  • [4] Geometry-guided multilevel RGBD fusion for surface normal estimation
    Tong, Yanfeng
    Chen, Jing
    Wang, Yongtian
    COMPUTER COMMUNICATIONS, 2023, 206 : 73 - 84
  • [5] Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering
    Chen, Mingfei
    Zhang, Jianfeng
    Xu, Xiangyu
    Liu, Lijuan
    Cai, Yujun
    Feng, Jiashi
    Yan, Shuicheng
    COMPUTER VISION, ECCV 2022, PT XXIII, 2022, 13683 : 222 - 239
  • [6] A geometry-guided multi-beamlet deep learning technique for CT reconstruction
    Lu, Ke
    Ren, Lei
    Yin, Fang-Fang
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2022, 8 (04)
  • [7] Geometry-Guided Adaptation for Road Segmentation
    Cheng, Gong
    Wang, Yue
    Qian, Yiming
    Elder, James H.
    2020 17TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2020), 2020, : 46 - 53
  • [8] GeoUDF: Surface Reconstruction from 3D Point Clouds via Geometry-guided Distance Representation
    Ren, Siyu
    Hou, Junhui
    Chen, Xiaodong
    He, Ying
    Wang, Wenping
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14168 - 14178
  • [9] A Geometry-Guided Multi-Beamlet Deep Learning Technique for CT Reconstruction
    Lu, K.
    Ren, L.
    Yin, F.
    MEDICAL PHYSICS, 2022, 49 (06) : E610 - E611
  • [10] Geometry-guided generalizable NeRF for human rendering
    Xie, Jiu-Cheng
    Yao, Yiqin
    Xun, Lv
    Zhu, Shuliang
    Guo, Yijing
    Gao, Hao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (42) : 90421 - 90437