Geometry-Guided Neural Implicit Surface Reconstruction

被引:0
|
作者
Li, Keqiang [1 ,2 ]
Wu, Huaiyu [1 ]
Zhao, Mingyang [3 ]
Fang, Qihang [1 ,2 ]
Yang, Jian [1 ,2 ]
Zhang, Ao [1 ,2 ]
Shen, Zhen [1 ]
Xiong, Gang [1 ]
Wang, Fei-Yue [4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Hong Kong Inst Sci & Innovat, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
来源
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Surface reconstruction; Image reconstruction; Rendering (computer graphics); Three-dimensional displays; Image color analysis; Accuracy; Surface treatment; Explicit geometry constraints; multiview images; neural implicit learning; surface reconstruction; PARADIGM; SCENES;
D O I
10.1109/TCSS.2024.3416313
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiview 3-D reconstruction holds considerable promise across a wide applications in social manufacturing. Conducting in-depth research on precise and robust multiview 3-D reconstruction holds the potential to significantly empower the domain of social manufacturing. Recently, there has been a burgeoning interest in the domain of neural implicit surfaces learning through volume rendering for the purpose of multiview reconstruction without 3-D supervision. Conventional approaches often overlook explicit multiview geometry constraints, resulting in shortcomings in generating consistent surface reconstructions and recovering fine details. To solve this, we propose geometry-guided neural implicit surface (GG-NeuS), a geometry-guided neural implicit surfaces learning method for multiview surface reconstruction. Our model places a stronger emphasis on maintaining geometry consistency, significantly enhancing the quality of reconstruction. First, we enforce multiview geometry constraints on the surface points by locating the zero-level set of signed distance function (SDF). Second, we incorporate normal cues, predicted by general-purpose monocular estimators, to substantially recover fine geometric details. Additionally, we introduce a voxel-based surface reconstruction methodology that strikes an optimal balance between training time and reconstruction quality. Through comprehensive qualitative and quantitative experiments and analyses, we demonstrate that GG-NeuS successfully reconstructs fine-grained surface details and achieves superior surface reconstruction quality than state-of-the-art approaches.
引用
收藏
页码:7898 / 7908
页数:11
相关论文
共 50 条
  • [31] Cross-view image synthesis using geometry-guided conditional GANs
    Regmi, Krishna
    Borji, Ali
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
  • [32] Geometry-Guided Street-View Panorama Synthesis From Satellite Imagery
    Shi, Yujiao
    Campbell, Dylan
    Yu, Xin
    Li, Hongdong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 10009 - 10022
  • [33] Geometry-Guided Dense Perspective Network for Speech-Driven Facial Animation
    Liu, Jingying
    Hui, Binyuan
    Li, Kun
    Liu, Yunke
    Lai, Yu-Kun
    Zhang, Yuxiang
    Liu, Yebin
    Yang, Jingyu
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (12) : 4873 - 4886
  • [34] LGGA-MPP: Local Geometry-Guided Graph Attention for Molecular Property Prediction
    Song, Lei
    Zhu, Huimin
    Wang, Kaili
    Li, Min
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2024, 64 (08) : 3105 - 3113
  • [35] Geometry-guided Compact Compression for Light Field Image using Graph Convolutional Networks
    Liu, Yu
    Wei, Linhui
    Zhao, Heming
    Shan, Jingming
    Wang, Yumei
    PROCEEDINGS OF THE 32ND WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO, NOSSDAV 2022, 2022, : 15 - 21
  • [36] Surface reconstruction using neural networks and adaptive geometry meshes
    Júnior, ADM
    Neto, ADD
    de Melo, JD
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 803 - 807
  • [37] PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects
    Chen, Guangcheng
    He, Yicheng
    He, Li
    Zhang, Hong
    COMPUTER VISION - ECCV 2024, PT VIII, 2025, 15066 : 205 - 222
  • [38] MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction
    Yu, Zehao
    Peng, Songyou
    Niemeyer, Michael
    Sattler, Torsten
    Geiger, Andreas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [39] HaLo-NeRF: Learning Geometry-Guided Semantics for Exploring Unconstrained Photo Collections
    Dudai, Chen
    Alper, Morris
    Bezalel, Hana
    Hanocka, Rana
    Lang, Itai
    Averbuch-Elor, Hadar
    COMPUTER GRAPHICS FORUM, 2024, 43 (02)
  • [40] Spatial-Temporal Graphs Plus Transformers for Geometry-Guided Facial Expression Recognition
    Zhao, Rui
    Liu, Tianshan
    Huang, Zixun
    Lun, Daniel P. K.
    Lam, Kin-Man
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 2751 - 2767