Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

被引:0
|
作者
Lin, Zhaoji [1 ]
Huang, Yutao [2 ]
Yao, Li [2 ]
机构
[1] Sanjiang Univ, Sch Comp Sci & Engn, Nanjing 210012, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
关键词
3D reconstruction; indoor scene; neural radiance fields; signed distance function; normal prior; mesh;
D O I
10.3390/jimaging10090231
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods have problems such as missing surface details, poor reconstruction of large plane textures and uneven illumination areas, and many wrongly reconstructed floating debris noises in the reconstructed models. This paper proposes a 3D reconstruction method for indoor scenes that combines neural radiation field (NeRFs) and signed distance function (SDF) implicit expressions. The volume density of the NeRF is used to provide geometric information for the SDF field, and the learning of geometric shapes and surfaces is strengthened by adding an adaptive normal prior optimization learning process. It not only preserves the high-quality geometric information of the NeRF, but also uses the SDF to generate an explicit mesh with a smooth surface, significantly improving the reconstruction quality of large plane textures and uneven illumination areas in indoor scenes. At the same time, a new regularization term is designed to constrain the weight distribution, making it an ideal unimodal compact distribution, thereby alleviating the problem of uneven density distribution and achieving the effect of floating debris removal in the final model. Experiments show that the 3D reconstruction effect of this paper on ScanNet, Hypersim, and Replica datasets outperforms the state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] GeoINR 1.0: an implicit neural network approach to three-dimensional geological modelling
    Hillier, Michael
    Wellmann, Florian
    de Kemp, Eric A.
    Brodaric, Boyan
    Schetselaar, Ernst
    Bedard, Karine
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2023, 16 (23) : 6987 - 7012
  • [42] Three-Dimensional Model-Based Human Detection in Crowded Scenes
    Wang, Lu
    Yung, Nelson Hon Ching
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2012, 13 (02) : 691 - 703
  • [43] Surface color perception in three-dimensional scenes
    Boyaci, Huseyin
    Doerschner, Katja
    Snyder, Jacqueline L.
    Maloney, Laurence T.
    VISUAL NEUROSCIENCE, 2006, 23 (3-4) : 311 - 321
  • [44] Discrete Indoor Three-Dimensional Localization System Based on Neural Networks Using Visible Light Communication
    Alonso-Gonzalez, Itziar
    Sanchez-Rodriguez, David
    Ley-Bosch, Carlos
    Quintana-Suarez, Miguel A.
    SENSORS, 2018, 18 (04)
  • [45] Fruit Morphological Measurement Based on Three-Dimensional Reconstruction
    Wang, Yawei
    Chen, Yifei
    AGRONOMY-BASEL, 2020, 10 (04):
  • [46] Three-Dimensional Reconstruction Method Based on Infrared Deflectometry
    Xiong, Ping
    Zhao, Jing
    Chen, Jinping
    Hu, Hao
    Cao, Jiangping
    PHOTONIC SENSORS, 2025, 15 (02)
  • [47] Research of Three-dimensional Reconstruction Based on Computer Vision
    Wang, Jian
    Chen, Defeng
    Zhao, Tuan
    2010 6TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS NETWORKING AND MOBILE COMPUTING (WICOM), 2010,
  • [48] Three-dimensional nonrigid reconstruction based on probability model
    Wang, Yaming
    Shen, Deming
    Huang, Wenqing
    Han, Yonghua
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (01)
  • [49] A vein display system based on three-dimensional reconstruction
    Wang, Danting
    Zhou, Ya
    Hu, Xiaoming
    Wu, Zhaoguo
    Dai, Xiaobin
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY III, 2014, 9273
  • [50] Three-Dimensional Reconstruction and Evaluation Based on CT Images
    Song, LiMei
    Wen, YuHua
    PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND COMPUTER SCIENCE, VOL II, 2009, : 44 - +