Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

被引:0
|
作者
Lin, Zhaoji [1 ]
Huang, Yutao [2 ]
Yao, Li [2 ]
机构
[1] Sanjiang Univ, Sch Comp Sci & Engn, Nanjing 210012, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
关键词
3D reconstruction; indoor scene; neural radiance fields; signed distance function; normal prior; mesh;
D O I
10.3390/jimaging10090231
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods have problems such as missing surface details, poor reconstruction of large plane textures and uneven illumination areas, and many wrongly reconstructed floating debris noises in the reconstructed models. This paper proposes a 3D reconstruction method for indoor scenes that combines neural radiation field (NeRFs) and signed distance function (SDF) implicit expressions. The volume density of the NeRF is used to provide geometric information for the SDF field, and the learning of geometric shapes and surfaces is strengthened by adding an adaptive normal prior optimization learning process. It not only preserves the high-quality geometric information of the NeRF, but also uses the SDF to generate an explicit mesh with a smooth surface, significantly improving the reconstruction quality of large plane textures and uneven illumination areas in indoor scenes. At the same time, a new regularization term is designed to constrain the weight distribution, making it an ideal unimodal compact distribution, thereby alleviating the problem of uneven density distribution and achieving the effect of floating debris removal in the final model. Experiments show that the 3D reconstruction effect of this paper on ScanNet, Hypersim, and Replica datasets outperforms the state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Research on Three-Dimensional Reconstruction Algorithm of Weak Textured Objects in Indoor Scenes
    Zhang Qingpeng
    Cao Yu
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (08)
  • [2] Reconstruction of Spatial Environment in Three-Dimensional Scenes
    Mezhenin, Alexander
    Izvozchikova, Vera
    Shardakov, Vladimir
    ADVANCES IN INTELLIGENT SYSTEMS, COMPUTER SCIENCE AND DIGITAL ECONOMICS, 2020, 1127 : 47 - 55
  • [3] Three-Dimensional Dose Super-Resolution Using Implicit Neural Representation
    Vasudevan, V.
    Pastor-Serrano, O.
    Huang, C.
    Chuang, C.
    Perko, Z.
    Dong, P.
    Xing, L.
    MEDICAL PHYSICS, 2022, 49 (06) : E711 - E712
  • [4] INRAS: Implicit Neural Representation for Audio Scenes
    Su, Kun
    Chen, Mingfei
    Shlizerman, Eli
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] Representation of three-dimensional scenes using screened voxel expressions
    Zaima, H
    Yamamoto, T
    MULTIMEDIA INFORMATION SYSTEMS IN PRACTICE, 1999, : 202 - 214
  • [6] An new three-dimensional shape reconstruction based on neural network
    Yan, LM
    Yuan, YW
    Deris, MM
    ICEMI'2003: PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS, VOLS 1-3, 2003, : 81 - 84
  • [7] Three-dimensional reconstruction of urban scenes from a single image
    Policarpo, F
    Azevedo, E
    Conci, A
    SIBGRAPI 2002: XV BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2002, : 430 - 430
  • [8] Color holograms synthesis framework for three-dimensional scenes reconstruction
    Memmolo, Pasquale
    Leo, Marco
    Distante, Cosimo
    Paturzo, Melania
    Ferraro, Pietro
    OPTICAL MEASUREMENT SYSTEMS FOR INDUSTRIAL INSPECTION IX, 2015, 9525
  • [9] Range and image sensor combination for three-dimensional reconstruction of objects or scenes
    Altuntas, Cihan
    Yildiz, Ferruh
    SENSOR REVIEW, 2012, 32 (03) : 236 - 244
  • [10] Conversion into three-dimensional implicit surface representation from topological active volumes based segmentation
    Rouco, J
    Barreira, N
    Penedo, MG
    Pardo, XM
    PATTERN RECOGNITION AND IMAGE ANALYSIS, PT 1, PROCEEDINGS, 2005, 3522 : 60 - 68