Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

被引:0
|
作者
Lin, Zhaoji [1 ]
Huang, Yutao [2 ]
Yao, Li [2 ]
机构
[1] Sanjiang Univ, Sch Comp Sci & Engn, Nanjing 210012, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
关键词
3D reconstruction; indoor scene; neural radiance fields; signed distance function; normal prior; mesh;
D O I
10.3390/jimaging10090231
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods have problems such as missing surface details, poor reconstruction of large plane textures and uneven illumination areas, and many wrongly reconstructed floating debris noises in the reconstructed models. This paper proposes a 3D reconstruction method for indoor scenes that combines neural radiation field (NeRFs) and signed distance function (SDF) implicit expressions. The volume density of the NeRF is used to provide geometric information for the SDF field, and the learning of geometric shapes and surfaces is strengthened by adding an adaptive normal prior optimization learning process. It not only preserves the high-quality geometric information of the NeRF, but also uses the SDF to generate an explicit mesh with a smooth surface, significantly improving the reconstruction quality of large plane textures and uneven illumination areas in indoor scenes. At the same time, a new regularization term is designed to constrain the weight distribution, making it an ideal unimodal compact distribution, thereby alleviating the problem of uneven density distribution and achieving the effect of floating debris removal in the final model. Experiments show that the 3D reconstruction effect of this paper on ScanNet, Hypersim, and Replica datasets outperforms the state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [11] Three dimensional reconstruction of structured scenes based on vanishing points
    Wang, Guanghui
    Wang, Shewei
    Gao, Xiang
    Li, Yubing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2006, PROCEEDINGS, 2006, 4261 : 935 - 942
  • [12] Hierarchical decomposition of depth map sequences for representation of three-dimensional dynamic scenes
    Kim, Sung-Yeol
    Ho, Yo-Sung
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2007, E90D (11): : 1813 - 1820
  • [13] Three-dimensional optoacoustic reconstruction using fast sparse representation
    Han, Yiyong
    Ding, Lu
    Ben, Xose Luis Dean
    Razansky, Daniel
    Prakash, Jaya
    Ntziachristos, Vasilis
    OPTICS LETTERS, 2017, 42 (05) : 979 - 982
  • [14] Surface reconstruction from three-dimensional segmentations using implicit functions
    Gomez-Mora, Miller
    Florez-Valencia, Leonardo
    2015 10TH COMPUTING COLOMBIAN CONFERENCE (10CCC), 2015, : 317 - 323
  • [15] Reconstruction of dense three-dimensional shapes for outdoor scenes from an image sequence
    Shi, JinLong
    Zou, Danping
    Bai, Suqin
    Qian, Qiang
    Pang, Linbin
    OPTICAL ENGINEERING, 2013, 52 (12)
  • [16] Dense Three-Dimensional Color Reconstruction for Large-Scale Outdoor Scenes
    Liu, Zixiao
    Guo, Sheng
    Pun, Man-On
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1530 - 1535
  • [17] Three-dimensional Reconstruction of Indoor Whole Elements Based on Mobile LiDAR Point Cloud Data
    Gong, Yuejian
    Mao, Wenbo
    Bi, Jiantao
    Wei, Ji
    He, Zhanjun
    LIDAR REMOTE SENSING FOR ENVIRONMENTAL MONITORING XIV, 2014, 9262
  • [18] Neural representation of three-dimensional features of manipulation objects with stereopsis
    H. Sakata
    Masato Taira
    Makoto Kusunoki
    Akira Murata
    Ken-ichiro Tsutsui
    Yuji Tanaka
    W. Nyi Shein
    Yukiko Miyashita
    Experimental Brain Research, 1999, 128 : 160 - 169
  • [19] Neural representation of three-dimensional features of manipulation objects with stereopsis
    Sakata, H
    Taira, M
    Kusunoki, M
    Murata, A
    Tsutsui, K
    Tanaka, Y
    Shein, WN
    Miyashita, Y
    EXPERIMENTAL BRAIN RESEARCH, 1999, 128 (1-2) : 160 - 169
  • [20] DeepISMNet: three-dimensional implicit structural modeling with convolutional neural network
    Bi, Zhengfa
    Wu, Xinming
    Li, Zhaoliang
    Chang, Dekuan
    Yong, Xueshan
    GEOSCIENTIFIC MODEL DEVELOPMENT, 2022, 15 (17) : 6841 - 6861