Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

被引:0
|
作者
Lin, Zhaoji [1 ]
Huang, Yutao [2 ]
Yao, Li [2 ]
机构
[1] Sanjiang Univ, Sch Comp Sci & Engn, Nanjing 210012, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
关键词
3D reconstruction; indoor scene; neural radiance fields; signed distance function; normal prior; mesh;
D O I
10.3390/jimaging10090231
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods have problems such as missing surface details, poor reconstruction of large plane textures and uneven illumination areas, and many wrongly reconstructed floating debris noises in the reconstructed models. This paper proposes a 3D reconstruction method for indoor scenes that combines neural radiation field (NeRFs) and signed distance function (SDF) implicit expressions. The volume density of the NeRF is used to provide geometric information for the SDF field, and the learning of geometric shapes and surfaces is strengthened by adding an adaptive normal prior optimization learning process. It not only preserves the high-quality geometric information of the NeRF, but also uses the SDF to generate an explicit mesh with a smooth surface, significantly improving the reconstruction quality of large plane textures and uneven illumination areas in indoor scenes. At the same time, a new regularization term is designed to constrain the weight distribution, making it an ideal unimodal compact distribution, thereby alleviating the problem of uneven density distribution and achieving the effect of floating debris removal in the final model. Experiments show that the 3D reconstruction effect of this paper on ScanNet, Hypersim, and Replica datasets outperforms the state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Three-dimensional reconstruction algorithm based on fusion of transport of intensity equation and neural network
    Cheng H.
    Hu J.-J.
    Liu Y.
    Ye Y.-Q.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2021, 55 (04): : 658 - 664and719
  • [32] Implicit Neural Visual Representation Compression of 3D Scenes
    Bang, Gun
    Do, Jihoon
    Kang, Jung Won
    Bea, Seong-Jun
    Lee, Hahyun
    Lee, Jinho
    Kim, Soowoong
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [33] Reconstruction of partially occluded objects encoded in three-dimensional scenes by using digital holograms
    Maycock, J
    McElhinney, CP
    Hennelly, BM
    Naughton, TJ
    McDonald, JB
    Javidi, B
    APPLIED OPTICS, 2006, 45 (13) : 2975 - 2985
  • [34] Three-Dimensional Implicit Curve Interpolation
    H.-Y. Xu
    J.-S. Dai
    The International Journal of Advanced Manufacturing Technology, 2002, 19 : 325 - 329
  • [35] Three-Dimensional Reconstruction of Indoor and Outdoor Environments Using a Stereo Catadioptric System
    Cordova-Esparza, Diana-Margarita
    Terven, Juan
    Romero-Gonzalez, Julio-Alejandro
    Ramirez-Pedraza, Alfonso
    APPLIED SCIENCES-BASEL, 2020, 10 (24): : 1 - 18
  • [36] Three-dimensional implicit curve interpolation
    Xu, HY
    Dai, JS
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2002, 19 (05): : 325 - 329
  • [37] Maps in three-dimensional representation
    Souza, Alessandra
    CONFINS-REVUE FRANCO-BRESILIENNE DE GEOGRAPHIE-REVISTA FRANCO-BRASILEIRA DE GEOGRAFIA, 2020, 47
  • [38] THREE-DIMENSIONAL CAMERA SYSTEM FOR THIN THREE-DIMENSIONAL DISPLAY BASED ON THE RECONSTRUCTION OF PARALLAX RAYS
    Takahashi, Hideya
    Miyatake, Shuhei
    Aida, Tahito
    Yamada, Kenji
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2009, 5 (03): : 619 - 629
  • [39] Is the cognitive map flat? Studies of the neural representation of three-dimensional space
    Jeffery, Kate
    COGNITIVE PROCESSING, 2012, 13 : S25 - S25
  • [40] Neural representation of three-dimensional acoustic space in the human temporal lobe
    Zhang, Xiaolu
    Zhang, Qingtian
    Hu, Xiaolin
    Zhang, Bo
    FRONTIERS IN HUMAN NEUROSCIENCE, 2015, 9 : 1 - 9