Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation

被引:0
|
作者
Lin, Zhaoji [1 ]
Huang, Yutao [2 ]
Yao, Li [2 ]
机构
[1] Sanjiang Univ, Sch Comp Sci & Engn, Nanjing 210012, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
关键词
3D reconstruction; indoor scene; neural radiance fields; signed distance function; normal prior; mesh;
D O I
10.3390/jimaging10090231
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods have problems such as missing surface details, poor reconstruction of large plane textures and uneven illumination areas, and many wrongly reconstructed floating debris noises in the reconstructed models. This paper proposes a 3D reconstruction method for indoor scenes that combines neural radiation field (NeRFs) and signed distance function (SDF) implicit expressions. The volume density of the NeRF is used to provide geometric information for the SDF field, and the learning of geometric shapes and surfaces is strengthened by adding an adaptive normal prior optimization learning process. It not only preserves the high-quality geometric information of the NeRF, but also uses the SDF to generate an explicit mesh with a smooth surface, significantly improving the reconstruction quality of large plane textures and uneven illumination areas in indoor scenes. At the same time, a new regularization term is designed to constrain the weight distribution, making it an ideal unimodal compact distribution, thereby alleviating the problem of uneven density distribution and achieving the effect of floating debris removal in the final model. Experiments show that the 3D reconstruction effect of this paper on ScanNet, Hypersim, and Replica datasets outperforms the state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Scalable MAV Indoor Reconstruction with Neural Implicit Surfaces
    Li, Haoda
    Yi, Puyuan
    Liu, Yunhao
    Zahor, Avideh
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1536 - 1544
  • [22] Visibility in three-dimensional cluttered scenes
    Langer, Michael S.
    Mannan, Fahim
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2012, 29 (09) : 1794 - 1807
  • [23] Research of Three-Dimensional Indoor Positioning Based on RSSI
    Liu, Shan
    Ma, Yufeng
    Chai, Jianping
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 1227 - 1231
  • [24] Indoor Three-Dimensional Positioning Method Based on CSS
    Liu, Gaoping
    Zhang, Jinyan
    Yang, Ruxiang
    MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 3281 - +
  • [25] Volumetric Representation and Sphere Packing of Indoor Space for Three-Dimensional Room Segmentation
    Yang, Fan
    Che, Mingliang
    Zuo, Xinkai
    Li, Lin
    Zhang, Jiyi
    Zhang, Chi
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (11)
  • [26] NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors
    Wang, Jiepeng
    Wang, Peng
    Long, Xiaoxiao
    Theobalt, Christian
    Komura, Taku
    Liu, Lingjie
    Wang, Wenping
    COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 139 - 155
  • [27] Application of three-dimensional orthogonal neural network to craniomaxillary reconstruction
    Hsu, JH
    Tseng, CS
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2001, 25 (06) : 477 - 482
  • [28] Three-dimensional reconstruction of neural tracts and commissures in the bee brain
    Ai, Hiroyuki
    Kusakabe, Yuri
    Itoh, Tsunao
    COMPARATIVE BIOCHEMISTRY AND PHYSIOLOGY B-BIOCHEMISTRY & MOLECULAR BIOLOGY, 2008, 151 (04): : 457 - 457
  • [29] Use of truncated pyramid representation methodology in three-dimensional reconstruction: an example
    Papadimitriou, C
    Yapijakis, C
    Davaki, P
    JOURNAL OF MICROSCOPY, 2004, 214 (01) : 70 - 75
  • [30] Research on Three-Dimensional Point Cloud Reconstruction Method Based on Graph Neural Networks
    Ma, Ruocheng
    Gao, Xiang
    Song, Zhaoxiang
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 106 - 113