Omnidirectional-Sensor-System-Based Texture Noise Correction in Large-Scale 3D Reconstruction

被引:0
|
作者
Xie, Wenya [1 ]
Hong, Xiaoping [1 ]
机构
[1] Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen 518055, Peoples R China
关键词
imaging sensor; texture noise correction; frame fusion; voxel hashing; 3D reconstruction; SPECULAR HIGHLIGHT REMOVAL;
D O I
10.3390/s24010078
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The evolution of cameras and LiDAR has propelled the techniques and applications of three-dimensional (3D) reconstruction. However, due to inherent sensor limitations and environmental interference, the reconstruction process often entails significant texture noise, such as specular highlight, color inconsistency, and object occlusion. Traditional methodologies grapple to mitigate such noise, particularly in large-scale scenes, due to the voluminous data produced by imaging sensors. In response, this paper introduces an omnidirectional-sensor-system-based texture noise correction framework for large-scale scenes, which consists of three parts. Initially, we obtain a colored point cloud with luminance value through LiDAR points and RGB images organization. Next, we apply a voxel hashing algorithm during the geometry reconstruction to accelerate the computation speed and save the computer memory. Finally, we propose the key innovation of our paper, the frame-voting rendering and the neighbor-aided rendering mechanisms, which effectively eliminates the aforementioned texture noise. From the experimental results, the processing rate of one million points per second shows its real-time applicability, and the output figures of texture optimization exhibit a significant reduction in texture noise. These results indicate that our framework has advanced performance in correcting multiple texture noise in large-scale 3D reconstruction.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] A Cluster-Based 3D Reconstruction System for Large-Scale Scenes
    Li, Yao
    Qi, Yue
    Wang, Chen
    Bao, Yongtang
    SENSORS, 2023, 23 (05)
  • [2] A Parallel Method for Texture Reconstruction in Large-Scale 3D Automatic Modeling Based on Oblique Photography
    Wang, Fei
    Zhu, Hongchun
    Cai, Haolin
    Qu, Wenhu
    Zhang, Shuaizhe
    Liu, Zhendong
    REMOTE SENSING, 2022, 14 (09)
  • [3] Efficient convex optimization-based texture mapping for large-scale 3D scene reconstruction
    Sheng, Xin
    Yuan, Jing
    Tao, Wenbing
    Tao, Bo
    Liu, Liman
    INFORMATION SCIENCES, 2021, 556 : 143 - 159
  • [4] Scanning-based 3D reconstruction of large-scale objects
    Bai, Suqin
    Shi, Jinlong
    Ge, Qijie
    Tian, Zhaohui
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ROBOTICS, INTELLIGENT CONTROL AND ARTIFICIAL INTELLIGENCE (RICAI 2019), 2019, : 584 - 589
  • [5] 3D Laser Omnimapping for 3D Reconstruction of Large-Scale Scenes
    Hu, Shaoxing
    Zhang, Aiwu
    2009 JOINT URBAN REMOTE SENSING EVENT, VOLS 1-3, 2009, : 688 - +
  • [6] Large-scale 3D Reconstruction with an R-based Analysis Workflow
    Chen, Riqing
    Zhang, Hui
    BDCAT'17: PROCEEDINGS OF THE FOURTH IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, 2017, : 85 - 93
  • [7] Large-Scale 3D Scene Reconstruction with Hilbert Maps
    Guizilini, Vitor
    Ramos, Fabio
    2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), 2016, : 3247 - 3254
  • [8] Power Bundle Adjustment for Large-Scale 3D Reconstruction
    Weber, Simon
    Demmel, Nikolaus
    Chan, Tin Chon
    Cremers, Daniel
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 281 - 289
  • [9] Large-scale outdoor 3D reconstruction on a mobile device
    Schoeps, Thomas
    Sattler, Torsten
    Hane, Christian
    Pollefeys, Marc
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 157 : 151 - 166
  • [10] Multi-sensor large-scale dataset for multi-view 3D reconstruction
    Voynov, Oleg
    Bobrovskikh, Gleb
    Karpyshev, Pavel
    Galochkin, Saveliy
    Ardelean, Andrei-Timotei
    Bozhenko, Arseniy
    Karmanova, Ekaterina
    Kopanev, Pavel
    Labutin-Rymsho, Yaroslav
    Rakhimov, Ruslan
    Safin, Aleksandr
    Serpiva, Valerii
    Artemov, Alexey
    Burnaev, Evgeny
    Tsetserukou, Dzmitry
    Zorin, Denis
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21392 - 21403