Omnidirectional-Sensor-System-Based Texture Noise Correction in Large-Scale 3D Reconstruction

被引:0
|
作者
Xie, Wenya [1 ]
Hong, Xiaoping [1 ]
机构
[1] Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen 518055, Peoples R China
关键词
imaging sensor; texture noise correction; frame fusion; voxel hashing; 3D reconstruction; SPECULAR HIGHLIGHT REMOVAL;
D O I
10.3390/s24010078
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The evolution of cameras and LiDAR has propelled the techniques and applications of three-dimensional (3D) reconstruction. However, due to inherent sensor limitations and environmental interference, the reconstruction process often entails significant texture noise, such as specular highlight, color inconsistency, and object occlusion. Traditional methodologies grapple to mitigate such noise, particularly in large-scale scenes, due to the voluminous data produced by imaging sensors. In response, this paper introduces an omnidirectional-sensor-system-based texture noise correction framework for large-scale scenes, which consists of three parts. Initially, we obtain a colored point cloud with luminance value through LiDAR points and RGB images organization. Next, we apply a voxel hashing algorithm during the geometry reconstruction to accelerate the computation speed and save the computer memory. Finally, we propose the key innovation of our paper, the frame-voting rendering and the neighbor-aided rendering mechanisms, which effectively eliminates the aforementioned texture noise. From the experimental results, the processing rate of one million points per second shows its real-time applicability, and the output figures of texture optimization exhibit a significant reduction in texture noise. These results indicate that our framework has advanced performance in correcting multiple texture noise in large-scale 3D reconstruction.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Construction of system for controlling the dimensions of large-scale parts based on a 3D machine vision system
    I. I. Dunin-Barkovskii
    Measurement Techniques, 2004, 47 : 1168 - 1173
  • [42] Connectivity-Based Boundary Extraction of Large-Scale 3D Sensor Networks: Algorithm and Applications
    Jiang, Hongbo
    Zhang, Shengkai
    Tan, Guang
    Wang, Chonggang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (04) : 908 - 918
  • [44] Tourism demonstration system for large-scale museums based on 3D virtual simulation technology
    Hu, Yongcai
    Sun, Wei
    Liu, Xigang
    Gan, Quan
    Shi, Jie
    ELECTRONIC LIBRARY, 2020, 38 (02): : 367 - 381
  • [45] Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction
    Reizenstein, Jeremy
    Shapovalov, Roman
    Henzler, Philipp
    Sbordone, Luca
    Labatut, Patrick
    Novotny, David
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10881 - 10891
  • [46] Real-Time Large-Scale Dense 3D Reconstruction with Loop Closure
    Kaehler, Olaf
    Prisacariu, Victor A.
    Murray, David W.
    COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 500 - 516
  • [47] Real-Time 3D Reconstruction of Large-Scale Scenes with LOD Representation
    Fu, Haohai
    Yang, Huamin
    Chen, Chunyi
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (02)
  • [48] Large-scale, real-time 3D scene reconstruction on a mobile device
    Dryanovski, Ivan
    Klingensmith, Matthew
    Srinivasa, Siddhartha S.
    Xiao, Jizhong
    AUTONOMOUS ROBOTS, 2017, 41 (06) : 1423 - 1445
  • [49] OPERATIONAL PIPELINE FOR LARGE-SCALE 3D RECONSTRUCTION OF BUILDINGS FROM SATELLITE IMAGES
    Tripodi, Sebastien
    Duan, Liuyun
    Poujade, Veronique
    Trastour, Frederic
    Bauchet, Jean-Philippe
    Laurore, Lionel
    Tarabalka, Yuliya
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 445 - 448
  • [50] A Large-Scale, Omnidirectional, and Polarization-Independent Metamaterial-Based Chemical Sensor
    Xu, Ruijia
    Sha, Jun
    Chen, Wenjun
    Yan, Kanghong
    Luo, Ji
    Yu, Yangbin
    Liao, Shaoquan
    Zhong, Jitong
    Yang, Shengrong
    Yao, Dongyuan
    Liu, Xiaoyan
    Tong, Yanlin
    Xu, Zefeng
    Lin, Yu-Sheng
    2018 INTERNATIONAL CONFERENCE ON OPTICAL MEMS AND NANOPHOTONICS (OMN), 2018, : 48 - 49