Multistage strategy for ground point filtering on large-scale datasets

被引:0
|
作者
Paredes, Diego Teijeiro [1 ]
Lopez, Margarita Amor [1 ]
Bujan, Sandra [2 ]
Richter, Rico [3 ]
Doellner, Juergen [3 ]
机构
[1] Univ A Coruna, Fac Informat, Dept Ingn Comp, Comp Arquitecture Grp,CITIC,Lab 1 2, Campus Elvina s-n, La Coruna 15071, Spain
[2] Univ Leon, Dept Tecnol Minera Topog & Estruct, Leon, Spain
[3] Univ Potsdam, Hasso Plattner Inst, Fac Digital Engn, Potsdam, Germany
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 18期
关键词
LiDAR point clouds; Landscape identification; Ground filtering; Apache spark; LIDAR DATA; CLASSIFICATION; CLOUD; SEGMENTATION; EXTRACTION; ALGORITHMS;
D O I
10.1007/s11227-024-06406-0
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Ground point filtering on national-level datasets is a challenge due to the presence of multiple types of landscapes. This limitation does not simply affect to individual users, but it is in particular relevant for those national institutions in charge of providing national-level Light Detection and Ranging (LiDAR) point clouds. Each type of landscape is typically better filtered by different filtering algorithms or parameters; therefore, in order to get the best quality classification, the LiDAR point cloud should be divided by the landscape before running the filtering algorithms. Despite the fact that the manual segmentation and identification of the landscapes can be very time intensive, only few studies have addressed this issue. In this work, we present a multistage approach to automate the identification of the type of landscape using several metrics extracted from the LiDAR point cloud, matching the best filtering algorithms in each type of landscape. An additional contribution is presented, a parallel implementation for distributed memory systems, using Apache Spark, that can achieve up to 34x\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$34\times$$\end{document} of speedup using 12 compute nodes.
引用
收藏
页码:25974 / 26001
页数:28
相关论文
共 50 条
  • [31] Parallel Framework for Dimensionality Reduction of Large-Scale Datasets
    Samudrala, Sai Kiranmayee
    Zola, Jaroslaw
    Aluru, Srinivas
    Ganapathysubramanian, Baskar
    SCIENTIFIC PROGRAMMING, 2015, 2015
  • [32] Will Large-scale Generative Models Corrupt Future Datasets?
    Hataya, Ryuichiro
    Bao, Han
    Arai, Hiromi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20498 - 20508
  • [33] Large-scale palm vein recognition on synthetic datasets
    Hernandez-Garcia, Ruber
    Santamaria, Jose, I
    Barrientos, Ricardo J.
    Salazar Jurado, Edwin H.
    Manuel Castro, Francisco
    Ramos-Cozar, Julian
    Guil, Nicolas
    2021 40TH INTERNATIONAL CONFERENCE OF THE CHILEAN COMPUTER SCIENCE SOCIETY (SCCC), 2021,
  • [34] Scalable Iterative Classification for Sanitizing Large-Scale Datasets
    Li, Bo
    Vorobeychik, Yevgeniy
    Li, Muqun
    Malin, Bradley
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (03) : 698 - 711
  • [35] TIPP: Parallel Delaunay Triangulation for Large-Scale Datasets
    Nguyen, Cuong
    Rhodes, Philip J.
    30TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT (SSDBM 2018), 2018,
  • [36] Exploring Large-scale Public Medical Image Datasets
    Oakden-Rayner, Luke
    ACADEMIC RADIOLOGY, 2020, 27 (01) : 106 - 112
  • [37] Distributed Sketched Subspace Clustering for Large-scale Datasets
    Traganitis, Panagiotis A.
    Giannakis, Georgios B.
    2017 IEEE 7TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2017,
  • [38] Generative models and abstractions for large-scale neuroanatomy datasets
    Rolnick, David
    Dyer, Eva L.
    CURRENT OPINION IN NEUROBIOLOGY, 2019, 55 : 112 - 120
  • [39] LARGE-SCALE DATASETS FOR GOING DEEPER IN IMAGE UNDERSTANDING
    Wu, Jiahong
    Zheng, He
    Zhao, Bo
    Li, Yixin
    Yan, Baoming
    Liang, Rui
    Wang, Wenjia
    Zhou, Shipei
    Lin, Guosen
    Fu, Yanwei
    Wang, Yizhou
    Wang, Yonggang
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1480 - 1485
  • [40] A fast fuzzy clustering algorithm for large-scale datasets
    Shi, LK
    He, PL
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2005, 3584 : 203 - 208