Airborne LiDAR data classification method combining physical and geometric characteristics

被引:0
|
作者
Zhao Y. [1 ,2 ]
Zhang Q. [1 ,2 ]
Liu C. [3 ,4 ]
Wu W. [3 ,4 ]
Li Y. [1 ,2 ]
机构
[1] School of Microelectronics, Tianjin University, Tianjin
[2] Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, Tianjin University, Tianjin
[3] Microsystem Center, The 54st Institute of China Electronics Technology Group Corporation, Shijiazhuang
[4] National Engineering Research Center for Communication Software and Special Integrated Circuit Design, Shijiazhuang
关键词
3D point clouds; airborne LiDAR; data classification; feature fusion; full-waveform; physical characteristics;
D O I
10.3788/IRLA20230212
中图分类号
学科分类号
摘要
Objective Full-waveform airborne LiDAR can not only obtain 3D point clouds, but also obtain full-waveform of the target. The classification of full-waveform LiDAR data is to assign a category label to each point based on data characteristics. It is an important part of data post-processing and has significant application value in the fields such as remote sensing and topographic mapping. However, existing methods overlook the correlation between full-waveform and point clouds geometry in terms of physical characteristics, and lack in-depth exploration of the correlation in neighborhood geometry and semantic features between point pairs. Therefore, the existing methods lack the ability to capture local structural information, which affects the classification effect. To address the above issues, a classification method based on the physical and geometric characteristics of the target is proposed. This method mines the high-dimensional feature association between 3D point clouds and full-waveforms on the high-dimensional physical characteristics of the target, and enhances the learning of local geometric structural information, thereby improving the classification ability of the model. Methods A classification method based on target physical and geometric features is proposed. Firstly, a high-dimensional feature fusion module is proposed, which extracted the rich physical characteristics from the full-waveform, and extracted the geometric features of the point clouds. Based on the correlation between full-waveforms and point clouds on the physical characteristics of the target, the complex relationship between the two is learned through a dual low-rank matrix, and deeper physical features are excavated (Fig.2). Secondly, a local neighborhood feature enhancement module is designed to enhance the learning of local geometric structures by constructing a fully-connected neighborhood structure, mining the geometric and semantic correlations between neighboring point pairs (Fig.3). Finally, by using the hierarchical encoder-decoder structure, the characteristics of multiple receptive field can be conbined. A classification method based on the physical characteristics and geometric characteristics can be constructed to improve the classification ability of the model (Fig.4). Results and Discussions The proposed method is based on the correlation between point clouds and full-waveforms on the physical characteristics of the target. By fusing the two, the physical meaning of the features is enriched and the learning of local geometric structures is enhanced. From Tab.2, it can be seen that the proposed method successfully generated correct labels for most points, achieving an average accuracy of 0.96, a recall of 0.90, and an F1 score of 0.92. Multiple methods such as FCN, GACNN, and FWNet2 are used for testing on the same dataset. Compared with FWNet2, which has the best performance among existing methods, our method has effective improvements in average accuracy, average recall, and average F1 score. Among them, compared with FWNet2, the accuracy, recall, and F1 score of our method have been improved by 0.02, 0.01, and 0.02 respectively in the ground category, and by 0.02, 0.04, and 0.03 respectively in the street category. The test results are shown (Fig.6). Conclusions This article proposes a classification algorithm based on the physical and geometric characteristics of the target. This method focuses on the rich physical characteristics and vertical structural information of the target contained in the full-waveform, as well as the correlation between full-waveforms and geometric features of point clouds. The fusion of the two features is achieved using a dual low-rank matrix; And based on the local neighborhood fully-connected structure, the learning of local structural information are strengthened, thus constructing an end-to-end full-waveform airborne LiDAR data classification network. Multiple experiments show that the average accuracy and recall of our classification method are as high as 0.96 and 0.90, respectively, indicating the effectiveness of this method. At the same time, it provides some possibilities for exploration in-depth feature extraction and fusion, based on the correlation in target physical characteristics between full-waveforms and point clouds. © 2023 Chinese Society of Astronautics. All rights reserved.
引用
收藏
相关论文
共 17 条
  • [1] Zhang K, Ye L J, Wen X, Et al., A dual attention neural network for airborne LiDAR point cloud semantic segmentation, IEEE Transactions on Geoscience and Remote Sensing, 60, pp. 1-17, (2022)
  • [2] Li Pengcheng, Xu Qing, Xing Shuai, Et al., Full-waveform LiDAR data decomposition method based on global convergent LM, Infrared and Laser Engineering, 44, 8, pp. 2262-2267, (2015)
  • [3] Nardinocchi C, Balsi M, Esposito S, Et al., Fully automatic point cloud analysis for powerline corridor mapping, IEEE Transactions on Geoscience and Remote Sensing, 58, 12, pp. 8637-8648, (2020)
  • [4] Li W, Luo Z, Xiao Z, Et al., A GCN-based method for eextracting power lines and pylons from airborne LiDAR data, IEEE Transactions on Geoscience and Remote Sensing, 60, pp. 1-14, (2022)
  • [5] Hu Shanjiang, He Yan, Tao Bangyi, Et al., Classification of sea and land waveforms based on deep learning for airborne laser bathymetry, Infrared and Laser Engineering, 48, 11, (2019)
  • [6] Liang G, Zhao X, Zhao J, Et al., MVCNN: A deep learning-based ocean-land waveform classification network for single-wavelength LiDAR bathymetry, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16, pp. 656-674, (2023)
  • [7] Shen Jun, Shang Jianhua, He Yan, Research process of data processing technology of full-waveform airborne laser radars, Laser Technology, 42, 3, pp. 295-299, (2018)
  • [8] Zhu Shixian, Research on critical technology of intensity imaging of 905 nm pulsed LiDAR, (2018)
  • [9] Charles R Q, Hao S, Mo K C, Et al., Point-Net: deep learning on point sets for 3D classification and segmentation, 2017 IEEE Conference on Computer Vision and Pattern Recognition, pp. 77-85, (2017)
  • [10] Qi C R, Yi L, Su H, Et al., Pointnet++: Deep hierarchical feature learning on point sets in a metric space[C], Advances in Neural Information Processing Systems, pp. 5099-5108, (2017)