Channel Attention and Normal-Based Local Feature Aggregation Network (CNLNet): A Deep Learning Method for Predisaster Large-Scale Outdoor Lidar Semantic Segmentation

被引:2
|
作者
Liu, Chang [1 ]
Ge, Linlin [1 ]
Xiang, Wei [2 ]
Du, Zheyuan [1 ,3 ]
Zhang, Qi [4 ]
机构
[1] Univ New South Wales, Fac Engn, Sch Civil & Environm Engn, Sydney, NSW 2052, Australia
[2] La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne, Vic 3086, Australia
[3] Geosci Australia, Minerals Energy & Groundwater Div, Canberra, ACT 2601, Australia
[4] Tech Univ Munich, Sch Engn & Design, D-80333 Munich, Germany
关键词
Deep learning; light detection and ranging (Lidar); predisaster; semantic segmentation;
D O I
10.1109/TGRS.2023.3339475
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Predisaster information storage is crucial for effective disaster response. The discussion regarding deep learning-based light detection and ranging (Lidar) semantic segmentation technology for indoor small items has been ongoing in recent years. However, the methods applicable to large-scale outdoor Lidar datasets for predisaster information storage remain limited. This study aims to propose a novel deep learning-based network for city-scale Lidar semantic segmentation to support predisaster information storage, called channel attention and normal-based local feature aggregation network (CNLNet). This network is designed to segment common urban land cover objects, including buildings and vegetation. This network incorporates surface normal information and the channel attention (CA) mechanism into the RandLA-Net backbone. Ablation studies have been devised to assess the performance of these two features. During the preprocessing step, color information from optical images is fused with Lidar data. The findings demonstrate that CNLNet can enhance the accuracy of the RandLA-Net backbone by improving mean intersection over union (mIoU) by at least 1%-2%. Including one of these two features also contributes to the backbone's improved accuracy. Notably, CNLNet outperforms other well-known networks in terms of accuracy with the test of the public Sementic3D dataset. This study further reveals that the proposed network excels in building segmentation, a crucial facet of predisaster information storage. Moreover, the results show that spatial resolution, whether at 0.5 or 10 m per pixel for optical images, has limited influence on outcomes. One theoretical contribution of this study is the demonstration of the advantages of integrating either surface normal information or a CA mechanism to enhance large-scale outdoor Lidar semantic segmentation. Labeled Lidar datasets have been created for training. The practical contribution is that it can optimize disaster response by efficiently facilitating predisaster information storage.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 24 条
  • [1] THE INFLUENCE OF CHANGING FEATURES ON THE ACCURACY OF DEEP LEARNING-BASED LARGE-SCALE OUTDOOR LIDAR SEMANTIC SEGMENTATION
    Liu, Chang
    Zhang, Qi
    Shirowzhan, Sara
    Bai, Ting
    Sheng, Ziheng
    Wu, Yunhao
    Kuang, Jianming
    Ge, Linlin
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 4443 - 4446
  • [2] Hierarchical feature aggregation network with semantic attention for counting large-scale crowd
    Meng, Chen
    Kang, Chunmeng
    Lyu, Lei
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (11) : 9957 - 9981
  • [3] Enhanced Local Feature Learning With Simple Offset Attention for Semantic Segmentation of Large-Scale Point Clouds
    Chen, Dong
    Wang, Yuebin
    Zhang, Liqiang
    Kang, Zhizhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] Sampling-attention deep learning network with transfer learning for large-scale urban point cloud semantic segmentation
    Zhou, Yunxiang
    Ji, Ankang
    Zhang, Limao
    Xue, Xiaolong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 117
  • [5] Semantic Segmentation of Large-Scale Laser Point Cloud in Mines Based on Local Feature Enhancement
    Dong, Hongxiang
    Yi, An
    Xie, Lirong
    Yang, Zhiyong
    Kai, Zhang
    CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2024, 51 (17):
  • [6] Advancements in Semantic Segmentation Methods for Large-Scale Point Clouds Based on Deep Learning
    Ai Da
    Zhang Xiaoyang
    Xu Ce
    Qin Siyu
    Yuan Hui
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (12)
  • [7] A 3D Semantic Segmentation Method for Large-Scale Point Cloud on Deep Learning
    Liu, Sihan
    Zhang, Wenyu
    Zhang, Yujun
    Wang, Zhijian
    Gao, Dongxiang
    ENGINEERING LETTERS, 2023, 31 (04) : 1667 - 1674
  • [8] MsVFE and V-SIAM: Attention-based multi-scale feature interaction and fusion for outdoor LiDAR semantic segmentation
    Yang, Jingru
    Wang, Jin
    Huang, Kaixiang
    Lu, Guodong
    Sun, Yu
    Yu, Huan
    Zhang, Cheng
    Yang, Ying
    Zou, Wenming
    NEUROCOMPUTING, 2024, 584
  • [9] MsVFE and V-SIAM: Attention-based multi-scale feature interaction and fusion for outdoor LiDAR semantic segmentation
    Yang, Jingru
    Wang, Jin
    Huang, Kaixiang
    Lu, Guodong
    Sun, Yu
    Yu, Huan
    Zhang, Cheng
    Yang, Ying
    Zou, Wenming
    Neurocomputing, 2024, 584
  • [10] LPFE-Net: a local parallel feature extraction network for large-scale point cloud semantic segmentation
    Ai, Da
    Zhang, Xiaoyang
    Xu, Ce
    Liu, Xinlong
    Yuan, Hui
    Liu, Ying
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)