Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features
    Wang, Jingxue
    Li, Huan
    Xu, Zhenghui
    Xie, Xiao
    REMOTE SENSING, 2023, 15 (21)
  • [22] Hybrid Offset Position Encoding for Large-Scale Point Cloud Semantic Segmentation
    Xiao, Yu
    Wu, Hui
    Chen, Yisheng
    Chen, Chongcheng
    Dong, Ruihai
    Lin, Ding
    REMOTE SENSING, 2025, 17 (02)
  • [23] BEMF-Net: Semantic Segmentation of Large-Scale Point Clouds via Bilateral Neighbor Enhancement and Multi-Scale Fusion
    Ji, Hao
    Yang, Sansheng
    Jiang, Zhipeng
    Zhang, Jianjun
    Guo, Shuhao
    Li, Gaorui
    Zhong, Saishang
    Liu, Zheng
    Xie, Zhong
    REMOTE SENSING, 2023, 15 (22)
  • [24] A self-attention based global feature enhancing network for semantic segmentation of large-scale urban street-level point clouds
    Chen, Qi
    Zhang, Zhenxin
    Chen, Siyun
    Wen, Siyuan
    Ma, Hao
    Xu, Zhihua
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 113
  • [25] CFSA-Net: Efficient Large-Scale Point Cloud Semantic Segmentation Based on Cross-Fusion Self-Attention
    Shu, Jun
    Wang, Shuai
    Yu, Shiqi
    Zhang, Jie
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (03): : 2677 - 2697
  • [26] DLA-Net: Learning dual local attention features for semantic segmentation of large-scale building facade point clouds
    Su, Yanfei
    Liu, Weiquan
    Yuan, Zhimin
    Cheng, Ming
    Zhang, Zhihong
    Shen, Xuelun
    Wang, Cheng
    PATTERN RECOGNITION, 2022, 123
  • [27] Local Fusion Attention Network for Semantic Segmentation of Building Facade Point Clouds
    Su, Yanfei
    Liu, Weiquan
    Cheng, Ming
    Yuan, Zhimin
    Wang, Cheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [28] Active Spatio-Fine Enhancement Network for Semantic Segmentation of Large-Scale Point Clouds
    Chen, Xijiang
    Wang, Zihao
    Zhao, Bufan
    Qin, Mengjiao
    Han, Xianquan
    Ozdemir, Emirhan
    IEEE Sensors Journal, 2024, 24 (22): : 37358 - 37379
  • [29] Active Spatio-Fine Enhancement Network for Semantic Segmentation of Large-Scale Point Clouds
    Chen, Xijiang
    Wang, Zihao
    Zhao, Bufan
    Qin, Mengjiao
    Han, Xianquan
    Ozdemir, Emirhan
    IEEE SENSORS JOURNAL, 2024, 24 (22) : 37358 - 37379
  • [30] ELMF-Net: Semantic Segmentation of Large-Scale Point Clouds via Efficient Local Feature Learner and Multiscale Fusion
    Sun, Maomao
    Rui, Ting
    Wang, Dong
    Yang, Chengsong
    Zheng, Nan
    IEEE SENSORS JOURNAL, 2025, 25 (07) : 11392 - 11404