Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] Advancements in Semantic Segmentation Methods for Large-Scale Point Clouds Based on Deep Learning
    Ai Da
    Zhang Xiaoyang
    Xu Ce
    Qin Siyu
    Yuan Hui
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (12)
  • [12] RAAFNet: Reverse Attention Adaptive Fusion Network for Large-Scale Point Cloud Semantic Segmentation
    Wang, Kai
    Zhang, Huanhuan
    MATHEMATICS, 2024, 12 (16)
  • [13] Dense Dual-Branch Cross Attention Network for Semantic Segmentation of Large-Scale Point Clouds
    Luo, Ziwei
    Zeng, Ziyin
    Tang, Wei
    Wan, Jie
    Xie, Zhong
    Xu, Yongyang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [14] Enhanced Local Feature Learning With Simple Offset Attention for Semantic Segmentation of Large-Scale Point Clouds
    Chen, Dong
    Wang, Yuebin
    Zhang, Liqiang
    Kang, Zhizhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [15] Fusion of images and point clouds for the semantic segmentation of large-scale 3D scenes based on deep learning
    Zhang, Rui
    Li, Guangyun
    Li, Minglei
    Wang, Li
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 143 : 85 - 96
  • [16] EDGE-CONVOLUTION POINT NET FOR SEMANTIC SEGMENTATION OF LARGE-SCALE POINT CLOUDS
    Contreras, Jhonatan
    Denzler, Joachim
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5236 - 5239
  • [17] Building semantic segmentation from large-scale point clouds via primitive recognition
    Romanengo, Chiara
    Cabiddu, Daniela
    Pittaluga, Simone
    Mortara, Michela
    GRAPHICAL MODELS, 2025, 136
  • [18] CSFNet: Cross-Modal Semantic Focus Network for Semantic Segmentation of Large-Scale Point Clouds
    Luo, Yang
    Han, Ting
    Liu, Yujun
    Su, Jinhe
    Chen, Yiping
    Li, Jinyuan
    Wu, Yundong
    Cai, Guorong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [19] UnrollingNet: An attention-based deep learning approach for the segmentation of large-scale point clouds of tunnels
    Zhang, Zhaoxiang
    Ji, Ankang
    Wang, Kunyu
    Zhang, Limao
    AUTOMATION IN CONSTRUCTION, 2022, 142
  • [20] PVI-Net: Point-Voxel-Image Fusion for Semantic Segmentation of Point Clouds in Large-Scale Autonomous Driving Scenarios
    Wang, Zongshun
    Li, Ce
    Ma, Jialin
    Feng, Zhiqiang
    Xiao, Limei
    INFORMATION, 2024, 15 (03)