Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Semantic segmentation of large-scale point clouds by integrating attention mechanisms and transformer models
    Yuan, Tiebiao
    Yu, Yangyang
    Wang, Xiaolong
    IMAGE AND VISION COMPUTING, 2024, 146
  • [2] Semantic segmentation of large-scale point clouds with neighborhood uncertainty
    Bao, Yong
    Wen, Haibiao
    Zhang, Baoqing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (21) : 60949 - 60964
  • [3] Feature Graph Convolution Network With Attentive Fusion for Large-Scale Point Clouds Semantic Segmentation
    Chen, Jun
    Chen, Yiping
    Wang, Cheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [4] GSIP: Green Semantic Segmentation of Large-Scale Indoor Point Clouds
    Zhang, Min
    Kadam, Pranav
    Liu, Shan
    Kuo, C. -C. Jay
    PATTERN RECOGNITION LETTERS, 2022, 164 : 9 - 15
  • [5] Learning Semantic Segmentation of Large-Scale Point Clouds With Random Sampling
    Hu, Qingyong
    Yang, Bo
    Xie, Linhai
    Rosa, Stefano
    Guo, Yulan
    Wang, Zhihua
    Trigoni, Niki
    Markham, Andrew
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 8338 - 8354
  • [6] LessNet: Lightweight and efficient semantic segmentation for large-scale point clouds
    Feng, Guoqiang
    Li, Weilong
    Zhao, Xiaolin
    Yang, Xuemeng
    Kong, Xin
    Huang, TianXin
    Cui, Jinhao
    IET CYBER-SYSTEMS AND ROBOTICS, 2022, 4 (02) : 107 - 115
  • [7] Continuous Mapping Convolution for Large-Scale Point Clouds Semantic Segmentation
    Yan, Kunping
    Hu, Qingyong
    Wang, Hanyun
    Huang, Xiaohong
    Li, Li
    Ji, Song
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] BushNet: Effective semantic segmentation of bush in large-scale point clouds
    Wei, Hejun
    Xu, Enyong
    Zhang, Jinlai
    Meng, Yanmei
    Wei, Jin
    Dong, Zhen
    Li, Zhengqiang
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 193
  • [9] Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph
    Lei Wang
    Jiaji Wu
    Xunyu Liu
    Xiaoliang Ma
    Jun Cheng
    Complex & Intelligent Systems, 2022, 8 : 3833 - 3845
  • [10] Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph
    Wang, Lei
    Wu, Jiaji
    Liu, Xunyu
    Ma, Xiaoliang
    Cheng, Jun
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (05) : 3833 - 3845