Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation
    Xie Xinchen
    Li, Chen
    Tian, Lihua
    2022 IEEE WORLD AI IOT CONGRESS (AIIOT), 2022, : 9 - 14
  • [42] VPFNET: A Scale-Adaptive Voxel Point Fusion Network for Semantic Segmentation of Point Clouds
    Wang, Xiaoyang
    Cui, Kaining
    Wang, Lu
    Liu, Zhenfei
    Yu, Bingxin
    He, Yuhong
    Cheng, Jun
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 75 - 88
  • [43] Facet Segmentation-Based Line Segment Extraction for Large-Scale Point Clouds
    Lin, Yangbin
    Wang, Cheng
    Chen, Bili
    Zai, Dawei
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (09): : 4839 - 4854
  • [44] Point-based Attention Convolutional Neural Networks for Point Clouds Semantic Segmentation
    Li, Ying
    Li, Qing
    ACM International Conference Proceeding Series, 2022, : 1642 - 1647
  • [45] Dual fusion network for semantic segmentation of point clouds *
    Lu, Jian
    Guo, Huihui
    Jia, Xurui
    Wu, Jiatong
    Chen, Xiaogai
    OPTICS AND LASERS IN ENGINEERING, 2024, 177
  • [46] Region-Based Edge Convolutions With Geometric Attributes for the Semantic Segmentation of Large-Scale 3-D Point Clouds
    Contreras, Jhonatan
    Sickert, Sven
    Denzler, Joachim
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 2598 - 2609
  • [47] TOWARDS ACCURATE INSTANCE SEGMENTATION IN LARGE-SCALE LIDAR POINT CLOUDS
    Xiang, Binbin
    Peters, Torben
    Kontogianni, Theodora
    Vetterli, Frawa
    Puliti, Stefano
    Astrup, Rasmus
    Schindler, Konrad
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 605 - 612
  • [48] Semantic segmentation of point clouds by fusing dual attention mechanism and dynamic graph convolution
    Yang, Jun
    Zhang, Chen
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (10): : 2984 - 2994
  • [49] Semantic Segmentation of Large-Scale Outdoor Point Clouds by Encoder-Decoder Shared MLPs with Multiple Losses
    Rim, Beanbonyka
    Lee, Ahyoung
    Hong, Min
    REMOTE SENSING, 2021, 13 (16)
  • [50] Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation
    Zongyi Xu
    Xiaoshui Huang
    Bo Yuan
    Yangfu Wang
    Qianni Zhang
    Weisheng Li
    Xinbo Gao
    Science China Information Sciences, 2024, 67