A progressive segmentation network for navigable areas with semantic-spatial information flow

被引:0
|
作者
Li, Wei [2 ,3 ]
Liao, Muxin [1 ,3 ]
Zou, Wenbin [1 ,2 ,3 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong, Peoples R China
[2] Shenzhen Univ, Shenzhen Key Lab Adv Machine Learning & Applicat, Shenzhen 518060, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Guangdong, Peoples R China
关键词
Navigable areas; Deep neural networks; Auxiliary information; Semantic-spatial information flow; Spatial weight aggregation; TERRAIN; NAVIGATION;
D O I
10.1016/j.eswa.2024.125465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Segmentation of safe navigable areas is a crucial technology for scene parsing in autopilot systems. However, existing segmentation methods often fail to adequately exploit the complementary relationships between multiscale features in complex wild environments, resulting in insufficient information fusion. In pursuit of a resolution, a Progressive Segmentation Network (PSNet) is proposed for navigable areas segmentation, which builds a semantic-spatial information flow branch to dynamically exploit the complementary relationships between multiscale features for progressive guided learning. Specifically, PSNet consists of four essential modules, including the Local Capturer and Global dependence Builder (LCGB), Multi-Directional Pooling Module (MDPM), Fusion-wise Module (FWM), and Spatial Weight Aggregation Module (SWAM). To facilitate efficient information dissemination, the LCGB was utilized to capture dense spatial information, and the MDPM was proposed to extract global geometric information of obstacles. These pieces of information serve as prior knowledge to guide learning. Additionally, we propose the FWM based on attention fusion unit (AFU) and contribution weights unit (CWU) to construct the complementary relationships between multiscale features and obtain rich multiscale fusion information. SWAM is proposed to enhance the significant spatial features from FWM and achieve impressive segmentation results. Extensive experimental results on the wild datasets demonstrate that PSNet outperforms state-of-the-art methods in recognizing safe navigable areas. The code for PSNet will be available at https://github.com/lv881314/PSNet.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] A Mutual Information Domain Adaptation Network for Remotely Sensed Semantic Segmentation
    Chen, Hongyu
    Zhang, Hongyan
    Yang, Guangyi
    Li, Shengyang
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [42] Spatial Information-Guided Adaptive Context-Aware Network for Efficient RGB-D Semantic Segmentation
    Zhang, Yang
    Xiong, Chenyun
    Liu, Junjie
    Ye, Xuhui
    Sun, Guodong
    IEEE SENSORS JOURNAL, 2023, 23 (19) : 23512 - 23521
  • [43] Rainy day image semantic segmentation based on two-stage progressive network
    Zhang, Heng
    Jia, Dongli
    Ma, Hui
    VISUAL COMPUTER, 2024, 40 (12): : 8945 - 8956
  • [44] Progressive Guidance Edge Perception Network for Semantic Segmentation of Remote-Sensing Images
    Pan, Shaoming
    Tao, Yulong
    Chen, Xiaoshu
    Chong, Yanwen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [45] LPASS-Net: Lightweight Progressive Attention Semantic Segmentation Network for Automatic Segmentation of Remote Sensing Images
    Liang, Han
    Seo, Suyoung
    REMOTE SENSING, 2022, 14 (23)
  • [46] Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentation
    Chen, Lin-Zhuo
    Lin, Zheng
    Wang, Ziqin
    Yang, Yong-Liang
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2313 - 2324
  • [47] Csswin-unet: a Swin-unet network for semantic segmentation of remote sensing images by aggregating contextual information and extracting spatial information
    Xiao, Dong
    Kang, Zhihao
    Fu, Yanhua
    Li, Zhenni
    Ran, Mengying
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (23) : 7598 - 7625
  • [48] GMODet: A Real-Time Detector for Ground-Moving Objects in Optical Remote Sensing Images With Regional Awareness and Semantic-Spatial Progressive Interaction
    Wang, Bin
    Sui, Haigang
    Ma, Guorui
    Zhou, Yuan
    Zhou, Mingting
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [49] Attention Based Quick Network With Optical Flow Estimation for Semantic Segmentation
    Cai, Jiawen
    Liu, Yarong
    Qin, Pan
    IEEE ACCESS, 2023, 11 : 12402 - 12413
  • [50] Spatial and Temporal Awareness Network for Semantic Segmentation on Automotive Radar Point Cloud
    Zhang, Ziwei
    Liu, Jun
    Jiang, Guangfeng
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3520 - 3530