A progressive segmentation network for navigable areas with semantic-spatial information flow

被引:0
|
作者
Li, Wei [2 ,3 ]
Liao, Muxin [1 ,3 ]
Zou, Wenbin [1 ,2 ,3 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong, Peoples R China
[2] Shenzhen Univ, Shenzhen Key Lab Adv Machine Learning & Applicat, Shenzhen 518060, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Guangdong, Peoples R China
关键词
Navigable areas; Deep neural networks; Auxiliary information; Semantic-spatial information flow; Spatial weight aggregation; TERRAIN; NAVIGATION;
D O I
10.1016/j.eswa.2024.125465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Segmentation of safe navigable areas is a crucial technology for scene parsing in autopilot systems. However, existing segmentation methods often fail to adequately exploit the complementary relationships between multiscale features in complex wild environments, resulting in insufficient information fusion. In pursuit of a resolution, a Progressive Segmentation Network (PSNet) is proposed for navigable areas segmentation, which builds a semantic-spatial information flow branch to dynamically exploit the complementary relationships between multiscale features for progressive guided learning. Specifically, PSNet consists of four essential modules, including the Local Capturer and Global dependence Builder (LCGB), Multi-Directional Pooling Module (MDPM), Fusion-wise Module (FWM), and Spatial Weight Aggregation Module (SWAM). To facilitate efficient information dissemination, the LCGB was utilized to capture dense spatial information, and the MDPM was proposed to extract global geometric information of obstacles. These pieces of information serve as prior knowledge to guide learning. Additionally, we propose the FWM based on attention fusion unit (AFU) and contribution weights unit (CWU) to construct the complementary relationships between multiscale features and obtain rich multiscale fusion information. SWAM is proposed to enhance the significant spatial features from FWM and achieve impressive segmentation results. Extensive experimental results on the wild datasets demonstrate that PSNet outperforms state-of-the-art methods in recognizing safe navigable areas. The code for PSNet will be available at https://github.com/lv881314/PSNet.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] SPNet: An RGB-D Sequence Progressive Network for Road Semantic Segmentation
    Zhou, Zhi
    Zhang, Yuhang
    Hua, Guoguang
    Long, Ruijing
    Tian, Shishun
    Zou, Wenbin
    2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [32] Real-time semantic segmentation via mutual optimization of spatial details and semantic information
    Ma, Mengyuan
    Huang, Huiling
    Han, Jun
    Feng, Yanbing
    Yang, Yi
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2024, 46 (03) : 6821 - 6834
  • [33] Spatial Structure Preserving Feature Pyramid Network for Semantic Image Segmentation
    Yuan, Yuan
    Fang, Jie
    Lu, Xiaoqiang
    Feng, Yachuang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (03)
  • [34] Frequency and Spatial Domain Injection Network for Methane Plumes Semantic Segmentation
    Liu, Yuquan
    Shi, Hailiang
    Wu, Shichao
    Ye, Hanhan
    Wang, Xianhua
    Sun, Erchang
    Han, Yunfei
    Xiong, Wei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [35] Residual spatial fusion network for RGB-thermal semantic segmentation
    Li, Ping
    Chen, Junjie
    Lin, Binbin
    Xu, Xianghua
    NEUROCOMPUTING, 2024, 595
  • [36] Spatial Attention based Semantic Decouple Network for Breast Tumor Segmentation
    Wang, Li
    Wang, Lihui
    Chen, Qijian
    Yang, Feng
    Zhu, Yuemin
    2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, : 235 - 239
  • [37] Spatial semantic network and agent-based framework for spatial information interoperation
    Luo, Yingwei
    Wang, Xiaolin
    Xu, Zhuoqun
    Proc. IEEE Int. Conf. Inf. Reuse Integr., IRI, (40-47):
  • [38] Spatial semantic network and agent-based framework for spatial information interoperation
    Luo, YW
    Wang, XL
    Xu, ZQ
    PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION, 2003, : 40 - 47
  • [39] SIIF: Semantic information interactive fusion network for photovoltaic defect segmentation
    Zhou, Peng
    Wang, Rui
    Wang, Chuhan
    Chen, Haiyong
    Liu, Kun
    APPLIED ENERGY, 2024, 371
  • [40] A Mutual Information Domain Adaptation Network for Remotely Sensed Semantic Segmentation
    Chen, Hongyu
    Zhang, Hongyan
    Yang, Guangyi
    Li, Shengyang
    Zhang, Liangpei
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60