Uncertainty-Aware Point-Cloud Semantic Segmentation for Unstructured Roads

被引:4
|
作者
Liu, Pengfei [1 ,2 ]
Yu, Guizhen [1 ,2 ]
Wang, Zhangyu [3 ,4 ]
Zhou, Bin [3 ,4 ]
Ming, Ruotong [5 ]
Jin, Chunhua [6 ]
机构
[1] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Autonomous Transportat Technol Special Ve, Beijing 100191, Peoples R China
[3] Beihang Univ, Res Inst Frontier Sci, Beijing 100191, Peoples R China
[4] Beihang Univ, Hefei Innovat Res Inst, Hefei 230012, Peoples R China
[5] Chongqing Univ, Chongqing Univ Univ Cincinnati Joint Co op Inst, Chongqing 400044, Peoples R China
[6] Beijing Informat Sci & Technol Univ, Res Inst Artificial Intelligence, Beijing 100192, Peoples R China
基金
中国国家自然科学基金;
关键词
Uncertainty; Semantic segmentation; Roads; Sensors; Semantics; Estimation; Convolution; Point cloud; semantic segmentation; uncertainty estimation; unstructured roads; LANE-DETECTION; CLASSIFICATION; NAVIGATION;
D O I
10.1109/JSEN.2023.3266802
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic segmentation is one of the fundamental elements for achieving effective and safe autonomous driving. However, due to the irregular boundaries and variable illumination of unstructured roads, applying it in these scenarios is confronted with great challenges. To address these problems, a novel point-cloud semantic segmentation framework for unstructured roads is proposed. It contains three sections: spherical projection, an uncertainty-aware semantic segmentation network, and postprocessing. First, point cloud will be projected to the range image, which can be processed by the 2-D convolution network. Then, the uncertainty-aware semantic segmentation network is constructed. It consists of context-aware attention (CAA) module and direction attention up-sampling (DAU) module, which can improve the performance for the segmentation of unstructured roads. In addition, a Gaussian mixture model (GMM) is introduced at the end of the network to predict the result with uncertainty, indicating the confidence level of the output. Finally, the segmentation result is refined during the postprocessing to help filter the noise points. Experimental data from mine sites were collected to validate the performance for unstructured roads. In addition, the proposed method was evaluated on the public unstructured dataset RELLIS-3-D. The experiments show that the proposed architecture achieved 74.9% and 40.4% mIoU, which performs better than comparison methods. Additionally, the network is more robust to noisy data by achieving improvements of 4.6%-7.6% under different levels of noise data.
引用
收藏
页码:15071 / 15080
页数:10
相关论文
共 50 条
  • [1] Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation
    Yang, Yuwei
    Hayat, Munawar
    Jin, Zhao
    Ren, Chao
    Lei, Yinjie
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21759 - 21768
  • [2] PointRas: Uncertainty-Aware Multi-Resolution Learning for Point Cloud Segmentation
    Zheng, Yu
    Xu, Xiuwei
    Zhou, Jie
    Lu, Jiwen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6002 - 6016
  • [3] An uncertainty-aware domain adaptive semantic segmentation framework
    Yin H.
    Wang P.
    Liu B.
    Yan J.
    Autonomous Intelligent Systems, 2024, 4 (01):
  • [4] Uncertainty-aware Cross-Entropy for Semantic Segmentation
    Landgraf, Steven
    Hillemann, Markus
    Wursthorn, Kira
    Ulrich, Markus
    ISPRS ANNALS OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES: VOLUME X-2-2024, 2024, : 129 - 136
  • [5] Uncertainty-Aware Contrastive Distillation for Incremental Semantic Segmentation
    Yang, Guanglei
    Fini, Enrico
    Xu, Dan
    Rota, Paolo
    Ding, Mingli
    Nabi, Moin
    Alameda-Pineda, Xavier
    Ricci, Elisa
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2567 - 2581
  • [6] Point-Cloud Semantic Segmentation Network Considering Normals
    Shang Pengfei
    Chen Yi
    Lv Weijia
    Zheng Fang
    Wang Jielong
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [7] Uncertainty-aware point cloud segmentation for infrastructure projects using Bayesian deep learning
    Vassilev, Hristo
    Laska, Marius
    Blankenbach, Joerg
    AUTOMATION IN CONSTRUCTION, 2024, 164
  • [8] Uncertainty-Aware Learning for Zero-Shot Semantic Segmentation
    Hu, Ping
    Sclaroff, Stan
    Saenko, Kate
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [9] Weakly Supervised Large-Scale Point Cloud Semantic Segmentation Based on Dual Consistency Constraints and Uncertainty-Aware Fusion
    Zhou, Ce
    Ling, Qiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [10] Neighborhood Spatial Aggregation MC Dropout for Efficient Uncertainty-Aware Semantic Segmentation in Point Clouds
    Qi, Chao
    Yin, Jianqin
    Niu, Yingchun
    Xu, Jinghang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61