Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation

被引:1
|
作者
Yao, Baochen [1 ,2 ]
Dong, Li [1 ,2 ]
Qiu, Xiaojie [3 ]
Song, Kangkang [4 ]
Yan, Diqun [1 ,2 ]
Peng, Chengbin [1 ,2 ]
机构
[1] Ningbo Univ, Coll Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Ningbo Univ, Key Lab Mobile Network Applicat Technol Zhejiang, Ningbo 315211, Peoples R China
[3] Zhejiang Cowain Automat Technol Co Ltd, Ningbo 315201, Peoples R China
[4] Ningbo Inst Mat Technol & Engn, Chinese Acad Sci, Ningbo 315201, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Perturbation methods; Reliability; Prototypes; Training; Predictive models; Measurement; Contrastive learning; negative pseudo-label; point cloud segmentation; weakly supervised; SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3416219
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional point cloud data are widely used in many fields, as they can be easily obtained and contain rich semantic information. Recently, weakly supervised segmentation has attracted lots of attention, because it only requires very few labels, thus reducing time-consuming and expensive data annotation efforts for huge amounts of point cloud data. The existing approaches typically adopt softmax scores from the last layer as the confidence for selecting high-confident point predictions. However, such approaches can ignore the potential value of a large number of low-confidence point predictions under traditional metrics. In this work, we propose an uncertainty-guided contrastive learning (UCL) framework for weakly supervised point cloud segmentation. A novel uncertainty metric based on prototype entropy (PE) is presented to estimate the reliability of model predictions. With this metric, we propose a negative contrastive learning module exploiting negative pseudo-labels of predictions with low reliability and an active contrastive learning module enhancing feature learning of segmentation models by predictions with high reliability. We also propose a generic multiscale feature perturbation method to expand a wider perturbation space. Extensive experimental results on indoor and outdoor point cloud datasets demonstrate that the proposed method achieves competitive performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Dual uncertainty-guided multi-model pseudo-label learning for semi-supervised medical image segmentation
    Qiu Z.
    Gan W.
    Yang Z.
    Zhou R.
    Gan H.
    Mathematical Biosciences and Engineering, 2024, 21 (02) : 2212 - 2232
  • [42] Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning
    Huang, Shuowen
    Hu, Qingwu
    Ai, Mingyao
    Zhao, Pengcheng
    Li, Jian
    Cui, Hao
    Wang, Shaohua
    AUTOMATION IN CONSTRUCTION, 2024, 168
  • [43] Contrastive Learning for Self-Supervised Pre-Training of Point Cloud Segmentation Networks With Image Data
    Janda, Andrej
    Wagstaff, Brandon
    Ng, Edwin G.
    Kelly, Jonathan
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 145 - 152
  • [44] A survey on weakly supervised 3D point cloud semantic segmentation
    Wang, Jingyi
    Liu, Yu
    Tan, Hanlin
    Zhang, Maojun
    IET COMPUTER VISION, 2024, 18 (03) : 329 - 342
  • [45] Weakly-Supervised Point Cloud Semantic Segmentation Based on Dilated Region
    Zhang, Lujian
    Bi, Yuanwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 20
  • [46] Less Is More: Label Recommendation for Weakly Supervised Point Cloud Semantic Segmentation
    Pan, Zhiyi
    Zhang, Nan
    Gao, Wei
    Liu, Shan
    Li, Ge
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4397 - 4405
  • [47] EXPLORING LABEL INITIALIZATION FOR WEAKLY SUPERVISED ALS POINT CLOUD SEMANTIC SEGMENTATION
    Wang, Puzuo
    Yao, Wei
    XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 5-2 : 151 - 158
  • [48] Weakly supervised point cloud semantic segmentation with the fusion of heterogeneous network features
    Niu, Yingchun
    Yin, Jianqin
    IMAGE AND VISION COMPUTING, 2024, 142
  • [49] Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning
    Sun, Tianfang
    Zhang, Zhizhong
    Tan, Xin
    Qu, Yanyun
    Xie, Yuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1838 - 1852
  • [50] A Weakly Supervised Graph Deep Learning Framework for Point Cloud Registration
    Sun, Lan
    Zhang, Zhenxin
    Zhong, Ruofei
    Chen, Dong
    Zhang, Liqiang
    Zhu, Lin
    Wang, Qiang
    Wang, Guo
    Zou, Jianjun
    Wang, Yu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60