Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation

被引:1
|
作者
Yao, Baochen [1 ,2 ]
Dong, Li [1 ,2 ]
Qiu, Xiaojie [3 ]
Song, Kangkang [4 ]
Yan, Diqun [1 ,2 ]
Peng, Chengbin [1 ,2 ]
机构
[1] Ningbo Univ, Coll Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Ningbo Univ, Key Lab Mobile Network Applicat Technol Zhejiang, Ningbo 315211, Peoples R China
[3] Zhejiang Cowain Automat Technol Co Ltd, Ningbo 315201, Peoples R China
[4] Ningbo Inst Mat Technol & Engn, Chinese Acad Sci, Ningbo 315201, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Perturbation methods; Reliability; Prototypes; Training; Predictive models; Measurement; Contrastive learning; negative pseudo-label; point cloud segmentation; weakly supervised; SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3416219
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional point cloud data are widely used in many fields, as they can be easily obtained and contain rich semantic information. Recently, weakly supervised segmentation has attracted lots of attention, because it only requires very few labels, thus reducing time-consuming and expensive data annotation efforts for huge amounts of point cloud data. The existing approaches typically adopt softmax scores from the last layer as the confidence for selecting high-confident point predictions. However, such approaches can ignore the potential value of a large number of low-confidence point predictions under traditional metrics. In this work, we propose an uncertainty-guided contrastive learning (UCL) framework for weakly supervised point cloud segmentation. A novel uncertainty metric based on prototype entropy (PE) is presented to estimate the reliability of model predictions. With this metric, we propose a negative contrastive learning module exploiting negative pseudo-labels of predictions with low reliability and an active contrastive learning module enhancing feature learning of segmentation models by predictions with high reliability. We also propose a generic multiscale feature perturbation method to expand a wider perturbation space. Extensive experimental results on indoor and outdoor point cloud datasets demonstrate that the proposed method achieves competitive performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] PCL: Point Contrast and Labeling for Weakly Supervised Point Cloud Semantic Segmentation
    Du, Anan
    Zhou, Tianfei
    Pang, Shuchao
    Wu, Qiang
    Zhang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8902 - 8914
  • [22] CPCM: Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentation
    Liu, Lizhao
    Zhuang, Zhuangwei
    Huang, Shangxin
    Xiao, Xunlong
    Xiang, Tianhang
    Chen, Cen
    Wang, Jingdong
    Tan, Mingkui
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18367 - 18376
  • [23] Class agnostic and specific consistency learning for weakly-supervised point cloud semantic segmentation
    Wu, Junwei
    Sun, Mingjie
    Xu, Haotian
    Jiang, Chenru
    Ma, Wuwei
    Zhang, Quan
    PATTERN RECOGNITION, 2025, 158
  • [24] UNCERTAINTY-GUIDED ROBUST TRAINING FOR MEDICAL IMAGE SEGMENTATION
    Li, Yan
    Chen, Xiaoyi
    Quan, Li
    Zhang, Ni
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1471 - 1475
  • [25] HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
    Li, Mengtian
    Xie, Yuan
    Shen, Yunhang
    Ke, Bo
    Qiao, Ruizhi
    Ren, Bo
    Lin, Shaohui
    Ma, Lizhuang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14910 - 14919
  • [26] Weakly-Supervised Semantic Segmentation by Learning Label Uncertainty
    Neven, Robby
    Neven, Davy
    De Brabandere, Bert
    Proesmans, Marc
    Goedeme, Toon
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1678 - 1686
  • [27] Uncertainty-guided dual-views for semi-supervised volumetric medical image segmentation
    Peiris, Himashi
    Hayat, Munawar
    Chen, Zhaolin
    Egan, Gary
    Harandi, Mehrtash
    NATURE MACHINE INTELLIGENCE, 2023, 5 (07) : 724 - +
  • [28] Weakly-supervised Point Cloud Instance Segmentation with Geometric Priors
    Du, Heming
    Yu, Xin
    Hussain, Farookh
    Armin, Mohammad Ali
    Petersson, Lars
    Li, Weihao
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4260 - 4269
  • [29] An MIL-Derived Transformer for Weakly Supervised Point Cloud Segmentation
    Yang, Cheng-Kun
    Wu, Ji-Jia
    Chen, Kai-Syun
    Chuang, Yung-Yu
    Lin, Yen-Yu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11820 - 11829
  • [30] Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud
    Zhang, Yachao
    Li, Zonghao
    Xie, Yuan
    Qu, Yanyun
    Li, Cuihua
    Mei, Tao
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 3421 - 3429