HSCN: Semi-Supervised ALS Point Cloud Semantic Segmentation via Hybrid Structure Constraint Network

被引:0
|
作者
Zeng, Tao [1 ]
Luo, Fulin [2 ]
Guo, Tan [3 ]
Gong, Xiuwen [4 ]
Shu, Wenqiang [5 ]
Zhao, Yong [1 ]
机构
[1] Sichuan Univ, Sch Elect Informat Engn, Chengdu 610065, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[4] Univ Technol Sydney, Fac Engn & IT, Ultimo, NSW 2007, Australia
[5] Chongqing Geomatics & Remote Sensing Applicat Ctr, Chongqing 401147, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Training; Semantic segmentation; Three-dimensional displays; Data models; Measurement; Semantics; Predictive models; Perturbation methods; Generators; Geometric structure similarity; kernel point convolution (KPConv); point cloud semantic segmentation; pseudo-label generator; semi-supervised learning (SSL); CONVOLUTION; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3484681
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semi-supervised learning (SSL) plays a crucial role in airborne laser scanning (ALS) point cloud semantic segmentation to reduce the cost of sample labeling. However, the prevailing semi-supervised approaches mainly focus on local and global feature aggregation, which neglects the multiscale and neighborhood structure properties of ALS point clouds. To address this issue, we propose an innovative approach called the Hybrid Structured Constraint Network (HSCN) for semi-supervised semantic segmentation of ALS point clouds. HSCN makes full use of a large number of unlabeled samples to guide the model training under limited labeled samples. To process the unlabeled samples, we construct a global awareness loss (GAL) to constrain the global distribution of point clouds. Then, we also design a multiscale geometric structure similarity metric loss (MLS) to align the neighborhood structure for point clouds at different scales. In addition, we utilize the multiscale features to develop a multilevel fused pseudo-label generator for obtaining high-value pseudo-labels, and then a pseudo-label loss (PLS) is constructed to reduce the class mean probability discrepancies. The proposed HSCN fully utilizes the multiscale and neighborhood structure properties of unlabeled samples to achieve a robust model under limited labeled samples. Extensive experimental analysis using three benchmark datasets (i.e., ISPRS, LASDU, and DFC2019) reveals that our proposed method achieves comparable advantages to some existing advanced fully supervised approaches, even only 0.1% labeled samples for model training. The code is available at https://github.com/SC-shendazt/HSCN.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Fuzzy Positive Learning for Semi-supervised Semantic Segmentation
    Qiao, Pengchong
    Wei, Zhidan
    Wang, Yu
    Wang, Zhennan
    Song, Guoli
    Xu, Fan
    Ji, Xiangyang
    Liu, Chang
    Chen, Jie
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15465 - 15474
  • [42] Colour Augmentation for Improved Semi-supervised Semantic Segmentation
    French, Geoff
    Mackiewicz, Michal
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 356 - 363
  • [43] Boosting Semi-Supervised Semantic Segmentation with Probabilistic Representations
    Xie, Haoyu
    Wang, Changqi
    Zheng, Mingkai
    Dong, Minjing
    You, Shan
    Fu, Chong
    Xu, Chang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 2938 - 2946
  • [44] Catastrophic Forgetting Problem in Semi-Supervised Semantic Segmentation
    Zhou, Yan
    Jiao, Ruyi
    Wang, Dongli
    Mu, Jinzhen
    Li, Jianxun
    IEEE ACCESS, 2022, 10 (48855-48864) : 48855 - 48864
  • [45] Semi-supervised Semantic Segmentation with Mutual Knowledge Distillation
    Yuan, Jianlong
    Ge, Jinchao
    Wang, Zhibin
    Liu, Yifan
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5436 - 5444
  • [46] Switching Temporary Teachers for Semi-Supervised Semantic Segmentation
    Na, Jaemin
    Ha, Jung-Woo
    Chang, Hyung Jin
    Han, Dongyoon
    Hwang, Wonjun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [47] Unbiased Subclass Regularization for Semi-Supervised Semantic Segmentation
    Guan, Dayan
    Huang, Jiaxing
    Xiao, Aoran
    Lu, Shijian
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9958 - 9968
  • [48] Semi-supervised semantic segmentation with cross teacher training
    Xiao, Hui
    Li, Dong
    Xu, Hao
    Fu, Shuibo
    Yan, Diqun
    Song, Kangkang
    Peng, Chengbin
    NEUROCOMPUTING, 2022, 508 : 36 - 46
  • [49] A Pseudo Variance Algorithm for Semi-Supervised Semantic Segmentation
    Li, Bin
    Ye, Mengting
    Jiang, Xiangyuan
    Ma, Xiaojing
    Sun, Wenxu
    Chen, Jiyang
    Ma, Sile
    IEEE ACCESS, 2025, 13 : 34149 - 34159
  • [50] Semi-supervised Learning Methods for Semantic Segmentation of Polyps
    Ines, Adrian
    Dominguez, Cesar
    Heras, Jonathan
    Mata, Eloy
    Pascual, Vico
    ADVANCES IN ARTIFICIAL INTELLIGENCE, CAEPIA 2024, 2024, : 162 - 172