HSCN: Semi-Supervised ALS Point Cloud Semantic Segmentation via Hybrid Structure Constraint Network

被引:0
|
作者
Zeng, Tao [1 ]
Luo, Fulin [2 ]
Guo, Tan [3 ]
Gong, Xiuwen [4 ]
Shu, Wenqiang [5 ]
Zhao, Yong [1 ]
机构
[1] Sichuan Univ, Sch Elect Informat Engn, Chengdu 610065, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[4] Univ Technol Sydney, Fac Engn & IT, Ultimo, NSW 2007, Australia
[5] Chongqing Geomatics & Remote Sensing Applicat Ctr, Chongqing 401147, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Training; Semantic segmentation; Three-dimensional displays; Data models; Measurement; Semantics; Predictive models; Perturbation methods; Generators; Geometric structure similarity; kernel point convolution (KPConv); point cloud semantic segmentation; pseudo-label generator; semi-supervised learning (SSL); CONVOLUTION; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3484681
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semi-supervised learning (SSL) plays a crucial role in airborne laser scanning (ALS) point cloud semantic segmentation to reduce the cost of sample labeling. However, the prevailing semi-supervised approaches mainly focus on local and global feature aggregation, which neglects the multiscale and neighborhood structure properties of ALS point clouds. To address this issue, we propose an innovative approach called the Hybrid Structured Constraint Network (HSCN) for semi-supervised semantic segmentation of ALS point clouds. HSCN makes full use of a large number of unlabeled samples to guide the model training under limited labeled samples. To process the unlabeled samples, we construct a global awareness loss (GAL) to constrain the global distribution of point clouds. Then, we also design a multiscale geometric structure similarity metric loss (MLS) to align the neighborhood structure for point clouds at different scales. In addition, we utilize the multiscale features to develop a multilevel fused pseudo-label generator for obtaining high-value pseudo-labels, and then a pseudo-label loss (PLS) is constructed to reduce the class mean probability discrepancies. The proposed HSCN fully utilizes the multiscale and neighborhood structure properties of unlabeled samples to achieve a robust model under limited labeled samples. Extensive experimental analysis using three benchmark datasets (i.e., ISPRS, LASDU, and DFC2019) reveals that our proposed method achieves comparable advantages to some existing advanced fully supervised approaches, even only 0.1% labeled samples for model training. The code is available at https://github.com/SC-shendazt/HSCN.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] LaserMix for Semi-Supervised LiDAR Semantic Segmentation
    Kong, Lingdong
    Ren, Jiawei
    Pan, Liang
    Liu, Ziwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21705 - 21715
  • [22] Semi-Supervised Semantic Segmentation With Region Relevance
    Chen, Rui
    Chen, Tao
    Wang, Qiong
    Yao, Yazhou
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 852 - 857
  • [23] A semi-supervised approach for the semantic segmentation of trajectories
    Soares Junior, Amilcar
    Times, Valeria Cesario
    Renso, Chiara
    Matwin, Stan
    Cabral, Lucidio A. F.
    2018 19TH IEEE INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2018), 2018, : 145 - 154
  • [24] Revisiting Consistency for Semi-Supervised Semantic Segmentation
    Grubisic, Ivan
    Orsic, Marin
    Segvic, Sinisa
    SENSORS, 2023, 23 (02)
  • [25] Information Transfer in Semi-Supervised Semantic Segmentation
    Wu, Jiawei
    Fan, Haoyi
    Li, Zuoyong
    Liu, Guang-Hai
    Lin, Shouying
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 1174 - 1185
  • [26] SSGAM-Net: A Hybrid Semi-Supervised and Supervised Network for Robust Semantic Segmentation Based on Drone LiDAR Data
    Wu, Hua
    Huang, Zhe
    Zheng, Wanhao
    Bai, Xiaojing
    Sun, Li
    Pu, Mengyang
    REMOTE SENSING, 2024, 16 (01)
  • [27] SemiGMMPoint: Semi-supervised point cloud segmentation based on Gaussian mixture models
    Zhuang, Xianwei
    Wang, Hualiang
    He, Xiaoxuan
    Fu, Siming
    Hu, Haoji
    PATTERN RECOGNITION, 2025, 158
  • [28] SPCR: SEMI-SUPERVISED POINT CLOUD INSTANCE SEGMENTATION WITH PERTURBATION CONSISTENCY REGULARIZATION
    Liao, Yongbin
    Zhu, Hongyuan
    Chen, Tao
    Fan, Jiayuan
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3113 - 3117
  • [29] Point Cloud Instance Segmentation With Semi-Supervised Bounding-Box Mining
    Liao, Yongbin
    Zhu, Hongyuan
    Zhang, Yanggang
    Ye, Chuangguan
    Chen, Tao
    Fan, Jiayuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 10159 - 10170
  • [30] Semi-supervised peripapillary atrophy segmentation with shape constraint
    Li, Mengxuan
    Zhang, Weihang
    Yang, Ruixiao
    Xu, Jie
    Zhao, He
    Li, Huiqi
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 166