HSCN: Semi-Supervised ALS Point Cloud Semantic Segmentation via Hybrid Structure Constraint Network

被引:0
|
作者
Zeng, Tao [1 ]
Luo, Fulin [2 ]
Guo, Tan [3 ]
Gong, Xiuwen [4 ]
Shu, Wenqiang [5 ]
Zhao, Yong [1 ]
机构
[1] Sichuan Univ, Sch Elect Informat Engn, Chengdu 610065, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[4] Univ Technol Sydney, Fac Engn & IT, Ultimo, NSW 2007, Australia
[5] Chongqing Geomatics & Remote Sensing Applicat Ctr, Chongqing 401147, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Training; Semantic segmentation; Three-dimensional displays; Data models; Measurement; Semantics; Predictive models; Perturbation methods; Generators; Geometric structure similarity; kernel point convolution (KPConv); point cloud semantic segmentation; pseudo-label generator; semi-supervised learning (SSL); CONVOLUTION; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3484681
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semi-supervised learning (SSL) plays a crucial role in airborne laser scanning (ALS) point cloud semantic segmentation to reduce the cost of sample labeling. However, the prevailing semi-supervised approaches mainly focus on local and global feature aggregation, which neglects the multiscale and neighborhood structure properties of ALS point clouds. To address this issue, we propose an innovative approach called the Hybrid Structured Constraint Network (HSCN) for semi-supervised semantic segmentation of ALS point clouds. HSCN makes full use of a large number of unlabeled samples to guide the model training under limited labeled samples. To process the unlabeled samples, we construct a global awareness loss (GAL) to constrain the global distribution of point clouds. Then, we also design a multiscale geometric structure similarity metric loss (MLS) to align the neighborhood structure for point clouds at different scales. In addition, we utilize the multiscale features to develop a multilevel fused pseudo-label generator for obtaining high-value pseudo-labels, and then a pseudo-label loss (PLS) is constructed to reduce the class mean probability discrepancies. The proposed HSCN fully utilizes the multiscale and neighborhood structure properties of unlabeled samples to achieve a robust model under limited labeled samples. Extensive experimental analysis using three benchmark datasets (i.e., ISPRS, LASDU, and DFC2019) reveals that our proposed method achieves comparable advantages to some existing advanced fully supervised approaches, even only 0.1% labeled samples for model training. The code is available at https://github.com/SC-shendazt/HSCN.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
    Jiang, Li
    Shi, Shaoshuai
    Tian, Zhuotao
    Lai, Xin
    Liu, Shu
    Fu, Chi-Wing
    Jia, Jiaya
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6403 - 6412
  • [2] Semi-supervised Learning for Segmentation Under Semantic Constraint
    Ganaye, Pierre-Antoine
    Sdika, Michael
    Benoit-Cattin, Hugues
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, PT III, 2018, 11072 : 595 - 602
  • [3] SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network
    Cheng, Mingmei
    Hui, Le
    Xie, Jin
    Yang, Jian
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1140 - 1147
  • [4] Hierarchical Point-based Active Learning for Semi-supervised Point Cloud Semantic Segmentation
    Xu, Zongyi
    Yuan, Bo
    Zhao, Shanshan
    Zhang, Qianni
    Gao, Xinbo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18052 - 18062
  • [5] Revisiting Network Perturbation for Semi-supervised Semantic Segmentation
    Li, Sien
    Wang, Tao
    Hui, Ruizhe
    Liu, Wenxi
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XII, 2025, 15042 : 157 - 171
  • [6] Semi-supervised Semantic Segmentation with Error Localization Network
    Kwon, Donghyeon
    Kwak, Suha
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9947 - 9957
  • [7] A new weakly supervised approach for ALS point cloud semantic segmentation
    Wang, Puzuo
    Yao, Wei
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 188 : 237 - 254
  • [8] Transferable Semi-Supervised Semantic Segmentation
    Xiao, Huaxin
    Wei, Yunchao
    Liu, Yu
    Zhang, Maojun
    Feng, Jiashi
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7420 - 7427
  • [9] Universal Semi-Supervised Semantic Segmentation
    Kalluri, Tarun
    Varma, Girish
    Chandraker, Manmohan
    Jawahar, C. V.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5258 - 5269
  • [10] Semi-Supervised Semantic Segmentation via Adaptive Equalization Learning
    Hu, Hanzhe
    Wei, Fangyun
    Hu, Han
    Ye, Qiwei
    Cui, Jinshi
    Wang, Liwei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34