HSCN: Semi-Supervised ALS Point Cloud Semantic Segmentation via Hybrid Structure Constraint Network

被引:0
|
作者
Zeng, Tao [1 ]
Luo, Fulin [2 ]
Guo, Tan [3 ]
Gong, Xiuwen [4 ]
Shu, Wenqiang [5 ]
Zhao, Yong [1 ]
机构
[1] Sichuan Univ, Sch Elect Informat Engn, Chengdu 610065, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[4] Univ Technol Sydney, Fac Engn & IT, Ultimo, NSW 2007, Australia
[5] Chongqing Geomatics & Remote Sensing Applicat Ctr, Chongqing 401147, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Training; Semantic segmentation; Three-dimensional displays; Data models; Measurement; Semantics; Predictive models; Perturbation methods; Generators; Geometric structure similarity; kernel point convolution (KPConv); point cloud semantic segmentation; pseudo-label generator; semi-supervised learning (SSL); CONVOLUTION; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3484681
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semi-supervised learning (SSL) plays a crucial role in airborne laser scanning (ALS) point cloud semantic segmentation to reduce the cost of sample labeling. However, the prevailing semi-supervised approaches mainly focus on local and global feature aggregation, which neglects the multiscale and neighborhood structure properties of ALS point clouds. To address this issue, we propose an innovative approach called the Hybrid Structured Constraint Network (HSCN) for semi-supervised semantic segmentation of ALS point clouds. HSCN makes full use of a large number of unlabeled samples to guide the model training under limited labeled samples. To process the unlabeled samples, we construct a global awareness loss (GAL) to constrain the global distribution of point clouds. Then, we also design a multiscale geometric structure similarity metric loss (MLS) to align the neighborhood structure for point clouds at different scales. In addition, we utilize the multiscale features to develop a multilevel fused pseudo-label generator for obtaining high-value pseudo-labels, and then a pseudo-label loss (PLS) is constructed to reduce the class mean probability discrepancies. The proposed HSCN fully utilizes the multiscale and neighborhood structure properties of unlabeled samples to achieve a robust model under limited labeled samples. Extensive experimental analysis using three benchmark datasets (i.e., ISPRS, LASDU, and DFC2019) reveals that our proposed method achieves comparable advantages to some existing advanced fully supervised approaches, even only 0.1% labeled samples for model training. The code is available at https://github.com/SC-shendazt/HSCN.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network
    Wang, Jia-Xin
    Chen, Si-Bao
    Ding, Chris H. Q.
    Tang, Jin
    Luo, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [32] Semi-supervised hybrid spine network for segmentation of spine MR images
    Huang, Meiyan
    Zhou, Shuoling
    Chen, Xiumei
    Lai, Haoran
    Feng, Qianjin
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 107
  • [33] CorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentation
    Sun, Boyuan
    Yang, Yuqi
    Le, Zhang
    Cheng, Ming-Ming
    Hou, Qibin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 3097 - 3107
  • [34] A Residual Correction Approach for Semi-supervised Semantic Segmentation
    Li, Haoliang
    Zheng, Huicheng
    PATTERN RECOGNITION AND COMPUTER VISION, PT IV, 2021, 13022 : 90 - 102
  • [35] ROBUST ADVERSARIAL LEARNING FOR SEMI-SUPERVISED SEMANTIC SEGMENTATION
    Zhang, Jia
    Li, Zhixin
    Zhang, Canlong
    Ma, Huifang
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 728 - 732
  • [36] SEMI-SUPERVISED SEMANTIC SEGMENTATION CONSTRAINED BY CONSISTENCY REGULARIZATION
    Li, Xiaoqiang
    He, Qin
    Dai, Songmin
    Wu, Pin
    Tong, Weiqin
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [37] Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision
    Chen, Xiaokang
    Yuan, Yuhui
    Zeng, Gang
    Wang, Jingdong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2613 - 2622
  • [38] Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism
    Xiao, Yifan
    Dong, Jing
    Zhang, Qiang
    Yi, Pengfei
    Liu, Rui
    Wei, Xiaopeng
    ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, UKCI 2023, 2024, 1453 : 182 - 194
  • [39] Enhanced Soft Label for Semi-Supervised Semantic Segmentation
    Ma, Jie
    Wang, Chuan
    Liu, Yang
    Lin, Liang
    Li, Guanbin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1185 - 1195
  • [40] An efficient and scalable semi-supervised framework for semantic segmentation
    Huazheng Hao
    Hui Xiao
    Junjie Xiong
    Li Dong
    Diqun Yan
    Dongtai Liang
    Jiayan Zhuang
    Chengbin Peng
    Neural Computing and Applications, 2025, 37 (7) : 5481 - 5497