Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

被引:0
|
作者
Huang, Shuowen [1 ]
Hu, Qingwu [1 ]
Ai, Mingyao [1 ]
Zhao, Pengcheng [1 ]
Li, Jian [2 ]
Cui, Hao [2 ]
Wang, Shaohua [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Zhengzhou Univ, Sch Geosci & Technol, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Architectural heritage; 3D semantic segmentation; Weakly supervised;
D O I
10.1016/j.autcon.2024.105831
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacherstudent framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] 3D Point Cloud Semantic Segmentation Network Based on Coding Feature Learning
    Tong, Guofeng
    Liu, Yongxu
    Peng, Hao
    Shao, Yuyuan
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (04): : 313 - 326
  • [32] Supervised Learning for Semantic Segmentation of 3D LiDAR Data
    Mei, Jilin
    Chen, Jiayu
    Yao, Wen
    Zhao, Xijun
    Zhao, Huijing
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1491 - 1498
  • [33] SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network
    Cheng, Mingmei
    Hui, Le
    Xie, Jin
    Yang, Jian
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1140 - 1147
  • [34] WSSIC-Net: Weakly-Supervised Semantic Instance Completion of 3D Point Cloud Scenes
    Fu, Zhiheng
    Guo, Yulan
    Chen, Minglin
    Hu, Qingyong
    Laga, Hamid
    Boussaid, Farid
    Bennamoun, Mohammed
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 2008 - 2019
  • [35] Exploiting Supervised Learning for 3D Model Semantic Segmentation Using Multispectral Data
    Ioannakis, George
    Arnaoutoglou, Fotis
    Koutsoudis, Anestis
    Chamzas, Christodoulos
    2019 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2019, : 965 - 968
  • [36] A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation
    Sarker, Sushmita
    Sarker, Prithul
    Stone, Gunner
    Gorman, Ryan
    Tavakkoli, Alireza
    Bebis, George
    Sattarvand, Javad
    MACHINE VISION AND APPLICATIONS, 2024, 35 (04)
  • [37] Transfer Learning Based Semantic Segmentation for 3D Object Detection from Point Cloud
    Imad, Muhammad
    Doukhi, Oualid
    Lee, Deok-Jin
    SENSORS, 2021, 21 (12)
  • [38] A 3D Semantic Segmentation Method for Large-Scale Point Cloud on Deep Learning
    Liu, Sihan
    Zhang, Wenyu
    Zhang, Yujun
    Wang, Zhijian
    Gao, Dongxiang
    ENGINEERING LETTERS, 2023, 31 (04) : 1667 - 1674
  • [39] 3D point cloud semantic segmentation: state of the art and challenges
    Wang Y.
    Hu Y.
    Kong Q.
    Zeng H.
    Zhang L.
    Fan B.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2023, 45 (10): : 1653 - 1664
  • [40] Few-shot 3D Point Cloud Semantic Segmentation
    Zhao, Na
    Chua, Tat-Seng
    Lee, Gim Hee
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8869 - 8878