Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

被引:0
|
作者
Huang, Shuowen [1 ]
Hu, Qingwu [1 ]
Ai, Mingyao [1 ]
Zhao, Pengcheng [1 ]
Li, Jian [2 ]
Cui, Hao [2 ]
Wang, Shaohua [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Zhengzhou Univ, Sch Geosci & Technol, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Architectural heritage; 3D semantic segmentation; Weakly supervised;
D O I
10.1016/j.autcon.2024.105831
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacherstudent framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Spatial Adaptive Fusion Consistency Contrastive Constraint: Weakly Supervised Building Facade Point Cloud Semantic Segmentation
    Su, Yanfei
    Cheng, Ming
    Yuan, Zhimin
    Liu, Weiquan
    Zeng, Wankang
    Zhang, Zhihong
    Wang, Cheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds
    Deng, Shuang
    Dong, Qiulei
    Liu, Bo
    Hu, Zhanyi
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 9214 - 9220
  • [23] SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds
    Hu, Qingyong
    Yang, Bo
    Fang, Guangchi
    Guo, Yulan
    Leonardis, Ales
    Trigoni, Niki
    Markham, Andrew
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 600 - 619
  • [24] Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation on Point Clouds
    Wei, Jiacheng
    Lin, Guosheng
    Yap, Kim-Hui
    Hung, Tzu-Yi
    Xie, Lihua
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4383 - 4392
  • [25] Multi-Scale Classification and Contrastive Regularization: Weakly Supervised Large-Scale 3D Point Cloud Semantic Segmentation
    Wang, Jingyi
    He, Jingyang
    Liu, Yu
    Chen, Chen
    Zhang, Maojun
    Tan, Hanlin
    REMOTE SENSING, 2024, 16 (17)
  • [26] Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage
    Pierdicca, Roberto
    Paolanti, Marina
    Matrone, Francesca
    Martini, Massimo
    Morbidoni, Christian
    Malinverni, Eva Savina
    Frontoni, Emanuele
    Lingua, Andrea Maria
    REMOTE SENSING, 2020, 12 (06)
  • [27] Joint Learning of 2D-3D Weakly Supervised Semantic Segmentation
    Kweon, Hyeokjun
    Yoon, Kuk-Jin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [28] 3d indoor point cloud semantic segmentation using image and voxel
    Yeom S.-S.
    Ha J.-E.
    Ha, Jong-Eun (jeha@seoultech.ac.kr), 1600, Institute of Control, Robotics and Systems (27): : 1000 - 1007
  • [29] 3D semantic segmentation using deep learning for large-scale indoor point cloud
    Chen Hui
    Xu Peng
    Zuo Yipeng
    Wang Weina
    PROCEEDINGS OF 2019 14TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), 2019, : 1650 - 1655
  • [30] Research of Deep Learning-Based Semantic Segmentation for 3D Point Cloud
    Wang, Tao
    Wang, Wenju
    Cai, Yu
    Computer Engineering and Applications, 2024, 57 (23) : 18 - 26