Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

被引:0
|
作者
Huang, Shuowen [1 ]
Hu, Qingwu [1 ]
Ai, Mingyao [1 ]
Zhao, Pengcheng [1 ]
Li, Jian [2 ]
Cui, Hao [2 ]
Wang, Shaohua [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Zhengzhou Univ, Sch Geosci & Technol, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Architectural heritage; 3D semantic segmentation; Weakly supervised;
D O I
10.1016/j.autcon.2024.105831
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacherstudent framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Weakly Supervised Learning for Point Cloud Semantic Segmentation With Dual Teacher
    Yao, Baochen
    Xiao, Hui
    Zhuang, Jiayan
    Peng, Chengbin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6347 - 6354
  • [2] A survey on weakly supervised 3D point cloud semantic segmentation
    Wang, Jingyi
    Liu, Yu
    Tan, Hanlin
    Zhang, Maojun
    IET COMPUTER VISION, 2024, 18 (03) : 329 - 342
  • [3] Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning
    Sun, Tianfang
    Zhang, Zhizhong
    Tan, Xin
    Qu, Yanyun
    Xie, Yuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1838 - 1852
  • [4] Cross-Cloud Consistency for Weakly Supervised Point Cloud Semantic Segmentation
    Zhang, Yachao
    Lan, Yuxiang
    Xie, Yuan
    Li, Cuihua
    Qu, Yanyun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025,
  • [5] Weakly supervised point cloud semantic segmentation based on scene consistency
    Niu, Yingchun
    Yin, Jianqin
    Qi, Chao
    Geng, Liang
    APPLIED INTELLIGENCE, 2024, 54 (23) : 12439 - 12452
  • [6] PointMatch: A consistency training framework for weakly supervised semantic segmentation of 3D point clouds
    Wu, Yushuang
    Yan, Zizheng
    Cai, Shengcai
    Li, Guanbin
    Han, Xiaoguang
    Cui, Shuguang
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 427 - 436
  • [7] PCL: Point Contrast and Labeling for Weakly Supervised Point Cloud Semantic Segmentation
    Du, Anan
    Zhou, Tianfei
    Pang, Shuchao
    Wu, Qiang
    Zhang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8902 - 8914
  • [8] Class agnostic and specific consistency learning for weakly-supervised point cloud semantic segmentation
    Wu, Junwei
    Sun, Mingjie
    Xu, Haotian
    Jiang, Chenru
    Ma, Wuwei
    Zhang, Quan
    PATTERN RECOGNITION, 2025, 158
  • [9] GECNN for Weakly Supervised Semantic Segmentation of 3D Point Clouds
    He, Zifen
    Zhu, Shouye
    Huang, Ying
    Zhang, Yinhui
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (12) : 2237 - 2243
  • [10] Weakly Supervised 3D Point Cloud Segmentation via Multi-Prototype Learning
    Su, Yongyi
    Xu, Xun
    Jia, Kui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7723 - 7736