Self-Supervised Pre-Training for 3-D Roof Reconstruction on LiDAR Data

被引:1
|
作者
Yang, Hongxin [1 ]
Huang, Shangfeng [1 ]
Wang, Ruisheng [1 ,2 ]
Wang, Xin [1 ]
机构
[1] Univ Calgary, Dept Geomatics Engn, Calgary, AB T2N 1N4, Canada
[2] Shenzhen Univ, Sch Architecture & Urban Planning, Shenzhen 518060, Peoples R China
关键词
Corner detection; Training; Task analysis; edge prediction; roof reconstruction; self-supervised learning;
D O I
10.1109/LGRS.2024.3362733
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Reconstructing building roofs from light detection and ranging (LiDAR) point clouds from aerial perspectives is significantly important in photogrammetry domains. This letter proposes a novel approach for 3-D real-world building roof reconstruction in Estonia, employing a two-stage self-supervised pre-training architecture to transform 3-D roof point clouds into wireframe models. We utilize a self-supervised pre-training framework that incorporates a purpose-designed and efficient self-attention mechanism to generate point-wise features. Subsequently, we develop modules for corner detection and edge prediction to classify and regress the coordinates of corner points and determine optimal edge selections, respectively, to construct the final wireframe model. The effectiveness of our approach is evaluated on real-world roof datasets, achieving corner and edge precision accuracies of 83% and 78%, respectively. In addition, fine-tuning our self-supervised pre-training method with varying ratios of labeled data, particularly with only 50% partially labeled data, attains superior performance, achieving 84% and 85% corner and edge precision, respectively.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 50 条
  • [31] MEASURING THE IMPACT OF DOMAIN FACTORS IN SELF-SUPERVISED PRE-TRAINING
    Sanabria, Ramon
    Wei-Ning, Hsu
    Alexei, Baevski
    Auli, Michael
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [32] Contrastive Self-Supervised Pre-Training for Video Quality Assessment
    Chen, Pengfei
    Li, Leida
    Wu, Jinjian
    Dong, Weisheng
    Shi, Guangming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 458 - 471
  • [33] Self-supervised pre-training in photovoltaic systems via supervisory control and data acquisition data
    Wang, Dejun
    Duan, Zhenqing
    Wang, Wenbin
    Chu, Jingchun
    Cui, Qingru
    Zhu, Runze
    Cui, Yahui
    Zhang, You
    You, Zedong
    IET CYBER-PHYSICAL SYSTEMS: THEORY & APPLICATIONS, 2023, 8 (04) : 272 - 279
  • [34] Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-training
    He, Yuting
    Yang, Guanyu
    Ge, Rongjun
    Chen, Yang
    Coatrieux, Jean-Louis
    Wang, Boyu
    Li, Shuo
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9538 - 9547
  • [35] Token Boosting for Robust Self-Supervised Visual Transformer Pre-training
    Li, Tianjiao
    Foo, Lin Geng
    Hu, Ping
    Shang, Xindi
    Rahmani, Hossein
    Yuan, Zehuan
    Liu, Jun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24027 - 24038
  • [36] Joint Encoder-Decoder Self-Supervised Pre-training for ASR
    Arunkumar, A.
    Umesh, S.
    INTERSPEECH 2022, 2022, : 3418 - 3422
  • [37] ENHANCING THE DOMAIN ROBUSTNESS OF SELF-SUPERVISED PRE-TRAINING WITH SYNTHETIC IMAGES
    Hassan, Mohamad N. C.
    Bhattacharya, Avigyan
    da Costa, Victor G. Turrisi
    Banerjee, Biplab
    Ricci, Elisa
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 5470 - 5474
  • [38] Individualized Stress Mobile Sensing Using Self-Supervised Pre-Training
    Islam, Tanvir
    Washington, Peter
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [39] Stabilizing Label Assignment for Speech Separation by Self-supervised Pre-training
    Huang, Sung-Feng
    Chuang, Shun-Po
    Liu, Da-Rong
    Chen, Yi-Chen
    Yang, Gene-Ping
    Lee, Hung-yi
    INTERSPEECH 2021, 2021, : 3056 - 3060
  • [40] Self-Supervised Pre-training for Protein Embeddings Using Tertiary Structures
    Guo, Yuzhi
    Wu, Jiaxiang
    Ma, Hehuan
    Huang, Junzhou
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6801 - 6809