Deep Learning-Based Target Point Localization for UAV Inspection of Point Cloud Transmission Towers

被引:0
|
作者
Li, Xuhui [1 ,2 ]
Li, Yongrong [1 ]
Chen, Yiming [1 ]
Zhang, Geng [1 ]
Liu, Zhengjun [1 ]
机构
[1] Chinese Acad Surveying & Mapping, Beijing 100036, Peoples R China
[2] Lanzhou Jiaotong Univ, Fac Geomat, Lanzhou 730070, Peoples R China
关键词
deep learning; point cloud; transmission tower; UAV inspection; part segmentation; instance segmentation; target point localization; attention mechanism;
D O I
10.3390/rs16050817
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV transmission tower inspection is the use of UAV technology for regular inspection and troubleshooting of towers on transmission lines, which helps to improve the safety and reliability of transmission lines and ensures the stability of the power supply. From the traditional manual tower boarding to the current way of manually selecting target camera shooting points from 3D point clouds to plan the inspection path of the UAV, operational efficiency has drastically improved. However, indoor planning work is still labor-consuming and expensive. In this paper, a deep learning-based point cloud transmission tower segmentation (PCTTS) model combined with the corresponding target point localization algorithm is proposed for automatic segmentation of transmission tower point cloud data and automatically localizing the key inspection component as the target point for UAV inspection. First, we utilize octree sampling with unit ball normalization to simplify the data and ensure translation invariance before putting the data into the model. In the feature extraction stage, we encode the point set information and combine Euclidean distance and cosine similarity features to ensure rotational invariance. On this basis, we adopt multi-scale feature extraction, construct a local coordinate system, and introduce the offset-attention mechanism to enhance model performance further. Then, after the feature propagation module, gradual up-sampling is used to obtain the features of each point to complete the point cloud segmentation. Finally, combining the segmentation results with the target point localization algorithm completes the automatic extraction of UAV inspection target points. The method has been applied to six kinds of transmission tower point cloud data of part segmentation results and three kinds of transmission tower point cloud data of instance segmentation results. The experimental results show that the model achieves mIOU of 94.1% on the self-built part segmentation dataset and 86.9% on the self-built instance segmentation dataset, and the segmentation accuracy outperforms that of the methods for point cloud segmentation, such as PointNet++, DGCNN, Point Transformer, and PointMLP. Meanwhile, the experimental results of UAV inspection target point localization also verify the method's effectiveness in this paper.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] A point cloud segmentation method for power lines and towers based on a combination of multiscale density features and point-based deep learning
    Zhao, Wenbo
    Dong, Qing
    Zuo, Zhengli
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) : 620 - 644
  • [22] LEARNING-BASED RATE CONTROL FOR LEARNING-BASED POINT CLOUD GEOMETRY CODING
    Ruivo, Manuel
    Guarda, Andre F. R.
    Pereira, Fernando
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 251 - 255
  • [23] Research and application on deep learning-based point cloud completion for marine structures with point coordinate fusion and coordinate-supervised point cloud generator
    Han, Shuo
    Yu, Shengqi
    Zhang, Xiaobo
    Zhang, Luotao
    Ran, Chunqing
    Zhang, Qianran
    Li, Hongyu
    MEASUREMENT, 2025, 242
  • [24] Learning-Based Sampling Method for Point Cloud Segmentation
    An, Yi
    Wang, Jian
    He, Lijun
    Li, Fan
    IEEE SENSORS JOURNAL, 2024, 24 (15) : 24140 - 24151
  • [25] ON BLOCK PREDICTION FOR LEARNING-BASED POINT CLOUD COMPRESSION
    Lazzarotto, Davi
    Alexiou, Evangelos
    Ebrahimi, Touradj
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3378 - 3382
  • [26] Research on deep learning-based point cloud semantic segmentation for offshore drilling platforms
    Yu, Hao
    Zhang, Xiaobo
    Zhang, Luotao
    Ran, Chunqing
    OCEAN ENGINEERING, 2024, 301
  • [27] Unsupervised Deep learning-based Point Cloud Detection for Railway Foreign Object Intrusion
    Song, Haifeng
    Song, Xiying
    Zhou, Min
    Liu, Ling
    Dong, Hairong
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [28] Deep learning-based low overlap point cloud registration for complex scenario: The review
    Zhao, Yuehua
    Zhang, Jiguang
    Xu, Shibiao
    Ma, Jie
    INFORMATION FUSION, 2024, 107
  • [29] A Comprehensive Deep Learning-Based Outlier Removal Method for Multibeam Bathymetric Point Cloud
    Long, Jiawei
    Zhang, Hongmei
    Zhao, Jianhu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [30] Deep Learning-Based Classification of Large-Scale Airborne LiDAR Point Cloud
    Turgeon-Pelchat, Mathieu
    Foucher, Samuel
    Bouroubi, Yacine
    CANADIAN JOURNAL OF REMOTE SENSING, 2021, 47 (03) : 381 - 395