Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

被引:9
|
作者
Jiang, Tengping [1 ,2 ,3 ,4 ]
Liu, Shan [1 ,2 ,3 ]
Zhang, Qinyu [1 ,2 ,3 ]
Xu, Xin [1 ,2 ,3 ]
Sun, Jian [1 ,2 ,3 ]
Wang, Yongjun [1 ,2 ,3 ]
机构
[1] Jiangsu Ctr Collaborat Innovat Geog Informat Resou, Nanjing 210023, Peoples R China
[2] Nanjing Normal Univ, Key Lab Virtual Geog Environm, Minist Educ, Nanjing 210093, Peoples R China
[3] State Key Lab Cultivat Base Geog Environm Evolut, Nanjing 210093, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
Mobile laser scanning (MLS) point clouds; Individual tree segmentation; Instance segmentation; Cylindrical voxel representation; Cylinder convolution; EXTRACTION;
D O I
10.1016/j.jag.2023.103473
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Automatic and accurate instance segmentation of street trees from point clouds is a fundamental task in urban green space research. Previous studies have achieved satisfactory tree segmentation results in simple scenarios. However, for challenging cases, including adjacent overlapping tree crowns, irregular tree shapes, and incompleteness caused by occlusion, most methods show under- or over-segmentation effects. In this study, an automated two-stage framework (tree extraction and individual tree segmentation) using vehicle-mounted mobile laser scanning (MLS) point clouds is developed to robustly detect single roadside trees. In the first stage, the ground points are filtered to reduce the processing time. Subsequently, an improved graph-based semantic segmentation network extracts roadside tree points from the urban scenes. For individual tree segmentation, a segmentation strategy combining cylindrical convolution and dynamic shift detects instance-level roadside trees. A simple road environment and two complex urban areas are used to verify the performance of the individual urban tree segmentation. The proposed method achieves 84-92% overall segmentation accuracy of the roadside tree point clouds and significantly outperforms existing methods in various challenging cases. Some applications can benefit from individual tree segmentation. For instance, the 3D green volume is calculated at the level of individual urban trees. The proposed method provides a practical solution for ecological assessment based on the 3D green volume of urban roads.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] A Classification-Segmentation Framework for the Detection of Individual Trees in Dense MMS Point Cloud Data Acquired in Urban Areas
    Weinmann, Martin
    Weinmann, Michael
    Mallet, Clement
    Bredif, Mathieu
    REMOTE SENSING, 2017, 9 (03)
  • [42] A classification-segmentation framework for the detection of individual trees in dense MMS point cloud data acquired in urban areas
    Weinmann M.
    Weinmann M.
    Mallet C.
    Brédif M.
    Weinmann, Martin (martin.weinmann@kit.edu), 2017, MDPI AG (09)
  • [43] Deep Learning Based Underwater Image Enhancement Using Deep Convolution Neural Network
    Ray, Sharmita
    Baghel, Amit
    Bhatia, Vimal
    2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [44] Deep learning for conifer/deciduous classification of airborne LiDAR 3D point clouds representing individual trees
    Hamraz, Hamid
    Jacobs, Nathan B.
    Contreras, Marco A.
    Clark, Chase H.
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 158 : 219 - 230
  • [45] An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
    Yang, Jian
    Gan, Ruilin
    Luo, Binhan
    Wang, Ao
    Shi, Shuo
    Du, Lin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 6561 - 6576
  • [46] Deep Learning Based Airway Segmentation Using Key Point Prediction
    Park, Jinyoung
    Hwang, JaeJoon
    Ryu, Jihye
    Nam, Inhye
    Kim, Sol-A
    Cho, Bong-Hae
    Shin, Sang-Hun
    Lee, Jae-Yeol
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [47] SEGMENTATION OF INDIVIDUAL TREES BASED ON A POINT CLOUD CLUSTERING METHOD USING AIRBORNE LIDAR DATA
    Li, Shihua
    Su, Lian
    Liu, Yuhan
    He, Ze
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 7520 - 7523
  • [48] Hierarchical Point Cloud Transformer: A Unified Vegetation Semantic Segmentation Model for Multisource Point Clouds Based on Deep Learning
    Qiang, Xiaoyong
    He, Weibing
    Chen, Shengyi
    Lv, Qingzhe
    Huang, Fang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 16
  • [49] Automated semantic segmentation of 3D point clouds of railway tunnel using deep learning
    Park, Jeongjun
    Kim, Byung-Kyu
    Lee, Jun S.
    Yoo, Mintaek
    Lee, Il-Wha
    Ryu, Young-Moo
    PROCEEDINGS OF THE ITA-AITES WORLD TUNNEL CONGRESS 2023, WTC 2023: Expanding Underground-Knowledge and Passion to Make a Positive Impact on the World, 2023, : 2844 - 2852
  • [50] Sensor Agnostic Semantic Segmentation of Structurally Diverse and Complex Forest Point Clouds Using Deep Learning
    Krisanski, Sean
    Taskhiri, Mohammad Sadegh
    Gonzalez Aracil, Susana
    Herries, David
    Turner, Paul
    REMOTE SENSING, 2021, 13 (08)