Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

被引:9
|
作者
Jiang, Tengping [1 ,2 ,3 ,4 ]
Liu, Shan [1 ,2 ,3 ]
Zhang, Qinyu [1 ,2 ,3 ]
Xu, Xin [1 ,2 ,3 ]
Sun, Jian [1 ,2 ,3 ]
Wang, Yongjun [1 ,2 ,3 ]
机构
[1] Jiangsu Ctr Collaborat Innovat Geog Informat Resou, Nanjing 210023, Peoples R China
[2] Nanjing Normal Univ, Key Lab Virtual Geog Environm, Minist Educ, Nanjing 210093, Peoples R China
[3] State Key Lab Cultivat Base Geog Environm Evolut, Nanjing 210093, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
Mobile laser scanning (MLS) point clouds; Individual tree segmentation; Instance segmentation; Cylindrical voxel representation; Cylinder convolution; EXTRACTION;
D O I
10.1016/j.jag.2023.103473
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Automatic and accurate instance segmentation of street trees from point clouds is a fundamental task in urban green space research. Previous studies have achieved satisfactory tree segmentation results in simple scenarios. However, for challenging cases, including adjacent overlapping tree crowns, irregular tree shapes, and incompleteness caused by occlusion, most methods show under- or over-segmentation effects. In this study, an automated two-stage framework (tree extraction and individual tree segmentation) using vehicle-mounted mobile laser scanning (MLS) point clouds is developed to robustly detect single roadside trees. In the first stage, the ground points are filtered to reduce the processing time. Subsequently, an improved graph-based semantic segmentation network extracts roadside tree points from the urban scenes. For individual tree segmentation, a segmentation strategy combining cylindrical convolution and dynamic shift detects instance-level roadside trees. A simple road environment and two complex urban areas are used to verify the performance of the individual urban tree segmentation. The proposed method achieves 84-92% overall segmentation accuracy of the roadside tree point clouds and significantly outperforms existing methods in various challenging cases. Some applications can benefit from individual tree segmentation. For instance, the 3D green volume is calculated at the level of individual urban trees. The proposed method provides a practical solution for ecological assessment based on the 3D green volume of urban roads.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Point clouds segmentation and flood risk simulation method based on deep learning
    Jiang P.
    Wu J.
    Zhang S.
    Lai Y.
    Liu K.
    Wang C.
    Shuikexue Jinzhan/Advances in Water Science, 2024, 35 (01): : 62 - 73
  • [22] Urban vegetation segmentation using terrestrial LiDAR point clouds based on point non-local means network
    Chen, Yiping
    Wu, Rongren
    Yang, Chengzhe
    Lin, Yaojin
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105
  • [23] Using Synthetic Tree Data in Deep Learning-Based Tree Segmentation Using LiDAR Point Clouds
    Bryson, Mitch
    Wang, Feiyu
    Allworth, James
    REMOTE SENSING, 2023, 15 (09)
  • [24] A deep learning network for semantic labeling of large-scale urban point clouds
    Yang B.
    Han X.
    Dong Z.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1059 - 1067
  • [25] FGCN: Deep Feature-based Graph Convolutional Network for Semantic Segmentation of Urban 3D Point Clouds
    Khan, Saqib Ali
    Shi, Yilei
    Shahzad, Muhammad
    Zhu, Xiao Xiang
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 778 - 787
  • [26] 3D Semantic Segmentation of Large-Scale Point-Clouds in Urban Areas Using Deep Learning
    Lowphansirikul, Chakri
    Kim, Kyoung-Sook
    Vinayaraj, Poliyapram
    Tuarob, Suppawong
    2019 11TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST), 2019, : 238 - 243
  • [27] An Over-Segmentation-Based Uphill Clustering Method for Individual Trees Extraction in Urban Street Areas From MLS Data
    Li, Jintao
    Cheng, Xiaojun
    Wu, Zhenlun
    Guo, Wang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 2206 - 2221
  • [28] Vegetation segmentation using oblique photogrammetry point clouds based on RSPT network
    Hu, Hong
    Sun, Zhangyu
    Kang, Ruihong
    Wu, Yanlan
    Wang, Baoguo
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [29] Semantic Segmentation on LiDAR Point Cloud in Urban Area using Deep Learning
    Wicaksono, Satria Bagus
    Wibisono, Ari
    Jatmiko, Wisnu
    Gamal, Ahmad
    Wisesa, Hanif Arief
    2019 4TH INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS 2019), 2019, : 63 - 66
  • [30] Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage
    Pierdicca, Roberto
    Paolanti, Marina
    Matrone, Francesca
    Martini, Massimo
    Morbidoni, Christian
    Malinverni, Eva Savina
    Frontoni, Emanuele
    Lingua, Andrea Maria
    REMOTE SENSING, 2020, 12 (06)