Applying Fully Convolutional Architectures for Semantic Segmentation of a Single Tree Species in Urban Environment on High Resolution UAV Optical Imagery

被引:98
|
作者
Lobo Torres, Daliana [1 ]
Queiroz Feitosa, Raul [1 ]
Nigri Happ, Patrick [1 ]
Elena Cue La Rosa, Laura [1 ]
Marcato Junior, Jose [2 ]
Martins, Jose [2 ]
Ola Bressan, Patrik [3 ,4 ]
Goncalves, Wesley Nunes [2 ,4 ]
Liesenberg, Veraldo [5 ]
机构
[1] Pontifical Catholic Univ Rio De Janeiro, Dept Elect Engn, BR-22451900 Rio De Janeiro, Brazil
[2] Univ Fed Mato Grosso do Sul, Fac Engn Architecture & Urbanism & Geog, BR-79070900 Campo Grande, MS, Brazil
[3] Fed Inst Mato Grosso Sul, BR-79240000 Jardim, Brazil
[4] Univ Fed Mato Grosso do Sul, Fac Comp Sci, BR-79070900 Campo Grande, MS, Brazil
[5] Santa Catarina State Univ, Dept Forest Engn, BR-88520000 Lages, SC, Brazil
关键词
deep learning; fully convolution neural networks; semantic segmentation; unmanned aerial vehicle (UAV); AERIAL VEHICLES; LANDSAT-TM; CLASSIFICATION;
D O I
10.3390/s20020563
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study proposes and evaluates five deep fully convolutional networks (FCNs) for the semantic segmentation of a single tree species: SegNet, U-Net, FC-DenseNet, and two DeepLabv3+ variants. The performance of the FCN designs is evaluated experimentally in terms of classification accuracy and computational load. We also verify the benefits of fully connected conditional random fields (CRFs) as a post-processing step to improve the segmentation maps. The analysis is conducted on a set of images captured by an RGB camera aboard a UAV flying over an urban area. The dataset also contains a mask that indicates the occurrence of an endangered species called Dipteryx alata Vogel, also known as cumbaru, taken as the species to be identified. The experimental analysis shows the effectiveness of each design and reports average overall accuracy ranging from 88.9% to 96.7%, an F1-score between 87.0% and 96.1%, and IoU from 77.1% to 92.5%. We also realize that CRF consistently improves the performance, but at a high computational cost.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] APPLICATION OF UNET FULLY CONVOLUTIONAL NEURAL NETWORK TO IMPERVIOUS SURFACE SEGMENTATION IN URBAN ENVIRONMENT FROM HIGH RESOLUTION SATELLITE IMAGERY
    McGlinchy, Joe
    Johnson, Brian
    Muller, Brian
    Joseph, Maxwell
    Diaz, Jeremy
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3915 - 3918
  • [2] Urban UAV Images Semantic Segmentation Based on Fully Convolutional Networks with Digital Surface Models
    Zhang, Bowen
    Kong, Yingying
    Leung, Henry
    Xing, Shiyu
    2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2019, : 1 - 6
  • [3] Incorporating convolutional and transformer architectures to enhance semantic segmentation of fine-resolution urban images
    Yu, Xizi
    Li, Shuang
    Zhang, Yu
    EUROPEAN JOURNAL OF REMOTE SENSING, 2024, 57 (01)
  • [4] Comprehensive Semantic Segmentation on High Resolution UAV Imagery for Natural Disaster Damage Assessment
    Chowdhury, Tashnim
    Rahnemoonfar, Maryam
    Murphy, Robin
    Fernandes, Odair
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3904 - 3913
  • [5] Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery
    Li, Qi
    Cai, Jiaxin
    Luo, Jiexin
    Yu, Yuanlong
    Gu, Jason
    Pan, Jia
    Liu, Wenxi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1708 - 1715
  • [6] Mapping forest tree species in high resolution UAV-based RGB-imagery by means of convolutional neural networks
    Schiefer, Felix
    Kattenborn, Teja
    Frick, Annett
    Frey, Julian
    Schall, Peter
    Koch, Barbara
    Schmidtlein, Sebastian
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 170 : 205 - 215
  • [7] Watershed segmentation and classification of tree species using high resolution forest imagery
    Kanda, F
    Kubo, M
    Muramoto, K
    IGARSS 2004: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM PROCEEDINGS, VOLS 1-7: SCIENCE FOR SOCIETY: EXPLORING AND MANAGING A CHANGING PLANET, 2004, : 3822 - 3825
  • [8] REGISTRATION OF HIGH RESOLUTION SAR AND OPTICAL SATELLITE IMAGERY USING FULLY CONVOLUTIONAL NETWORKS
    Hoffmann, Stefan
    Brust, Clemens-Alexander
    Shadaydeh, Maha
    Denzler, Joachim
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5152 - 5155
  • [9] Consumer-grade UAV imagery facilitates semantic segmentation of species-rich savanna tree layers
    Popp, Manuel R.
    Kalwij, Jesse M.
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [10] Consumer-grade UAV imagery facilitates semantic segmentation of species-rich savanna tree layers
    Manuel R. Popp
    Jesse M. Kalwij
    Scientific Reports, 13 (1)