Applying Fully Convolutional Architectures for Semantic Segmentation of a Single Tree Species in Urban Environment on High Resolution UAV Optical Imagery

被引:98
|
作者
Lobo Torres, Daliana [1 ]
Queiroz Feitosa, Raul [1 ]
Nigri Happ, Patrick [1 ]
Elena Cue La Rosa, Laura [1 ]
Marcato Junior, Jose [2 ]
Martins, Jose [2 ]
Ola Bressan, Patrik [3 ,4 ]
Goncalves, Wesley Nunes [2 ,4 ]
Liesenberg, Veraldo [5 ]
机构
[1] Pontifical Catholic Univ Rio De Janeiro, Dept Elect Engn, BR-22451900 Rio De Janeiro, Brazil
[2] Univ Fed Mato Grosso do Sul, Fac Engn Architecture & Urbanism & Geog, BR-79070900 Campo Grande, MS, Brazil
[3] Fed Inst Mato Grosso Sul, BR-79240000 Jardim, Brazil
[4] Univ Fed Mato Grosso do Sul, Fac Comp Sci, BR-79070900 Campo Grande, MS, Brazil
[5] Santa Catarina State Univ, Dept Forest Engn, BR-88520000 Lages, SC, Brazil
关键词
deep learning; fully convolution neural networks; semantic segmentation; unmanned aerial vehicle (UAV); AERIAL VEHICLES; LANDSAT-TM; CLASSIFICATION;
D O I
10.3390/s20020563
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study proposes and evaluates five deep fully convolutional networks (FCNs) for the semantic segmentation of a single tree species: SegNet, U-Net, FC-DenseNet, and two DeepLabv3+ variants. The performance of the FCN designs is evaluated experimentally in terms of classification accuracy and computational load. We also verify the benefits of fully connected conditional random fields (CRFs) as a post-processing step to improve the segmentation maps. The analysis is conducted on a set of images captured by an RGB camera aboard a UAV flying over an urban area. The dataset also contains a mask that indicates the occurrence of an endangered species called Dipteryx alata Vogel, also known as cumbaru, taken as the species to be identified. The experimental analysis shows the effectiveness of each design and reports average overall accuracy ranging from 88.9% to 96.7%, an F1-score between 87.0% and 96.1%, and IoU from 77.1% to 92.5%. We also realize that CRF consistently improves the performance, but at a high computational cost.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Symmetrical Dense-Shortcut Deep Fully Convolutional Networks for Semantic Segmentation of Very-High-Resolution Remote Sensing Images
    Chen, Guanzhou
    Zhang, Xiaodong
    Wang, Qing
    Dai, Fan
    Gong, Yuanfu
    Zhu, Kun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) : 1633 - 1644
  • [32] Single Shot MultiBox Detector for Urban Plantation Single Tree Detection and Location With High-Resolution Remote Sensing Imagery
    Zheng, Yueyuan
    Wu, Gang
    FRONTIERS IN ENVIRONMENTAL SCIENCE, 2021, 9
  • [33] Individual Building Rooftop and Tree Crown Segmentation from High-Resolution Urban Aerial Optical Images
    Jiao, Jichao
    Deng, Zhongliang
    JOURNAL OF SENSORS, 2016, 2016
  • [34] A Novel Object-Based Deep Learning Framework for Semantic Segmentation of Very High-Resolution Remote Sensing Data: Comparison with Convolutional and Fully Convolutional Networks
    Papadomanolaki, Maria
    Vakalopoulou, Maria
    Karantzalos, Konstantinos
    REMOTE SENSING, 2019, 11 (06)
  • [35] Using high resolution UAV thermal imagery to assess the variability in the water status of five fruit tree species within a commercial orchard
    Gonzalez-Dugo, V.
    Zarco-Tejada, P.
    Nicolas, E.
    Nortes, P. A.
    Alarcon, J. J.
    Intrigliolo, D. S.
    Fereres, E.
    PRECISION AGRICULTURE, 2013, 14 (06) : 660 - 678
  • [36] Using high resolution UAV thermal imagery to assess the variability in the water status of five fruit tree species within a commercial orchard
    V. Gonzalez-Dugo
    P. Zarco-Tejada
    E. Nicolás
    P. A. Nortes
    J. J. Alarcón
    D. S. Intrigliolo
    E. Fereres
    Precision Agriculture, 2013, 14 : 660 - 678
  • [37] Mapping Urban Green Spaces at the Metropolitan Level Using Very High Resolution Satellite Imagery and Deep Learning Techniques for Semantic Segmentation
    Huerta, Roberto E.
    Yepez, Fabiola D.
    Lozano-Garcia, Diego F.
    Guerra Cobian, Victor H.
    Ferrino Fierro, Adrian L.
    de Leon Gomez, Hector
    Cavazos Gonzalez, Ricardo A.
    Vargas-Martinez, Adriana
    REMOTE SENSING, 2021, 13 (11)
  • [38] INDIVIDUAL TREE SEGMENTATION OVER LARGE AREAS USING AIRBORNE LIDAR POINT CLOUD AND VERY HIGH RESOLUTION OPTICAL IMAGERY
    Qin, Yuchu
    Ferraz, Antonio
    Mallet, Clement
    Iovan, Corina
    2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 800 - 803
  • [39] Dense Semantic Labeling of Very-High-Resolution Aerial Imagery and LiDAR with Fully-Convolutional Neural Networks and Higher-Order CRFs
    Liu, Yansong
    Piramanayagam, Sankaranarayanan
    Monteiro, Sildomar T.
    Saber, Eli
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1561 - 1570
  • [40] Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
    Qin, Yuchu
    Wu, Yunchao
    Li, Bin
    Gao, Shuai
    Liu, Miao
    Zhan, Yulin
    SENSORS, 2019, 19 (05)