Multi-Branch Deep Learning Framework for Land Scene Classification in Satellite Imagery

被引:20
|
作者
Khan, Sultan Daud [1 ]
Basalamah, Saleh [2 ]
机构
[1] Natl Univ Technol, Dept Comp Sci, Islamabad 44000, Pakistan
[2] Umm Al Qura Univ, Dept Comp Engn, Mecca 24382, Saudi Arabia
关键词
scene classification; aerial imagery; deep learning; multi-scale model; remote sensing; scene understanding; BENCHMARK; SALIENCY; NETWORK; COVER; MODEL;
D O I
10.3390/rs15133408
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Land scene classification in satellite imagery has a wide range of applications in remote surveillance, environment monitoring, remote scene analysis, Earth observations and urban planning. Due to immense advantages of the land scene classification task, several methods have been proposed during recent years to automatically classify land scenes in remote sensing images. Most of the work focuses on designing and developing deep networks to identify land scenes from high-resolution satellite images. However, these methods face challenges in identifying different land scenes. Complex texture, cluttered background, extremely small size of objects and large variations in object scale are the common challenges that restrict the models to achieve high performance. To tackle these challenges, we propose a multi-branch deep learning framework that efficiently combines global contextual features with multi-scale features to identify complex land scenes. Generally, the framework consists of two branches. The first branch extracts global contextual information from different regions of the input image, and the second branch exploits a fully convolutional network (FCN) to extract multi-scale local features. The performance of the proposed framework is evaluated on three benchmark datasets, UC-Merced, SIRI-WHU, and EuroSAT. From the experiments, we demonstrate that the framework achieves superior performance compared to other similar models.
引用
收藏
页数:25
相关论文
共 50 条
  • [41] Predictive Ecological Land Classification From Multi-Decadal Satellite Imagery
    Sousa, Daniel
    Davis, Frank W.
    Easterday, Kelly
    Reynolds, Mark
    Riege, Laura
    Butterfield, H. Scott
    Katkowski, Moses
    FRONTIERS IN FORESTS AND GLOBAL CHANGE, 2022, 5
  • [42] Learning a Multi-Branch Neural Network from Multiple Sources for Knowledge Adaptation in Remote Sensing Imagery
    Al Rahhal, Mohamad M.
    Bazi, Yakoub
    Abdullah, Taghreed
    Mekhalfi, Mohamed L.
    AlHichri, Haikel
    Zuair, Mansour
    REMOTE SENSING, 2018, 10 (12)
  • [43] Multi-class classification of brain tumour magnetic resonance images using multi-branch network with inception block and five-fold cross validation deep learning framework
    Rastogi, Deependra
    Johri, Prashant
    Tiwari, Varun
    Elngar, Ahmed A.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 88
  • [44] Urban Land Use and Land Cover Classification Using Novel Deep Learning Models Based on High Spatial Resolution Satellite Imagery
    Zhang, Pengbin
    Ke, Yinghai
    Zhang, Zhenxin
    Wang, Mingli
    Li, Peng
    Zhang, Shuangyue
    SENSORS, 2018, 18 (11)
  • [45] An Integrated Parallel Inner Deep Learning Models Information Fusion With Bayesian Optimization for Land Scene Classification in Satellite Images
    Hamza, Ameer
    Khan, Muhammad Attique
    Ur Rehman, Shams
    Albarakati, Hussain Mobarak
    Alroobaea, Roobaea
    Baqasah, Abdullah M.
    Alhaisoni, Majed
    Masood, Anum
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 9888 - 9903
  • [46] One-Dimensional Convolutional Multi-branch Fusion Network for EEG-Based Motor Imagery Classification
    Liu, Xiaoguang
    Zhang, Mingjin
    Xiong, Shicheng
    Wang, Xiaodong
    Liang, Tie
    Li, Jun
    Xiong, Peng
    Wang, Hongrui
    Liu, Xiuling
    IRBM, 2023, 44 (06)
  • [47] A Multi-Branch 3D Convolutional Neural Network for EEG-Based Motor Imagery Classification
    Zhao, Xinqiao
    Zhang, Hongmiao
    Zhu, Guilin
    You, Fengxiang
    Kuang, Shaolong
    Sun, Lining
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (10) : 2164 - 2177
  • [48] BCLNet: Boundary contrastive learning with gated attention feature fusion and multi-branch spatial-channel reconstruction for land use classification
    Yue, Chenke
    Zhang, Yin
    Yan, Junhua
    Luo, Zhaolong
    Liu, Yong
    Guo, Pengyu
    KNOWLEDGE-BASED SYSTEMS, 2024, 302
  • [49] Multi-branch spatial-temporal-spectral convolutional neural networks for multi-task motor imagery EEG classification
    Cai, Zikun
    Luo, Tian-jian
    Cao, Xuan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [50] Study of multi-branch structure of Universal Learning Networks
    Mabu, Shingo
    Shimada, Kaoru
    Hirasawa, Kotaro
    Hu, Jinglu
    APPLIED SOFT COMPUTING, 2009, 9 (01) : 393 - 403