PCCN-MSS: Parallel Convolutional Classification Network Combined Multi-Spatial Scale and Spectral Features for UAV-Borne Hyperspectral With High Spatial Resolution Imagery

被引:3
|
作者
Jiang, Linhuan [1 ,2 ]
Zhang, Zhen [1 ,2 ]
Tang, Bo-Hui [1 ,2 ,3 ]
Huang, Lehao [1 ,2 ]
Zhang, Bingru [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Land Resource Engn, Kunming 650093, Peoples R China
[2] Yunnan Prov Dept Educ, Key Lab Plateau Remote Sensing, Kunming 650093, Peoples R China
[3] Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China
关键词
Feature extraction; Convolutional neural networks; Hyperspectral imaging; Data mining; Computational modeling; Autonomous aerial vehicles; Convolution; Feature pyramid networks (FPNs); image classification; parallel convolutional classification network; spectral attention (SA); unmanned aerial vehicle (UAV)-borne hyperspectral imagery; ATTENTION NETWORK; FUSION;
D O I
10.1109/JSTARS.2024.3370632
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral remote sensing images with high spatial resolution (H-2 imagery) have an abundant spatial-spectral information, holding tremendous potential for remote sensing fine-grained monitoring and classification. However, challenges such as high spatial heterogeneity, severe intra-class spectral variability, and poor signal-to-noise ratio especially in unmanned aerial vehicle (UAV) hyperspectral imagery constrain and hinder the performance of fine-grained classification. Convolutional neural network (CNN) emerges as a formidable and excellent tool for image mining and feature extraction, offering effective utility for land cover classification. In this article, a parallel convolutional classification network model based on multimodal filters [including independent component analysis (ICA)-two-dimensional (2-D)-FPN and spectral attention (SA)-3-D-CNN branching structures] PCCN-MSS is proposed for precise H-2 imagery classification. The ICA-2-D-FPN branch integrates ICA into 2-D-CNN to extract the multispatial scale and spectral information of H-2 imagery by feature pyramid networks, meanwhile, the SA-3-D-CNN branch is designed to extract the spatial and spectral information by combining SA mechanism and 3-D-CNN. Taking hyperspectral imagery of UAVs containing vegetation and artifactual material ground as an example, the proposed PCCN-MSS model achieves an overall accuracy of 78.18%, which outperforms by 9.58% to the compared methods. The proposed PCCN-MSS method can mitigate the classification issues of severe salt-and-pepper noise and inaccurate boundary, delivering more satisfactory classification results with robust classification performance and remarkable advantages for H-2 imagery.
引用
收藏
页码:6529 / 6543
页数:15
相关论文
共 50 条
  • [31] MS3A-Net: multi-scale and spectral-spatial attention network for hyperspectral image classification
    Dai, Mengyun
    Sun, Qi
    Dai, Luanyan
    Lin, Yaohai
    Wei, Lifang
    Yang, Changcai
    Chen, Riqing
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (19-24) : 7139 - 7160
  • [32] HYPERSPECTRAL IMAGE CLASSIFICATION VIA DOUBLE-BRANCH MULTI-SCALE SPECTRAL-SPATIAL CONVOLUTION NETWORK
    Liang, Lianhui
    Zhang, Shaoquan
    Li, Jun
    Cui, Zhi
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3588 - 3591
  • [33] SS-TMNet: Spatial-Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification
    Huang, Xiaohui
    Zhou, Yunfei
    Yang, Xiaofei
    Zhu, Xianhong
    Wang, Ke
    REMOTE SENSING, 2023, 15 (05)
  • [34] Spectral-Spatial Graph Convolutional Network with Dynamic-Synchronized Multiscale Features for Few-Shot Hyperspectral Image Classification
    Liu, Shuai
    Li, Hongfei
    Jiang, Chengji
    Feng, Jie
    REMOTE SENSING, 2024, 16 (05)
  • [35] Spectral-Spatial Classification of Few Shot Hyperspectral Image With Deep 3-D Convolutional Random Fourier Features Network
    Wang, Tingting
    Liu, Huanyu
    Li, Junbao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] A spatial-spectral fusion convolutional transformer network with contextual multi-head self-attention for hyperspectral image classification
    Wang, Wuli
    Sun, Qi
    Zhang, Li
    Ren, Peng
    Wang, Jianbu
    Ren, Guangbo
    Liu, Baodi
    NEURAL NETWORKS, 2025, 187
  • [37] A novel spectral-spatial multi-scale network for hyperspectral image classification with the Res2Net block
    Zhang, Zhongqiang
    Liu, Danhua
    Gao, Dahua
    Shi, Guangming
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (03) : 751 - 777
  • [38] A Multi-Scale Spatial Attention Region Proposal Network for High-Resolution Optical Remote Sensing Imagery
    Dong, Ruchan
    Jiao, Licheng
    Zhang, Yan
    Zhao, Jin
    Shen, Weiyan
    REMOTE SENSING, 2021, 13 (17)
  • [39] Multi-Scale Spectral-Spatial Attention Network for Hyperspectral Image Classification Combining 2D Octave and 3D Convolutional Neural Networks
    Liang, Lianhui
    Zhang, Shaoquan
    Li, Jun
    Plaza, Antonio
    Cui, Zhi
    REMOTE SENSING, 2023, 15 (07)
  • [40] URBAN SCENES CHANGE DETECTION BASED ON MULTI-SCALE IRREGULAR BAG OF VISUAL FEATURES FOR HIGH SPATIAL RESOLUTION IMAGERY
    Chen, Jiale
    Zhu, Qiqi
    Zhong, Yanfei
    Guan, Qingfeng
    Zhang, Liangpei
    Li, Deren
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1197 - 1200