A local enhanced mamba network for hyperspectral image classification

被引:6
|
作者
Wang, Chuanzhi [1 ]
Huang, Jun [1 ]
Lv, Mingyun [1 ]
Du, Huafei [1 ]
Wu, Yongmei [1 ]
Qin, Ruiru [1 ]
机构
[1] Beihang Univ, Sch Aeronaut Sci & Engn, Beijing 100191, Peoples R China
关键词
Hyperspectral image classification; Multi-directional scan mechanism; Local spatial feature extraction; Mamba; Transformer; TRANSFORMER;
D O I
10.1016/j.jag.2024.104092
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Deep learning has significantly advanced hyperspectral image (HSI) classification, primarily due to its robust nonlinear feature extraction capabilities. The vision transformer has achieved notable performance but is limited by the quadratic computational burden of its self-attention mechanism. Recently, a network based on state space model named Mamba, has attracted considerable attention for its linear complexity and commendable performance. Nevertheless, Mamba was originally designed for one-dimensional causal sequence modeling, and its effectiveness in inherent non-causal HSI classification remains to be fully validated. To address this issue, we propose a novel Local Enhanced Mamba (LE-Mamba) network for hyperspectral image classification, which mainly comprises a Local Enhanced Spatial SSM (LES-S6), a Central Region Spectral SSM (CRS-S6), and a MultiScale Convolutional Gated Unit (MSCGU). The LES-S6 improves non-causal local feature extraction by incorporating a multi-directional local spatial scanning mechanism. Additionally, the CRS-S6 employs a bidirectional scanning mechanism in the spectral dimension to capture fine spectral details and integrate them with spatial information. The MSCGU utilizes a convolutional gating mechanism to aggregate features from diverse scanning routes and extract high-level semantic information. The overall accuracies of LE-Mamba on Indian Pines, WHUHi-HanChuan, WHU-Hi-LongKou, and Pavia University datasets are 99.16 %, 98.16 %, 99.57 %, and 99.63 %, respectively. Extensive experimental results on these four public datasets demonstrate that the LE-Mamba outperforms eight mainstream deep learning models in classification performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] QWT Enhanced SVM for Hyperspectral Image Classification
    Shen, Yue
    Feng, Hongqi
    Wang, Qiang
    Liu, Yipeng
    he, Zhi
    2014 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC) PROCEEDINGS, 2014, : 1454 - 1458
  • [32] LESSFormer: Local-Enhanced Spectral-Spatial Transformer for Hyperspectral Image Classification
    Zou, Jiaqi
    He, Wei
    Zhang, Hongyan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [33] LOCAL DETAIL ENHANCED HYPERSPECTRAL IMAGE VISUALIZATION
    Fang, Jialu
    Qian, Yuntao
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 1092 - 1095
  • [34] Hyperspectral image classification based on local feature decoupling and hybrid attention SpectralFormer network
    Zhao, Yunji
    Bao, Wenming
    Xu, Xiaozhuo
    Zhou, Yuhang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (05) : 1727 - 1754
  • [35] A non-local capsule neural network for hyperspectral remote sensing image classification
    Lei, Runmin
    Zhang, Chunju
    Du, Shihong
    Wang, Chen
    Zhang, Xueying
    Zheng, Hui
    Huang, Jianwei
    Yu, Min
    REMOTE SENSING LETTERS, 2021, 12 (01) : 77 - 86
  • [36] Double-Branch Local Context Feature Extraction Network for Hyperspectral Image Classification
    Cui, Ying
    Li, Wenshan
    Chen, Liwei
    Gao, Shan
    Wang, Liguo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [37] Hierarchical structural graph neural network with local relation enhancement for hyperspectral image classification
    Cao, Feilong
    Huang, Xiaomei
    Yang, Bing
    Ye, Hailiang
    DIGITAL SIGNAL PROCESSING, 2024, 146
  • [38] Hyperspectral Image Classification With Squeeze Multibias Network
    Fang, Leyuan
    Liu, Guangyun
    Li, Shutao
    Ghamisi, Pedram
    Benediktsson, Jon Atli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (03): : 1291 - 1301
  • [39] Hypergraph convolutional network for hyperspectral image classification
    Qin Xu
    Jing Lin
    Bo Jiang
    Jinpei Liu
    Bin Luo
    Neural Computing and Applications, 2023, 35 : 21863 - 21882
  • [40] HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON PCA NETWORK
    Wang, Fan
    Zhang, Rong
    Wu, Qian
    2016 8TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2016,