A local enhanced mamba network for hyperspectral image classification

被引:6
|
作者
Wang, Chuanzhi [1 ]
Huang, Jun [1 ]
Lv, Mingyun [1 ]
Du, Huafei [1 ]
Wu, Yongmei [1 ]
Qin, Ruiru [1 ]
机构
[1] Beihang Univ, Sch Aeronaut Sci & Engn, Beijing 100191, Peoples R China
关键词
Hyperspectral image classification; Multi-directional scan mechanism; Local spatial feature extraction; Mamba; Transformer; TRANSFORMER;
D O I
10.1016/j.jag.2024.104092
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Deep learning has significantly advanced hyperspectral image (HSI) classification, primarily due to its robust nonlinear feature extraction capabilities. The vision transformer has achieved notable performance but is limited by the quadratic computational burden of its self-attention mechanism. Recently, a network based on state space model named Mamba, has attracted considerable attention for its linear complexity and commendable performance. Nevertheless, Mamba was originally designed for one-dimensional causal sequence modeling, and its effectiveness in inherent non-causal HSI classification remains to be fully validated. To address this issue, we propose a novel Local Enhanced Mamba (LE-Mamba) network for hyperspectral image classification, which mainly comprises a Local Enhanced Spatial SSM (LES-S6), a Central Region Spectral SSM (CRS-S6), and a MultiScale Convolutional Gated Unit (MSCGU). The LES-S6 improves non-causal local feature extraction by incorporating a multi-directional local spatial scanning mechanism. Additionally, the CRS-S6 employs a bidirectional scanning mechanism in the spectral dimension to capture fine spectral details and integrate them with spatial information. The MSCGU utilizes a convolutional gating mechanism to aggregate features from diverse scanning routes and extract high-level semantic information. The overall accuracies of LE-Mamba on Indian Pines, WHUHi-HanChuan, WHU-Hi-LongKou, and Pavia University datasets are 99.16 %, 98.16 %, 99.57 %, and 99.63 %, respectively. Extensive experimental results on these four public datasets demonstrate that the LE-Mamba outperforms eight mainstream deep learning models in classification performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] CLASSIFICATION BASED ON CAPSULE NETWORK WITH HYPERSPECTRAL IMAGE
    Ma, Yi
    Zheng, Zezhong
    Guo, Zhengqiang
    Mou, Fan
    Zhou, Fangrong
    Kong, Rui
    Hou, Ankai
    Zhu, Mingcang
    He, Yong
    Ren, Juan
    Chen, Huaixin
    Liu, Zhigang
    Zhou, Guoqing
    Li, Jiang
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2750 - 2753
  • [42] A Full Tensor Network for Hyperspectral Image Classification
    Zhang, Wei-Tao
    Li, Yi-Bang
    Zheng, Sheng-Di
    Liu, Lu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [43] Adaptable Convolutional Network for Hyperspectral Image Classification
    Paoletti, Mercedes E.
    Haut, Juan M.
    REMOTE SENSING, 2021, 13 (18)
  • [44] Matrix capsule network for hyperspectral image classification
    Wang, Zhengyan
    Ling, Qiang
    Li, Zhaoxu
    Lin, Zaiping
    Wu, Jing
    AOPC 2020: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2020, 11567
  • [45] Dynamic kernel network for hyperspectral image classification
    Ahamed, Md. Hafiz
    Hossain, Md. Ali
    Sarker, Yeahia
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (09) : 2847 - 2866
  • [46] A Lightweight Transformer Network for Hyperspectral Image Classification
    Zhang, Xuming
    Su, Yuanchao
    Gao, Lianru
    Bruzzone, Lorenzo
    Gu, Xingfa
    Tian, Qingjiu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [47] Hypergraph convolutional network for hyperspectral image classification
    Xu, Qin
    Lin, Jing
    Jiang, Bo
    Liu, Jinpei
    Luo, Bin
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (29): : 21863 - 21882
  • [48] Hyperspectral Image Classification Based on Capsule Network
    Ma Qiaoyu
    Zhang Xin
    Zhang Chunlei
    Zhou Heng
    CHINESE JOURNAL OF ELECTRONICS, 2022, 31 (01) : 146 - 154
  • [49] Joint Classification of Hyperspectral and LiDAR Data Based on Mamba
    Liao, Diling
    Wang, Qingsong
    Lai, Tao
    Huang, Haifeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [50] Convolutional Transformer Network for Hyperspectral Image Classification
    Zhao, Zhengang
    Hu, Dan
    Wang, Hao
    Yu, Xianchuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19