Bidirectional Mamba with Dual-Branch Feature Extraction for Hyperspectral Image Classification

被引:0
|
作者
Sun, Ming [1 ,2 ]
Zhang, Jie [1 ]
He, Xiaoou [1 ]
Zhong, Yihe [1 ]
机构
[1] Qiqihar Univ, Coll Comp & Control Engn, Qiqihar 161006, Peoples R China
[2] Qiqihar Univ, Heilongjiang Key Lab Big Data Network Secur Detect, Qiqihar 161006, Peoples R China
关键词
CNN; Mamba; dual-branch feature extraction; HSI; ALGORITHM; NETWORK; CNN;
D O I
10.3390/s24216899
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The hyperspectral image (HSI) classification task is widely used in remote sensing image analysis. The HSI classification methods based on convolutional neural networks (CNNs) have greatly improved the classification performance. However, they cannot well utilize the sequential properties of spectral features and face the challenge of increasing computational cost with the increase in network depth. To address these shortcomings, this paper proposes a novel network with a CNN-Mamba architecture, called DBMamba, which uses a bidirectional Mamba to process spectral feature sequences at a linear computational cost. In the DBMamba, principal component analysis (PCA) is first used to extract the main features of the data. Then, a dual-branch CNN structure, with the fused features from spectral-spatial features by 3D-CNN and spatial features by 2D-CNN, is used to extract shallow spectral-spatial features. Finally, a bidirectional Mamba is used to effectively capture global contextual information in features and significantly enhance the extraction of spectral features. Experimental results on the Indian Pines, Salinas, and Pavia University datasets demonstrate that the classification performance surpasses that of many cutting-edge methods, improving by 1.04%, 0.15%, and 0.09%, respectively, over the competing SSFTT method. The research in this paper enhances the existing knowledge on HSI classification and provides valuable insights for future research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [41] Hyperspectral image classification with unsupervised feature extraction
    Sun, Qiaoqiao
    Bourennane, Salah
    REMOTE SENSING LETTERS, 2020, 11 (05) : 475 - 484
  • [42] SPARSE FEATURE EXTRACTION FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Wang, Lu
    Xie, Xiaoming
    Li, Wei
    Du, Qian
    Li, Guojun
    2015 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING, 2015, : 1067 - 1070
  • [43] HSIRMamba: An effective feature learning for hyperspectral image classification using residual Mamba
    Arya, Rajat Kumar
    Jain, Siddhant
    Chattopadhyay, Pratik
    Srivastava, Rajeev
    IMAGE AND VISION COMPUTING, 2025, 154
  • [44] Dual Branch Masked Transformer for Hyperspectral Image Classification
    Li, Kuo
    Chen, Yushi
    Huang, Lingbo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [45] Dual-Branch Spectral-Spatial Adversarial Representation Learning for Hyperspectral Image Classification With Few Labeled Samples
    Sun, Caihao
    Zhang, Xiaohua
    Meng, Hongyun
    Cao, Xianghai
    Zhang, Jinhua
    Jiao, Licheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 45 - 45
  • [46] DMCCT: Dual-Branch Multi-Granularity Convolutional Cross-Substitution Transformer for Hyperspectral Image Classification
    Fu, Laiying
    Chen, Xiaoyong
    Xu, Yanan
    Li, Xiao
    APPLIED SCIENCES-BASEL, 2024, 14 (20):
  • [47] Joint Classification of Hyperspectral Images and LiDAR Data Based on Dual-Branch Transformer
    Wang, Qingyan
    Zhou, Binbin
    Zhang, Junping
    Xie, Jinbao
    Wang, Yujing
    SENSORS, 2024, 24 (03)
  • [48] HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON SEMI-SUPERVISED DUAL-BRANCH CONVOLUTIONAL AUTOENCODER WITH SELF-ATTENTION
    Feng, Jie
    Ye, Zhanwei
    Li, Di
    Liang, Yuping
    Tang, Xu
    Zhang, Xiangrong
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1267 - 1270
  • [49] DCTN: Dual-Branch Convolutional Transformer Network With Efficient Interactive Self-Attention for Hyperspectral Image Classification
    Zhou, Yunfei
    Huang, Xiaohui
    Yang, Xiaofei
    Peng, Jiangtao
    Ban, Yifang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [50] Spatial Feature Enhancement and Attention-Guided Bidirectional Sequential Spectral Feature Extraction for Hyperspectral Image Classification
    Liu, Yi
    Jiang, Shanjiao
    Liu, Yijin
    Mu, Caihong
    REMOTE SENSING, 2024, 16 (17)