Bidirectional Mamba with Dual-Branch Feature Extraction for Hyperspectral Image Classification

被引:0
|
作者
Sun, Ming [1 ,2 ]
Zhang, Jie [1 ]
He, Xiaoou [1 ]
Zhong, Yihe [1 ]
机构
[1] Qiqihar Univ, Coll Comp & Control Engn, Qiqihar 161006, Peoples R China
[2] Qiqihar Univ, Heilongjiang Key Lab Big Data Network Secur Detect, Qiqihar 161006, Peoples R China
关键词
CNN; Mamba; dual-branch feature extraction; HSI; ALGORITHM; NETWORK; CNN;
D O I
10.3390/s24216899
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The hyperspectral image (HSI) classification task is widely used in remote sensing image analysis. The HSI classification methods based on convolutional neural networks (CNNs) have greatly improved the classification performance. However, they cannot well utilize the sequential properties of spectral features and face the challenge of increasing computational cost with the increase in network depth. To address these shortcomings, this paper proposes a novel network with a CNN-Mamba architecture, called DBMamba, which uses a bidirectional Mamba to process spectral feature sequences at a linear computational cost. In the DBMamba, principal component analysis (PCA) is first used to extract the main features of the data. Then, a dual-branch CNN structure, with the fused features from spectral-spatial features by 3D-CNN and spatial features by 2D-CNN, is used to extract shallow spectral-spatial features. Finally, a bidirectional Mamba is used to effectively capture global contextual information in features and significantly enhance the extraction of spectral features. Experimental results on the Indian Pines, Salinas, and Pavia University datasets demonstrate that the classification performance surpasses that of many cutting-edge methods, improving by 1.04%, 0.15%, and 0.09%, respectively, over the competing SSFTT method. The research in this paper enhances the existing knowledge on HSI classification and provides valuable insights for future research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] DSAFuse: Infrared and visible image fusion via dual-branch spatial adaptive feature extraction
    Shen, Shixian
    Feng, Yong
    Liu, Nianbo
    Liu, Ming
    Li, Yingna
    NEUROCOMPUTING, 2025, 616
  • [32] A Dual-Branch Extraction and Classification Method Under Limited Samples of Hyperspectral Images Based on Deep Learning
    Niu, Bingqing
    Lan, Jinhui
    Shao, Yang
    Zhang, Hui
    REMOTE SENSING, 2020, 12 (03)
  • [33] A Novel Dual-Branch Global and Local Feature Extraction Network for SAR and Optical Image Registration
    Zhao, Xuanran
    Wu, Yan
    Hu, Xin
    Li, Zhikang
    Li, Ming
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17637 - 17650
  • [34] Dual-Branch Dynamic Modulation Network for Hyperspectral and LiDAR Data Classification
    Xu, Zhengyi
    Jiang, Wen
    Geng, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [35] Residual cosine similar attention and bidirectional convolution in dual-branch network for skin lesion image classification
    Li, Aolun
    Zhang, Dezhi
    Yu, Long
    Kang, Xiaojing
    Tian, Shengwei
    Wu, Weidong
    You, Hongfeng
    Huo, Xiangzuo
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [36] Double-Branch Local Context Feature Extraction Network for Hyperspectral Image Classification
    Cui, Ying
    Li, Wenshan
    Chen, Liwei
    Gao, Shan
    Wang, Liguo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [37] Semi-supervised Dual-Branch Network for image classification
    Chen, Jiaming
    Yang, Meng
    Gao, Guangwei
    KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [38] Salient feature extraction for hyperspectral image classification
    Yu, Xuchu
    Wang, Ruirui
    Liu, Bing
    Yu, Anzhu
    REMOTE SENSING LETTERS, 2019, 10 (06) : 553 - 562
  • [39] Slow feature extraction for hyperspectral image classification
    Liu, Bing
    Yu, Anzhu
    Tan, Xiong
    Wang, Ruirui
    REMOTE SENSING LETTERS, 2021, 12 (05) : 429 - 438
  • [40] Feature extraction for hyperspectral image classification: a review
    Kumar, Brajesh
    Dikshit, Onkar
    Gupta, Ashwani
    Singh, Manoj Kumar
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (16) : 6248 - 6287