Bidirectional Mamba with Dual-Branch Feature Extraction for Hyperspectral Image Classification

被引:0
|
作者
Sun, Ming [1 ,2 ]
Zhang, Jie [1 ]
He, Xiaoou [1 ]
Zhong, Yihe [1 ]
机构
[1] Qiqihar Univ, Coll Comp & Control Engn, Qiqihar 161006, Peoples R China
[2] Qiqihar Univ, Heilongjiang Key Lab Big Data Network Secur Detect, Qiqihar 161006, Peoples R China
关键词
CNN; Mamba; dual-branch feature extraction; HSI; ALGORITHM; NETWORK; CNN;
D O I
10.3390/s24216899
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The hyperspectral image (HSI) classification task is widely used in remote sensing image analysis. The HSI classification methods based on convolutional neural networks (CNNs) have greatly improved the classification performance. However, they cannot well utilize the sequential properties of spectral features and face the challenge of increasing computational cost with the increase in network depth. To address these shortcomings, this paper proposes a novel network with a CNN-Mamba architecture, called DBMamba, which uses a bidirectional Mamba to process spectral feature sequences at a linear computational cost. In the DBMamba, principal component analysis (PCA) is first used to extract the main features of the data. Then, a dual-branch CNN structure, with the fused features from spectral-spatial features by 3D-CNN and spatial features by 2D-CNN, is used to extract shallow spectral-spatial features. Finally, a bidirectional Mamba is used to effectively capture global contextual information in features and significantly enhance the extraction of spectral features. Experimental results on the Indian Pines, Salinas, and Pavia University datasets demonstrate that the classification performance surpasses that of many cutting-edge methods, improving by 1.04%, 0.15%, and 0.09%, respectively, over the competing SSFTT method. The research in this paper enhances the existing knowledge on HSI classification and provides valuable insights for future research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] Dual-Branch Domain Adaptation Few-Shot Learning for Hyperspectral Image Classification
    Wang, Zhuowei
    Zhao, Shihui
    Zhao, Genping
    Song, Xiaoyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [22] Hyperspectral Image Classification With Mamba
    Pan, Zhaojie
    Li, Chenyu
    Plaza, Antonio
    Chanussot, Jocelyn
    Hong, Danfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [23] Dual-branch dense residual network for hyperspectral imagery classification
    Wang, Yuhao
    Liang, Binxiu
    Ding, Meng
    Li, Jiangyun
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (07) : 2581 - 2602
  • [24] Dual-branch spectral-spatial feature extraction network for multispectral image compression
    Kong, Fanqiang
    Tang, Jiahui
    Li, Yunsong
    Li, Dan
    Hu, Kedi
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3579 - 3597
  • [25] DBPF-net: dual-branch structural feature extraction reinforcement network for ocular surface disease image classification
    Wan, Cheng
    Mao, Yulong
    Xi, Wenqun
    Zhang, Zhe
    Wang, Jiantao
    Yang, Weihua
    FRONTIERS IN MEDICINE, 2024, 10
  • [26] Feature Extraction for Hyperspectral Image Classification
    Uddin, M. P.
    Mamun, M. A.
    Hossain, M. A.
    2017 IEEE REGION 10 HUMANITARIAN TECHNOLOGY CONFERENCE (R10-HTC), 2017, : 379 - 382
  • [27] Multiscale Dual-Branch Residual Spectral-Spatial Network With Attention for Hyperspectral Image Classification
    Ghaderizadeh, Saeed
    Abbasi-Moghadam, Dariush
    Sharifi, Alireza
    Tariq, Aqil
    Qin, Shujing
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 5455 - 5467
  • [28] SPECTRAL-SPATIAL DUAL-BRANCH CROSS-ENHANCED TRANSFORMER FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhang, Hang
    Zhan, Tianming
    Sun, Le
    2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, : 8975 - 8978
  • [29] Deep Image Classification Model Based on Dual-Branch
    Chen, Haoyu
    Lv, Qi
    Zhou, Wei
    Zheng, Jiang
    Wang, Jian
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, VOL. 1, 2022, 878 : 636 - 643
  • [30] A Dual-Branch Fusion of a Graph Convolutional Network and a Convolutional Neural Network for Hyperspectral Image Classification
    Yang, Pan
    Zhang, Xinxin
    SENSORS, 2024, 24 (14)