HybridGT: An Integration of Graph Transformer and LSTM for Effective Hyperspectral Band Selection

被引:0
|
作者
Neela, Nagaraju [1 ]
Veerakumar, T. [1 ]
Panda, Manoj Kumar [2 ]
Subudhi, Badri Narayan [3 ]
Esakkirajan, S. [4 ]
Bouwmans, Thierry [5 ]
机构
[1] Natl Inst Technol Goa, Dept Elect & Commun Engn, Cuncolim 403703, Goa, India
[2] GIET Univ, Dept Elect & Commun Engn, Gunupur, Rayagada, India
[3] Indian Inst Technol Jammu, Dept Elect Engn, Nagrota, Jammu, India
[4] PSG Coll Technol, Dept Instrumentat & Control Engn, Coimbatore, India
[5] Univ La Rochelle, Lab MIA, La Rochelle, France
关键词
Hyperspectral imagery (HSI); graph transformer (GT); band selection (BS); resNet-50; long short term memory (LSTM); Bi-dimensional empirical mode decomposition (BEMD); CLASSIFICATION;
D O I
10.1080/01431161.2024.2431174
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Hyperspectral imagery has a high-dimensional curse due to numerous spectral bands. Band selection (BS) is crucial for efficiently reducing dimensionality, retaining only essential bands containing valuable information. However, deep learning-based techniques have gained more attention through trained networks for band selection. Recently, graph-based learning has been extensively used in hyperspectral imagery, revealing intrinsic data relationships. This article presents a novel hybrid approach for hyperspectral band selection, addressing the curse of dimensionality in hyperspectral imagery (HSI). Integrating Long Short Term Memory (LSTM) and Graph Transformer (GT), the method employs Bi-dimensional Empirical Mode Decomposition (BEMD) for spatial data enhancement. Using transfer learning, we explore a ResNet-50 deep network to identify optimal intrinsic mode functions (IMFs). The final band subset will be obtained by concatenating the features extracted from the graph transformer and LSTM networks from selected IMFs and residual IMF, respectively. The proposed HybridGT-BS technique surpasses state-of-the-art methods in classification accuracy across three well-known HSI datasets - IP-Indian Pines, SA-Salinas, and PU-PaviaU. With the support of experimental results, the proposed technique significantly outperforms the classification accuracy with the best bands of the HSIs.
引用
收藏
页数:29
相关论文
共 50 条
  • [1] Glaucoma Detection through a Novel Hyperspectral Imaging Band Selection and Vision Transformer Integration
    Wang, Ching-Yu
    Nguyen, Hong-Thai
    Fan, Wen-Shuang
    Lue, Jiann-Hwa
    Saenprasarn, Penchun
    Chen, Meei-Maan
    Huang, Shuan-Yu
    Lin, Fen-Chi
    Wang, Hsiang-Chen
    DIAGNOSTICS, 2024, 14 (12)
  • [2] Hyperspectral Band Selection With Iterative Graph Autoencoder
    Zhou, Yuan
    Yao, Qingren
    Huo, Shuwei
    Li, Xiaofeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] GRAPH LEARNING BASED AUTOENCODER FOR HYPERSPECTRAL BAND SELECTION
    Zhang, Yongshan
    Wang, Xinxin
    Wang, Zhenyu
    Jiang, Xinwei
    Zhou, Yicong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2794 - 2798
  • [4] Structural graph learning method for hyperspectral band selection
    Li, Shuying
    Liu, Zhe
    Fang, Long
    Li, Qiang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (18) : 6719 - 6743
  • [5] IMPROVED GRAPH-BASED SEMISUPERVISED HYPERSPECTRAL BAND SELECTION
    Teng, Weike
    Zhao, Juan
    Bai, Xia
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1157 - 1160
  • [6] Semisupervised Band Selection With Graph Optimization for Hyperspectral Image Classification
    He, Fang
    Nie, Feiping
    Wang, Rong
    Jia, Weimin
    Zhang, Fenggan
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (12): : 10298 - 10311
  • [7] BSFormer: Transformer-Based Reconstruction Network for Hyperspectral Band Selection
    Liu, Yufei
    Li, Xiaorun
    Xu, Zezhong
    Hua, Ziqiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [8] Hyperspectral Band Selection via Band Grouping and Adaptive Multi-Graph Constraint
    You, Mengbo
    Meng, Xiancheng
    Wang, Yishu
    Jin, Hongyuan
    Zhai, Chunting
    Yuan, Aihong
    REMOTE SENSING, 2022, 14 (17)
  • [9] A Multiscale Spectral Features Graph Fusion Method for Hyperspectral Band Selection
    Sun, Weiwei
    Yang, Gang
    Peng, Jiangtao
    Meng, Xiangchao
    He, Ke
    Li, Wei
    Li, Heng-Chao
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Graph Manifold Clustering based Band Selection for Hyperspectral Face Recognition
    Bhattacharya, Shubhobrata
    Das, Samiran
    Routray, Aurobinda
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1990 - 1994