Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network

被引:1
|
作者
Zhao, Yunji [1 ]
Song, Nailong [1 ]
Bao, Wenming [1 ]
机构
[1] Henan Polytech Univ, Sch Elect Engn & Automat, Henan Int Joint Lab Direct Dr & Control Intelligen, Jiaozuo, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive feature fusion; Deep learning (DL); Global local feature fusion network (GLF2Net); Hyperspectral image (HSI) classification;
D O I
10.1007/s12145-024-01415-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep learning-based methods are widely used in hyperspectral image (HSI) classification and have achieved excellent classification performance. However, hyperspectral data from different categories exhibit strong nonlinear coupling, which results in low spatial distinguishability between samples from different categories. Under the condition of limited sample size, how to extract spectral-spatial features and reduce the coupling of hyperspectral data from different categories is the key to achieving high-precision classification. Some methods based on Convolutional Neural Networks (CNN) tend to focus on local information within hyperspectral cubes. Transformers have excellent performance in modeling global dependencies between sequences. To solve the above problems, this paper proposes a global local feature fusion network (GLF2Net) for hyperspectral classification. To effectively integrate global information, this method introduces frequency domain statistical methods into the field of hyperspectral image classification. Firstly, this paper utilizes Fast Fourier Transform (FFT) to obtain frequency domain information from HSI data. Then, an improved adaptive 13-dimensional frequency domain statistical feature is applied as a supplement to the information after Principal Component Analysis (PCA) dimensionality reduction. To fully capture local-global hyperspectral features from HSI data, a dual-branch structure with a Transformer encoder Convolution Mixer Branch (TCM) and a CNN Branch is designed. Through extensive experiments on real HSI datasets, it is proven that the classification performance of GLF2Net is superior to several classic HSI classification methods.
引用
收藏
页码:4619 / 4637
页数:19
相关论文
共 50 条
  • [11] Hyperspectral Image Spectral-Spatial Classification Method Based on Deep Adaptive Feature Fusion
    Mu, Caihong
    Liu, Yijin
    Liu, Yi
    REMOTE SENSING, 2021, 13 (04) : 1 - 21
  • [12] Feature pyramid network based on double filter feature fusion for hyperspectral image classification
    Wang, Ge
    Guo, Wenhui
    Wang, Yanjiang
    Wang, Wuli
    2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, : 240 - 244
  • [13] Hyperspectral Image Classification With Deep Feature Fusion Network
    Song, Weiwei
    Li, Shutao
    Fang, Leyuan
    Lu, Ting
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (06): : 3173 - 3184
  • [14] Adaptive Weighting Feature Fusion Approach Based on Generative Adversarial Network for Hyperspectral Image Classification
    Liang, Hongbo
    Bao, Wenxing
    Shen, Xiangfei
    REMOTE SENSING, 2021, 13 (02) : 1 - 25
  • [15] HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON MULTISCALE SPATIAL AND SPECTRAL FEATURE NETWORK
    Tang, Xu
    Meng, Fanbo
    Ma, Jingjing
    Zhang, Xiangrong
    Liu, Fang
    Peng, Qunnie
    Jiao, Licheng
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 838 - 841
  • [16] AUTOMATIC HYPERSPECTRAL IMAGE CLASSIFICATION BASED ONDEEP FEATURE FUSION NETWORK
    Zhang, Yunfei
    Zhu, Yuelong
    Hu, Hexuan
    Wang, Hongyan
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2021, 36 (05): : 363 - 375
  • [17] Feature Reduction Based on the Fusion of Spectral and Spatial Transformation for Hyperspectral Image Classification
    Hossain, Md Moazzem
    Hossain, Md Ali
    Al Mamun, Md
    Hossain, Md Mamun
    2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, : 150 - 153
  • [18] Adaptive spectral-spatial feature fusion network for hyperspectral image classification using limited training samples
    Gao, Hongmin
    Chen, Zhonghao
    Xu, Feng
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 107
  • [19] A Lightweight Spectral-Spatial Feature Extraction and Fusion Network for Hyperspectral Image Classification
    Chen, Linlin
    Wei, Zhihui
    Xu, Yang
    REMOTE SENSING, 2020, 12 (09)
  • [20] Semantic and spatial-spectral feature fusion transformer network for the classification of hyperspectral image
    Xie, Erxin
    Chen, Na
    Peng, Jiangtao
    Sun, Weiwei
    Du, Qian
    You, Xinge
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (04) : 1308 - 1322