Transductive Few-Shot Learning With Enhanced Spectral-Spatial Embedding for Hyperspectral Image Classification

被引:2
|
作者
Xi, Bobo [1 ,2 ,3 ]
Zhang, Yun [1 ]
Li, Jiaojiao [1 ]
Huang, Yan [4 ,5 ]
Li, Yunsong [1 ]
Li, Zan [1 ]
Chanussot, Jocelyn [6 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510000, Guangdong, Peoples R China
[3] Chinese Acad Sci, Natl Space Sci Ctr, Beijing 100190, Peoples R China
[4] Southeast Univ, Sch Informat Sci & Engn, State Key Lab Millimeter Waves, Nanjing 210096, Peoples R China
[5] Purple Mt Lab, Nanjing 211100, Peoples R China
[6] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Metalearning; Prototypes; Filters; Few shot learning; Transformers; Convolution; Training; Residual neural networks; Redundancy; Few-shot learning; feature embedding; meta-feature interaction; graph-based prototype refinement; TRANSFORMER; NETWORK;
D O I
10.1109/TIP.2025.3531709
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) has been rapidly developed in the hyperspectral image (HSI) classification, potentially eliminating time-consuming and costly labeled data acquisition requirements. Effective feature embedding is empirically significant in FSL methods, which is still challenging for the HSI with rich spectral-spatial information. In addition, compared with inductive FSL, transductive models typically perform better as they explicitly leverage the statistics in the query set. To this end, we devise a transductive FSL framework with enhanced spectral-spatial embedding (TEFSL) to fully exploit the limited prior information available. First, to improve the informative features and suppress the redundant ones contained in the HSI, we devise an attentive feature embedding network (AFEN) comprising a channel calibration module (CCM). Next, a meta-feature interaction module (MFIM) is designed to optimize the support and query features by learning adaptive co-attention using convolutional filters. During inference, we propose an iterative graph-based prototype refinement scheme (iGPRS) to achieve test-time adaptation, making the class centers more representative in a transductive learning manner. Extensive experimental results on four standard benchmarks demonstrate the superiority of our model with various handfuls (i.e., from 1 to 5) labeled samples.
引用
收藏
页码:854 / 868
页数:15
相关论文
共 50 条
  • [1] Spectral-Spatial Domain Attention Network for Hyperspectral Image Few-Shot Classification
    Zhang, Zhongqiang
    Gao, Dahua
    Liu, Danhua
    Shi, Guangming
    REMOTE SENSING, 2024, 16 (03)
  • [2] FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION WITH SPECTRAL-SPATIAL FEATURE FUSION BASED ON FUZZY BROAD LEARNING SYSTEM
    Hu, Xiaopei
    Zhao, Guixin
    Dong, Aimei
    Lv, Guohua
    Zhai, Yi
    Guo, Ying
    Dong, Xiangjun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3160 - 3164
  • [3] Few-Shot Learning for Hyperspectral Imaging via Spectral-Spatial Feature Reconstruction
    Liu, Shukai
    Chen, Danyi
    Teng, Fei
    Yin, Changqing
    Zhang, Huijuan
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2060 - 2065
  • [4] S2TNet: Spectral-Spatial Triplet Network for Few-Shot Hyperspectral Image Classification
    Yue, Guijie
    Zhang, Ling
    Zhou, Yiyang
    Wang, Yuxiang
    Xue, Zhaohui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [5] S3Net: Spectral-Spatial Siamese Network for Few-Shot Hyperspectral Image Classification
    Xue, Zhaohui
    Zhou, Yiyang
    Du, Peijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] S3Net: Spectral-Spatial Siamese Network for Few-Shot Hyperspectral Image Classification
    Xue, Zhaohui
    Zhou, Yiyang
    Du, Peijun
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [7] Transductive clustering optimization learning for few-shot image classification
    Wang, Yi
    Bian, Xiong
    Zhu, Songhao
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [8] Embedding Learning on Spectral-Spatial Graph for Semisupervised Hyperspectral Image Classification
    Cao, Jiayan
    Wang, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) : 1805 - 1809
  • [9] Heterogeneous Few-Shot Learning for Hyperspectral Image Classification
    Wang, Yan
    Liu, Ming
    Yang, Yuexin
    Li, Zhaokui
    Du, Qian
    Chen, Yushi
    Li, Fei
    Yang, Haibo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Deep Few-Shot Learning for Hyperspectral Image Classification
    Liu, Bing
    Yu, Xuchu
    Yu, Anzhu
    Zhang, Pengqiang
    Wan, Gang
    Wang, Ruirui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (04): : 2290 - 2304