Transductive Few-Shot Learning With Enhanced Spectral-Spatial Embedding for Hyperspectral Image Classification

被引:2
|
作者
Xi, Bobo [1 ,2 ,3 ]
Zhang, Yun [1 ]
Li, Jiaojiao [1 ]
Huang, Yan [4 ,5 ]
Li, Yunsong [1 ]
Li, Zan [1 ]
Chanussot, Jocelyn [6 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510000, Guangdong, Peoples R China
[3] Chinese Acad Sci, Natl Space Sci Ctr, Beijing 100190, Peoples R China
[4] Southeast Univ, Sch Informat Sci & Engn, State Key Lab Millimeter Waves, Nanjing 210096, Peoples R China
[5] Purple Mt Lab, Nanjing 211100, Peoples R China
[6] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Metalearning; Prototypes; Filters; Few shot learning; Transformers; Convolution; Training; Residual neural networks; Redundancy; Few-shot learning; feature embedding; meta-feature interaction; graph-based prototype refinement; TRANSFORMER; NETWORK;
D O I
10.1109/TIP.2025.3531709
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) has been rapidly developed in the hyperspectral image (HSI) classification, potentially eliminating time-consuming and costly labeled data acquisition requirements. Effective feature embedding is empirically significant in FSL methods, which is still challenging for the HSI with rich spectral-spatial information. In addition, compared with inductive FSL, transductive models typically perform better as they explicitly leverage the statistics in the query set. To this end, we devise a transductive FSL framework with enhanced spectral-spatial embedding (TEFSL) to fully exploit the limited prior information available. First, to improve the informative features and suppress the redundant ones contained in the HSI, we devise an attentive feature embedding network (AFEN) comprising a channel calibration module (CCM). Next, a meta-feature interaction module (MFIM) is designed to optimize the support and query features by learning adaptive co-attention using convolutional filters. During inference, we propose an iterative graph-based prototype refinement scheme (iGPRS) to achieve test-time adaptation, making the class centers more representative in a transductive learning manner. Extensive experimental results on four standard benchmarks demonstrate the superiority of our model with various handfuls (i.e., from 1 to 5) labeled samples.
引用
收藏
页码:854 / 868
页数:15
相关论文
共 50 条
  • [41] Enhanced Spectral-Spatial Residual Attention Network for Hyperspectral Image Classification
    Zhan, Yanting
    Wu, Ke
    Dong, Yanni
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7171 - 7186
  • [42] Spectral-Spatial Constraint Hyperspectral Image Classification
    Ji, Rongrong
    Gao, Yue
    Hong, Richang
    Liu, Qiong
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (03): : 1811 - 1824
  • [43] Spectral-Spatial Mamba for Hyperspectral Image Classification
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    REMOTE SENSING, 2024, 16 (13)
  • [44] Domain-Invariant Few-Shot Contrastive Learning for Hyperspectral Image Classification
    Chen, Wenchen
    Zhang, Yanmei
    Chu, Jianping
    Wang, Xingbo
    Applied Sciences (Switzerland), 2024, 14 (23):
  • [45] Few-Shot Hyperspectral Image Classification Using Meta Learning and Regularized Finetuning
    Li, Wenmei
    Liu, Qing
    Zhang, Yu
    Wang, Yu
    Yuan, Yuan
    Jia, Yan
    He, Yuhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 14
  • [46] Few-Shot Learning With Class-Covariance Metric for Hyperspectral Image Classification
    Xi, Bobo
    Li, Jiaojiao
    Li, Yunsong
    Song, Rui
    Hong, Danfeng
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5079 - 5092
  • [47] DEEP SELF-SUPERVISED LEARNING FOR FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Yu
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 501 - 504
  • [48] Feedback-Enhanced Few-Shot Transformer Learning for Small-Sized Hyperspectral Image Classification
    Liu, Lamei
    Zuo, Dongyu
    Wang, Ying
    Qu, Haicheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [49] Deep Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Li, Zhaokui
    Liu, Ming
    Chen, Yushi
    Xu, Yimin
    Li, Wei
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [50] A Multipath and Multiscale Siamese Network Based on Spatial-Spectral Features for Few-Shot Hyperspectral Image Classification
    Yang, Jinghui
    Qin, Jia
    Qian, Jinxi
    Li, Anqi
    Wang, Liguo
    REMOTE SENSING, 2023, 15 (18)