Transductive Few-Shot Learning With Enhanced Spectral-Spatial Embedding for Hyperspectral Image Classification

被引:2
|
作者
Xi, Bobo [1 ,2 ,3 ]
Zhang, Yun [1 ]
Li, Jiaojiao [1 ]
Huang, Yan [4 ,5 ]
Li, Yunsong [1 ]
Li, Zan [1 ]
Chanussot, Jocelyn [6 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510000, Guangdong, Peoples R China
[3] Chinese Acad Sci, Natl Space Sci Ctr, Beijing 100190, Peoples R China
[4] Southeast Univ, Sch Informat Sci & Engn, State Key Lab Millimeter Waves, Nanjing 210096, Peoples R China
[5] Purple Mt Lab, Nanjing 211100, Peoples R China
[6] Univ Grenoble Alpes, INRIA, CNRS, Grenoble INP,LJK, F-38000 Grenoble, France
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Metalearning; Prototypes; Filters; Few shot learning; Transformers; Convolution; Training; Residual neural networks; Redundancy; Few-shot learning; feature embedding; meta-feature interaction; graph-based prototype refinement; TRANSFORMER; NETWORK;
D O I
10.1109/TIP.2025.3531709
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) has been rapidly developed in the hyperspectral image (HSI) classification, potentially eliminating time-consuming and costly labeled data acquisition requirements. Effective feature embedding is empirically significant in FSL methods, which is still challenging for the HSI with rich spectral-spatial information. In addition, compared with inductive FSL, transductive models typically perform better as they explicitly leverage the statistics in the query set. To this end, we devise a transductive FSL framework with enhanced spectral-spatial embedding (TEFSL) to fully exploit the limited prior information available. First, to improve the informative features and suppress the redundant ones contained in the HSI, we devise an attentive feature embedding network (AFEN) comprising a channel calibration module (CCM). Next, a meta-feature interaction module (MFIM) is designed to optimize the support and query features by learning adaptive co-attention using convolutional filters. During inference, we propose an iterative graph-based prototype refinement scheme (iGPRS) to achieve test-time adaptation, making the class centers more representative in a transductive learning manner. Extensive experimental results on four standard benchmarks demonstrate the superiority of our model with various handfuls (i.e., from 1 to 5) labeled samples.
引用
收藏
页码:854 / 868
页数:15
相关论文
共 50 条
  • [21] Few-Shot Hyperspectral Image Classification With Deep Fuzzy Metric Learning
    Tang, Haojin
    Zhang, Chao
    Tang, Dong
    Lin, Xin
    Yang, Xiaofei
    Xie, Weixin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [22] FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION THROUGH MULTITASK TRANSFER LEARNING
    Qu, Ying
    Baghbaderani, Razieh Kaviani
    Qi, Hairong
    2019 10TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING - EVOLUTION IN REMOTE SENSING (WHISPERS), 2019,
  • [23] Few-Shot Hyperspectral Image Classification With Self-Supervised Learning
    Li, Zhaokui
    Guo, Hui
    Chen, Yushi
    Liu, Cuiwei
    Du, Qian
    Fang, Zhuoqun
    Wang, Yan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [24] Generalized few-shot learning for crop hyperspectral image precise classification
    Yuan, Hao-tian
    Huang, Ke-kun
    Duan, Jie-li
    Lai, Li-qian
    Yu, Jia-xiang
    Huang, Chao-wei
    Yang, Zhou
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 227
  • [25] Refined Prototypical Contrastive Learning for Few-Shot Hyperspectral Image Classification
    Liu, Quanyong
    Peng, Jiangtao
    Ning, Yujie
    Chen, Na
    Sun, Weiwei
    Du, Qian
    Zhou, Yicong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [26] Multiview Calibrated Prototype Learning for Few-Shot Hyperspectral Image Classification
    Yu, Chunyan
    Gong, Baoyu
    Song, Meiping
    Zhao, Enyu
    Chang, Chein-, I
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [27] Spectral-spatial hyperspectral image classification with dual spatial ensemble learning
    Fu, Wentao
    Sun, Xiyan
    Ji, Yuanfa
    Bai, Yang
    REMOTE SENSING LETTERS, 2021, 12 (12) : 1194 - 1206
  • [28] TDNet: A Novel Transductive Learning Framework With Conditional Metric Embedding for Few-Shot Remote Sensing Image Scene Classification
    Wang, Bing
    Wang, Zhirui
    Sun, Xian
    He, Qibin
    Wang, Hongqi
    Fu, Kun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4591 - 4606
  • [29] Learning Hierarchical Spectral-Spatial Features for Hyperspectral Image Classification
    Zhou, Yicong
    Wei, Yantao
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (07) : 1667 - 1678
  • [30] SPECTRAL-SPATIAL ONLINE DICTIONARY LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Fu, Wei
    Li, Shutao
    Fang, Leyuan
    Benediktsson, Jon Atli
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 3724 - 3727