Learning task-specific discriminative embeddings for few-shot image classification

被引:19
|
作者
Xing, Lei [1 ]
Shao, Shuai [2 ]
Liu, Weifeng [2 ]
Han, Anxun [1 ]
Pan, Xiangshuai [1 ]
Liu, Bao-Di [2 ]
机构
[1] China Univ Petr, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
[2] China Univ Petr, Coll Control Sci & Engn, Qingdao 266580, Peoples R China
关键词
Few-shot learning; Dictionary learning; Task-specific discriminative embeddings;
D O I
10.1016/j.neucom.2022.02.073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, few-shot learning has attracted more and more attention. Generally, the fine-tuning-based few shot learning framework contains two stages: i) In the pre-training stage, using base data to train the feature extractor; ii) In the meta-testing stage, using a well-trained feature extractor to extract embedding features of novel data and designing a base learner to predict the labels. Due to the diverse categories of base and novel data, it is challenging for the feature extractor trained in the pre-training stage to adapt to novel data, which will result in an embedding-mismatch problem. This paper proposes Task-specific Discriminative Embeddings for Few-shot Learning (TDE-FSL) to solve the embedding-mismatch problem. Specifically, we embed the dictionary learning method into the few-shot learning framework to map the feature embeddings to a more discriminative subspace to adapt to the specific task. Moreover, we extend the self-training framework to our approach to fully utilize the unlabeled data. Finally, we evaluate the TDE-FSL on five benchmark image datasets, such as mini-Imagenet, tiered-Imagenet, CIFAR-FS, FC100, and CUB dataset. The experimental results show that the performance of our proposed TDE-FSL achieves a significant improvement.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Learning Task-Specific Embeddings for Few-Shot Classification via Local Weight Adaptation
    Gong, Nianru
    Duan, Pengfei
    Rong, Yi
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 485 - 491
  • [2] Task-specific contrastive learning for few-shot remote sensing image scene classification
    Zeng, Qingjie
    Geng, Jie
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 191 : 143 - 154
  • [3] Graph Few-shot Learning with Task-specific Structures
    Wang, Song
    Chen, Chen
    Li, Jundong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [4] Task-specific method-agnostic metric for few-shot learning
    Wang, Heng
    Li, Yong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (04): : 3115 - 3124
  • [5] Task-specific method-agnostic metric for few-shot learning
    Heng Wang
    Yong Li
    Neural Computing and Applications, 2023, 35 : 3115 - 3124
  • [6] Cross-domain Few-shot Learning with Task-specific Adapters
    Li, Wei-Hong
    Liu, Xialei
    Bilen, Hakan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7151 - 7160
  • [7] Task-specific Part Discovery for Fine-grained Few-shot Classification
    Wei, Yongxian
    Wei, Xiu-Shen
    MACHINE INTELLIGENCE RESEARCH, 2024, 21 (05) : 954 - 965
  • [8] LGSim: local task-invariant and global task-specific similarity for few-shot classification
    Wenjing Li
    Zhongcheng Wu
    Jun Zhang
    Tingting Ren
    Fang Li
    Neural Computing and Applications, 2020, 32 : 13065 - 13076
  • [9] Few-Shot Learning of Compact Models via Task-Specific Meta Distillation
    Wu, Yong
    Chanda, Shekhor
    Hosseinzadeh, Mehrdad
    Liu, Zhi
    Wang, Yang
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 6254 - 6263
  • [10] LGSim: local task-invariant and global task-specific similarity for few-shot classification
    Li, Wenjing
    Wu, Zhongcheng
    Zhang, Jun
    Ren, Tingting
    Li, Fang
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (16): : 13065 - 13076