Pseudo-loss Confidence Metric for Semi-supervised Few-shot Learning

被引:42
|
作者
Huang, Kai [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
Deng, Xinyang [1 ]
Xu, Zhe [1 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCV48922.2021.00855
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised few-shot learning is developed to train a classifier that can adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Most semi-supervised few-shot learning methods select pseudo-labeled data of unlabeled set by task-specific confidence estimation. This work presents a task-unified confidence estimation approach for semi-supervised few-shot learning, named pseudo-loss confidence metric (PLCM). It measures the data credibility by the loss distribution of pseudo-labels, which is synthetical considered multi-tasks. Specifically, pseudo-labeled data of different tasks are mapped to a unified metric space by mean of the pseudo-loss model, making it possible to learn the prior pseudo-loss distribution. Then, confidence of pseudo-labeled data is estimated according to the distribution component confidence of its pseudo-loss. Thus highly reliable pseudo-labeled data are selected to strengthen the classifier. Moreover, to overcome the pseudo-loss distribution shift and improve the effectiveness of classifier, we advance the multi-step training strategy coordinated with the class balance measures of class-apart selection and class weight. Experimental results on four popular benchmark datasets demonstrate that the proposed approach can effectively select pseudo-labeled data and achieve the state-of-the-art performance.
引用
收藏
页码:8651 / 8660
页数:10
相关论文
共 50 条
  • [1] A Few-Shot Learning Model Based on Semi-Supervised with Pseudo Label
    Yu Y.
    Feng L.
    Wang G.-G.
    Xu Q.-F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (11): : 2284 - 2291
  • [2] PROGRESSIVE POINT TO SET METRIC LEARNING FOR SEMI-SUPERVISED FEW-SHOT CLASSIFICATION
    Zhu, Pengfei
    Gu, Mingqi
    Li, Wenbin
    Zhang, Changqing
    Hu, Qinghua
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 196 - 200
  • [3] TENET: Beyond Pseudo-labeling for Semi-supervised Few-shot Learning
    Ma, Chengcheng
    Dong, Weiming
    Xu, Changsheng
    MACHINE INTELLIGENCE RESEARCH, 2025,
  • [4] Task Cooperation for Semi-Supervised Few-Shot Learning
    Ye, Han-Jia
    Li, Xin-Chun
    Zhan, De-Chuan
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10682 - 10690
  • [5] HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learning
    Zhmoginov, Andrey
    Sandler, Mark
    Vladymyrov, Max
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [6] Few-shot Object Detection as a Semi-supervised Learning Problem
    Bailer, Werner
    Fassold, Hannes
    19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 131 - 135
  • [7] An Embarrassingly Simple Approach to Semi-Supervised Few-Shot Learning
    Wei, Xiu-Shen
    Xu, He-Yang
    Zhang, Faen
    Peng, Yuxin
    Zhou, Wei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [8] SEMI-SUPERVISED FEW-SHOT CLASS-INCREMENTAL LEARNING
    Cui, Yawen
    Xiong, Wuti
    Tavakolian, Mohammad
    Liu, Li
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1239 - 1243
  • [9] Semi-Supervised Few-Shot Learning with Prototypical Random Walks
    Ayyad, Ahmed
    Li, Yuchen
    Muaz, Raden
    Albarqouni, Shadi
    Elhoseiny, Mohamed
    AAAI WORKSHOP ON META-LEARNING AND METADL CHALLENGE, VOL 140, 2021, 140 : 45 - 57
  • [10] Few-Shot Learning for Fault Diagnosis: Semi-Supervised Prototypical Network with Pseudo-Labels
    He, Jun
    Zhu, Zheshuai
    Fan, Xinyu
    Chen, Yong
    Liu, Shiya
    Chen, Danfeng
    SYMMETRY-BASEL, 2022, 14 (07):