Improving Meta-learning for Few-Shot Text Classification via Label Propagation

被引:0
|
作者
Li, Haorui [1 ]
Shao, Jie [1 ,2 ]
Zeng, Xiangqiang [1 ]
Xu, Hui [2 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Shenzhen Inst Adv Study, Shenzhen 518110, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta-learning; Prototypical network; Few-shot text classification; Label propagation;
D O I
10.1007/978-3-031-70362-1_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning has shown remarkable success in few-shot learning, and a popular metric-based meta-learning method known as prototypical network has gained widespread adoption for addressing few-shot text classification tasks. However, its effectiveness is hampered by the reliance on limited labeled samples to define class prototypes, which may not accurately reflect the true class distribution, especially given the sparsity of textual data. This misalignment can consequently reduce the performance of few-shot text classification. To address this problem, we propose an optimization method for the prototypical network named LP-PN by leveraging a semi-supervised learning technique known as label propagation. LP-PN utilizes unlabeled samples from query set to optimize the representation of corresponding class prototypes, thus aligning prototypes more closely with the actual class distribution. Furthermore, to overcome the limitations of static distance metrics that fail to capture class differences, we incorporate a dynamic distance metric based on the attention mechanism in LP-PN. We evaluate our method across four benchmark datasets, and the results show that LP-PN demonstrates competitive performance compared with recent few-shot text classification methods.
引用
收藏
页码:389 / 405
页数:17
相关论文
共 50 条
  • [11] Unsupervised Meta-Learning for Few-Shot Image Classification
    Khodadadeh, Siavash
    Boloni, Ladislau
    Shah, Mubarak
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [12] Contrastive Meta-Learning for Few-shot Node Classification
    Wang, Song
    Tan, Zhen
    Liu, Huan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2386 - 2397
  • [13] Few-shot Edge Classification in Graph Meta-learning
    Yang, Xiaoxiao
    Xu, Jungang
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 166 - 172
  • [14] Meta-Learning for Few-Shot Time Series Classification
    Narwariya, Jyoti
    Malhotra, Pankaj
    Vig, Lovekesh
    Shroff, Gautam
    Vishnu, T. V.
    PROCEEDINGS OF THE 7TH ACM IKDD CODS AND 25TH COMAD (CODS-COMAD 2020), 2020, : 28 - 36
  • [15] Meta-Learning for Few-Shot Land Cover Classification
    Russwurm, Marc
    Wang, Sherrie
    Koerner, Marco
    Lobell, David
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 788 - 796
  • [16] META-LEARNING FOR FEW-SHOT TIME SERIES CLASSIFICATION
    Wang, Sherrie
    Russwurm, Marc
    Koerner, Marco
    Lobell, David B.
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 7041 - 7044
  • [17] Few-shot driver identification via meta-learning
    Lu, Lin
    Xiong, Shengwu
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
  • [18] Few-shot driver identification via meta-learning
    Lu, Lin
    Xiong, Shengwu
    Expert Systems with Applications, 2022, 203
  • [19] Few-shot SAR target classification via meta-learning with hybrid models
    Geng, Qingtian
    Wang, Yaning
    Li, Qingliang
    FRONTIERS IN EARTH SCIENCE, 2024, 12
  • [20] Fast Few-Shot Classification by Few-Iteration Meta-Learning
    Tripathi, Ardhendu Shekhar
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 9522 - 9528