Meta-learning triplet contrast network for few-shot text classification

被引:0
|
作者
Dong, Kaifang [1 ]
Jiang, Baoxing [2 ]
Li, Hongye [1 ]
Zhu, Zhenfang [3 ]
Liu, Peiyu [1 ]
机构
[1] Shandong Normal Univ, Jinan 250358, Shandong, Peoples R China
[2] Sichuan Univ, Chengdu 610005, Sichuan, Peoples R China
[3] Shandong Jiaotong Univ, Jinan 250357, Shandong, Peoples R China
关键词
Few-shot learning; Text classification; Triplet network; Natural language processing;
D O I
10.1016/j.knosys.2024.112440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot text classification (FSTC) strives to predict classes not involved in the training by learning from a few labeled examples. Currently, most tasks construct meta-tasks in a randomized manner that fails to give more priority to hard-to-identify classes and samples. Besides, some tasks incorporated a contrast strategy, but the sample could only be compared to positive or negative examples individually. In this work, we propose a Meta-learning Triplet Contrast Network (Meta-TCN) with bidirectional contrast capability to solve the above problem. Specifically, Meta-TCN uses external knowledge with labeled information as the class examples, which decouples the embedding of prototypes from the support pool. Meanwhile, the class examples combine the support samples to construct triplet pairs used for learning. Unlike previous studies, the model can learn negative and positive knowledge simultaneously, ensuring that understanding is enriched and enhances learning. Further, we improve the shortcomings of randomness in the meta-task construction process by proposing a Dynamic Rate of Change (DRC) sampling strategy. DRC enhances the model's focus on difficult-to- classify samples. We conducted extensive experiments on six benchmark datasets such as Huffpost and RCV1. Experiments show that the average accuracy of Meta-TCN can achieve state-of-the-art performance in the vast majority of tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [11] Meta-Learning for Few-Shot Time Series Classification
    Narwariya, Jyoti
    Malhotra, Pankaj
    Vig, Lovekesh
    Shroff, Gautam
    Vishnu, T. V.
    PROCEEDINGS OF THE 7TH ACM IKDD CODS AND 25TH COMAD (CODS-COMAD 2020), 2020, : 28 - 36
  • [12] Meta-Learning for Few-Shot Land Cover Classification
    Russwurm, Marc
    Wang, Sherrie
    Koerner, Marco
    Lobell, David
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 788 - 796
  • [13] META-LEARNING FOR FEW-SHOT TIME SERIES CLASSIFICATION
    Wang, Sherrie
    Russwurm, Marc
    Koerner, Marco
    Lobell, David B.
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 7041 - 7044
  • [14] Meta-Learning based prototype-relation network for few-shot classification
    Liu, Xiaoqian
    Zhou, Fengyu
    Liu, Jin
    Jiang, Lianjie
    NEUROCOMPUTING, 2020, 383 : 224 - 234
  • [15] Fast Few-Shot Classification by Few-Iteration Meta-Learning
    Tripathi, Ardhendu Shekhar
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 9522 - 9528
  • [16] Few-Shot Text Classification with an Efficient Prompt Tuning Method in Meta-Learning Framework
    Lv, Xiaobao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (03)
  • [17] Prototype Bayesian Meta-Learning for Few-Shot Image Classification
    Fu, Meijun
    Wang, Xiaomin
    Wang, Jun
    Yi, Zhang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [18] MetaDelta: A Meta-Learning System for Few-shot Image Classification
    Chen, Yudong
    Guan, Chaoyu
    Wei, Zhikun
    Wang, Xin
    Zhu, Wenwu
    AAAI WORKSHOP ON META-LEARNING AND METADL CHALLENGE, VOL 140, 2021, 140 : 17 - 28
  • [19] Few-Shot Classification Based on Sparse Dictionary Meta-Learning
    Jiang, Zuo
    Wang, Yuan
    Tang, Yi
    MATHEMATICS, 2024, 12 (19)
  • [20] External Knowledge Enhancing Meta-learning Framework for Few-Shot Text Classification via Contrastive Learning and Adversarial Network
    Sun, Xin
    Yang, Yan
    Liu, Yong
    WEB AND BIG DATA, APWEB-WAIM 2024, PT I, 2024, 14961 : 46 - 58