Meta-learning triplet contrast network for few-shot text classification

被引:0
|
作者
Dong, Kaifang [1 ]
Jiang, Baoxing [2 ]
Li, Hongye [1 ]
Zhu, Zhenfang [3 ]
Liu, Peiyu [1 ]
机构
[1] Shandong Normal Univ, Jinan 250358, Shandong, Peoples R China
[2] Sichuan Univ, Chengdu 610005, Sichuan, Peoples R China
[3] Shandong Jiaotong Univ, Jinan 250357, Shandong, Peoples R China
关键词
Few-shot learning; Text classification; Triplet network; Natural language processing;
D O I
10.1016/j.knosys.2024.112440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot text classification (FSTC) strives to predict classes not involved in the training by learning from a few labeled examples. Currently, most tasks construct meta-tasks in a randomized manner that fails to give more priority to hard-to-identify classes and samples. Besides, some tasks incorporated a contrast strategy, but the sample could only be compared to positive or negative examples individually. In this work, we propose a Meta-learning Triplet Contrast Network (Meta-TCN) with bidirectional contrast capability to solve the above problem. Specifically, Meta-TCN uses external knowledge with labeled information as the class examples, which decouples the embedding of prototypes from the support pool. Meanwhile, the class examples combine the support samples to construct triplet pairs used for learning. Unlike previous studies, the model can learn negative and positive knowledge simultaneously, ensuring that understanding is enriched and enhances learning. Further, we improve the shortcomings of randomness in the meta-task construction process by proposing a Dynamic Rate of Change (DRC) sampling strategy. DRC enhances the model's focus on difficult-to- classify samples. We conducted extensive experiments on six benchmark datasets such as Huffpost and RCV1. Experiments show that the average accuracy of Meta-TCN can achieve state-of-the-art performance in the vast majority of tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] MGML: Momentum group meta-learning for few-shot image classification
    Zhu, Xiaomeng
    Li, Shuxiao
    NEUROCOMPUTING, 2022, 514 : 351 - 361
  • [32] Survey of Few-Shot Image Classification Based on Deep Meta-Learning
    Zhou, Bojun
    Chen, Zhiyu
    Computer Engineering and Applications, 2024, 60 (08) : 1 - 15
  • [33] Few-shot classification via efficient meta-learning with hybrid optimization
    Jia, Jinfang
    Feng, Xiang
    Yu, Huiqun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [34] Few-Shot One-Class Classification via Meta-Learning
    Frikha, Ahmed
    Krompass, Denis
    Koepken, Hans-Georg
    Tresp, Volker
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7448 - 7456
  • [35] IMPROVING GENERALIZATION FOR FEW-SHOT REMOTE SENSING CLASSIFICATION WITH META-LEARNING
    Sharma, Surbhi
    Roscher, Ribana
    Riedel, Morris
    Memon, Shahbaz
    Cavallaro, Gabriele
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 5061 - 5064
  • [36] Structure-enhanced meta-learning for few-shot graph classification
    Jiang, Shunyu
    Feng, Fuli
    Chen, Weijian
    Li, Xiang
    He, Xiangnan
    AI OPEN, 2021, 2 : 160 - 167
  • [37] Few-shot Node Classification on Attributed Networks with Graph Meta-learning
    Liu, Yonghao
    Li, Mengyu
    Li, Ximing
    Giunchiglia, Fausto
    Feng, Xiaoyue
    Guan, Renchu
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 471 - 481
  • [38] Meta-Learning for Few-Shot NMT Adaptation
    Sharaf, Amr
    Hassan, Hany
    Daume, Hal, III
    NEURAL GENERATION AND TRANSLATION, 2020, : 43 - 53
  • [39] MedOptNet: Meta-Learning Framework for Few-Shot Medical Image Classification
    Lu, Liangfu
    Cui, Xudong
    Tan, Zhiyuan
    Wu, Yulei
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2024, 21 (04) : 725 - 736
  • [40] Mutual Learning Prototype Network for Few-Shot Text Classification
    Liu, Jun
    Qin, Xiaorui
    Tao, Jian
    Dong, Hongfei
    Li, Xiaoxu
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (03): : 30 - 35