Meta-learning triplet contrast network for few-shot text classification

被引:0
|
作者
Dong, Kaifang [1 ]
Jiang, Baoxing [2 ]
Li, Hongye [1 ]
Zhu, Zhenfang [3 ]
Liu, Peiyu [1 ]
机构
[1] Shandong Normal Univ, Jinan 250358, Shandong, Peoples R China
[2] Sichuan Univ, Chengdu 610005, Sichuan, Peoples R China
[3] Shandong Jiaotong Univ, Jinan 250357, Shandong, Peoples R China
关键词
Few-shot learning; Text classification; Triplet network; Natural language processing;
D O I
10.1016/j.knosys.2024.112440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot text classification (FSTC) strives to predict classes not involved in the training by learning from a few labeled examples. Currently, most tasks construct meta-tasks in a randomized manner that fails to give more priority to hard-to-identify classes and samples. Besides, some tasks incorporated a contrast strategy, but the sample could only be compared to positive or negative examples individually. In this work, we propose a Meta-learning Triplet Contrast Network (Meta-TCN) with bidirectional contrast capability to solve the above problem. Specifically, Meta-TCN uses external knowledge with labeled information as the class examples, which decouples the embedding of prototypes from the support pool. Meanwhile, the class examples combine the support samples to construct triplet pairs used for learning. Unlike previous studies, the model can learn negative and positive knowledge simultaneously, ensuring that understanding is enriched and enhances learning. Further, we improve the shortcomings of randomness in the meta-task construction process by proposing a Dynamic Rate of Change (DRC) sampling strategy. DRC enhances the model's focus on difficult-to- classify samples. We conducted extensive experiments on six benchmark datasets such as Huffpost and RCV1. Experiments show that the average accuracy of Meta-TCN can achieve state-of-the-art performance in the vast majority of tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Meta-Learning for Multi-Label Few-Shot Classification
    Simon, Christian
    Koniusz, Piotr
    Harandi, Mehrtash
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 346 - 355
  • [22] Meta-learning baselines and database for few-shot classification in agriculture
    Li, Yang
    Yang, Jiachen
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 182
  • [23] Generative Probabilistic Meta-Learning for Few-Shot Image Classification
    Fu, Meijun
    Wang, Xiaomin
    Wang, Jun
    Yi, Zhang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (02): : 1947 - 1960
  • [24] Unsupervised meta-learning for few-shot learning
    Xu, Hui
    Wang, Jiaxing
    Li, Hao
    Ouyang, Deqiang
    Shao, Jie
    PATTERN RECOGNITION, 2021, 116
  • [25] Prompt-Based Graph Convolution Adversarial Meta-Learning for Few-Shot Text Classification
    Gong, Ruwei
    Qin, Xizhong
    Ran, Wensheng
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [26] Meta-GNN: On Few-shot Node Classification in Graph Meta-learning
    Zhou, Fan
    Cao, Chengtai
    Zhang, Kunpeng
    Trajcevski, Goce
    Zhong, Ting
    Geng, Ji
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2357 - 2360
  • [27] Few-Shot Classification of Aerial Scene Images via Meta-Learning
    Zhang, Pei
    Bai, Yunpeng
    Wang, Dong
    Bai, Bendu
    Li, Ying
    REMOTE SENSING, 2021, 13 (01) : 1 - 21
  • [28] A META-LEARNING FRAMEWORK FOR FEW-SHOT CLASSIFICATION OF REMOTE SENSING SCENE
    Zhang, Pei
    Bai, Yunpeng
    Wang, Dong
    Bai, Bendu
    Li, Ying
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4590 - 4594
  • [29] Contrastive Knowledge-Augmented Meta-Learning for Few-Shot Classification
    Subramanyam, Rakshith
    Heimann, Mark
    Jayram, T. S.
    Anirudh, Rushil
    Thiagarajan, Jayaraman J.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2478 - 2486
  • [30] A Meta-Learning Approach for Few-Shot Face Forgery Segmentation and Classification
    Lin, Yih-Kai
    Yen, Ting-Yu
    SENSORS, 2023, 23 (07)