Meta-learning triplet contrast network for few-shot text classification

被引:0
|
作者
Dong, Kaifang [1 ]
Jiang, Baoxing [2 ]
Li, Hongye [1 ]
Zhu, Zhenfang [3 ]
Liu, Peiyu [1 ]
机构
[1] Shandong Normal Univ, Jinan 250358, Shandong, Peoples R China
[2] Sichuan Univ, Chengdu 610005, Sichuan, Peoples R China
[3] Shandong Jiaotong Univ, Jinan 250357, Shandong, Peoples R China
关键词
Few-shot learning; Text classification; Triplet network; Natural language processing;
D O I
10.1016/j.knosys.2024.112440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot text classification (FSTC) strives to predict classes not involved in the training by learning from a few labeled examples. Currently, most tasks construct meta-tasks in a randomized manner that fails to give more priority to hard-to-identify classes and samples. Besides, some tasks incorporated a contrast strategy, but the sample could only be compared to positive or negative examples individually. In this work, we propose a Meta-learning Triplet Contrast Network (Meta-TCN) with bidirectional contrast capability to solve the above problem. Specifically, Meta-TCN uses external knowledge with labeled information as the class examples, which decouples the embedding of prototypes from the support pool. Meanwhile, the class examples combine the support samples to construct triplet pairs used for learning. Unlike previous studies, the model can learn negative and positive knowledge simultaneously, ensuring that understanding is enriched and enhances learning. Further, we improve the shortcomings of randomness in the meta-task construction process by proposing a Dynamic Rate of Change (DRC) sampling strategy. DRC enhances the model's focus on difficult-to- classify samples. We conducted extensive experiments on six benchmark datasets such as Huffpost and RCV1. Experiments show that the average accuracy of Meta-TCN can achieve state-of-the-art performance in the vast majority of tasks.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification
    Han, ChengCheng
    Fan, Zeqiu
    Zhang, Dongxiang
    Qiu, Minghui
    Gao, Ming
    Zhou, Aoying
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1664 - 1673
  • [2] MEDA: Meta-Learning with Data Augmentation for Few-Shot Text Classification
    Sun, Pengfei
    Ouyang, Yawen
    Zhang, Wenming
    Dai, Xin-yu
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3929 - 3935
  • [3] Fair Meta-Learning For Few-Shot Classification
    Zhao, Chen
    Li, Changbin
    Li, Jincheng
    Chen, Feng
    11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 275 - 282
  • [4] Dual adversarial network with meta-learning for domain-generalized few-shot text classification
    Wang, Xuyang
    Du, Yajun
    Chen, Danroujing
    Li, Xianyong
    Chen, Xiaoliang
    Fan, Yongquan
    Xie, Chunzhi
    Li, Yanli
    Liu, Jia
    Li, Hui
    APPLIED SOFT COMPUTING, 2023, 146
  • [5] Meta-Learning Classification Network for Few-Shot Polarimetric SAR Images
    Luo, Huiqi
    Jiang, Nana
    Wang, Hui
    Guo, Jiao
    Zhu, Jubo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [6] Improving Meta-learning for Few-Shot Text Classification via Label Propagation
    Li, Haorui
    Shao, Jie
    Zeng, Xiangqiang
    Xu, Hui
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT V, ECML PKDD 2024, 2024, 14945 : 389 - 405
  • [7] Few-Shot Directed Meta-Learning for Image Classification
    Ouyang, Jihong
    Duan, Ganghai
    Liu, Siguang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (01)
  • [8] Unsupervised Meta-Learning for Few-Shot Image Classification
    Khodadadeh, Siavash
    Boloni, Ladislau
    Shah, Mubarak
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [9] Contrastive Meta-Learning for Few-shot Node Classification
    Wang, Song
    Tan, Zhen
    Liu, Huan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2386 - 2397
  • [10] Few-shot Edge Classification in Graph Meta-learning
    Yang, Xiaoxiao
    Xu, Jungang
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 166 - 172