Few-shot Hierarchical Text Classification with Bidirectional Path Constraint by label weighting

被引:0
|
作者
Zhang, Mingbao [1 ,2 ]
Song, Rui [4 ]
Li, Xiang [1 ,3 ]
Tavares, Adriano [1 ]
Xu, Hao [4 ]
机构
[1] Univ Minho, Braga, Portugal
[2] Neusoft Educ Technol Co Ltd, Shenyang, Peoples R China
[3] Dalian Neusoft Univ Informat, Dalian, Peoples R China
[4] Jilin Univ, Coll Comp Sci & Technol, Changchun, Peoples R China
关键词
Text analysis; Multi-label classification; Few-shot learning; Weakly-supervised learning;
D O I
10.1016/j.patrec.2025.01.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hierarchical Text Classification (HTC) organizes candidate labels into a hierarchical structure and uses one or more paths within the hierarchy as the ground-truth labels, which has been applied to various downstream tasks, e.g., sentiment analysis and harmful text detection. Existing works often involve data-driven models that are trained on large-scale datasets. However, creating annotated datasets is labor-intensive and timeconsuming. To address this issue, recent work has focused on the few-shot HTC task, where each class has only a few samples, e.g., 5. These approaches perform classification at each layer separately and leverage the prompt learning capability of pre-trained models like BERT. However, we find that these methods always neglect the inter-layer relationships. To solve this problem, we propose anew model called Bidirectional Path Constraint by Label Weighting (BPc-LW). Its basic idea is to use a pre-defined label embedding matrix and a feed-forward neural network for information propagation between layers, while also designing a bidirectional label weighting method to constrain the predictions of each layer to be along the same path in the label hierarchy. In addition, we employ a contrastive learning-based method to enhance the discriminative capacity of the hierarchical embeddings. We compare our proposed method with recent few-shot HTC baseline models across 3 benchmark datasets, and the experimental results demonstrate the effectiveness of BPc-LW.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [21] Joint Few-Shot Text Classification Aided by Label Semantic and Sentence-Aware Interaction
    Wang, Suhe
    Liu, Bo
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [22] Prompt-Based Label-Aware Framework for Few-Shot Multi-Label Text Classification
    Thaminkaew, Thanakorn
    Lertvittayakumjorn, Piyawat
    Vateekul, Peerapon
    IEEE ACCESS, 2024, 12 : 28310 - 28322
  • [23] Hierarchical bidirectional aggregation with prior guided transformer for few-shot segmentation
    Qiuyu Kong
    Jie Jiang
    Junyan Yang
    Qi Wang
    International Journal of Multimedia Information Retrieval, 2023, 12
  • [24] Hierarchical bidirectional aggregation with prior guided transformer for few-shot segmentation
    Kong, Qiuyu
    Jiang, Jie
    Yang, Junyan
    Wang, Qi
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2023, 12 (02)
  • [25] Mask-guided BERT for few-shot text classification
    Liao, Wenxiong
    Liu, Zhengliang
    Dai, Haixing
    Wu, Zihao
    Zhang, Yiyang
    Huang, Xiaoke
    Chen, Yuzhong
    Jiang, Xi
    Liu, David
    Zhu, Dajiang
    Li, Sheng
    Liu, Wei
    Liu, Tianming
    Li, Quanzheng
    Cai, Hongmin
    Li, Xiang
    NEUROCOMPUTING, 2024, 610
  • [26] ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classification
    Chen, Junfan
    Zhang, Richong
    Mao, Yongyi
    Xu, Jie
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10492 - 10500
  • [27] Enhanced Prompt Learning for Few-shot Text Classification Method
    Li R.
    Wei Z.
    Fan Y.
    Ye S.
    Zhang G.
    Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2024, 60 (01): : 1 - 12
  • [28] Mutual Learning Prototype Network for Few-Shot Text Classification
    Liu, Jun
    Qin, Xiaorui
    Tao, Jian
    Dong, Hongfei
    Li, Xiaoxu
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (03): : 30 - 35
  • [29] Knowledge Guided Metric Learning for Few-Shot Text Classification
    Sui, Dianbo
    Chen, Yubo
    Mao, Binjie
    Qiu, Delai
    Liu, Kang
    Zhao, Jun
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 3266 - 3271
  • [30] Boosting Few-Shot Text Classification via Distribution Estimation
    Liu, Han
    Zhang, Feng
    Zhang, Xiaotong
    Zhao, Siyang
    Ma, Fenglong
    Wu, Xiao-Ming
    Chen, Hongyang
    Yu, Hong
    Zhang, Xianchao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 13219 - 13227