Multi-Label Text Classification Based on Contrastive and Correlation Learning

被引:0
|
作者
Yang, Shuo [1 ]
Gao, Shu [1 ]
机构
[1] Wuhan Univ Technol, Sch Comp Sci & Artificial Intelligence, Wuhan 430070, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-label text classification; label correlation; contrastive learning; graph attention mechanism; label semantics;
D O I
10.1145/3672919.3672979
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-label text classification plays a crucial role in various domains. However, accurately capturing complex inter-label relationships and delving into the semantic information between labels and text remains a challenging problem. Therefore, we propose a multi-label text classification method based on contrastive and correlation learning. By introducing contrastive learning into multi-label text classification tasks, it enhances the distinctiveness and expressiveness of text and label features. In the extraction of label features, external knowledge from Wikipedia is incorporated and various embedding methods are employed to extract label information, enabling a deeper exploration of label semantics. Meanwhile, GAT is used to more accurately extract inter-label correlations. In the prediction module, an improved label correlation network is introduced to further consider label relevance. Experimental results demonstrate the feasibility and effectiveness of the proposed method on two publicly available datasets, AAPD and RCV1. Compared to state-of-the-art models, our method achieves a 0.5%-1.5% improvement in micro-F1 metrics, validating the efficacy of the approach.
引用
收藏
页码:325 / 330
页数:6
相关论文
共 50 条
  • [1] Contrastive Enhanced Learning for Multi-Label Text Classification
    Wu, Tianxiang
    Yang, Shuqun
    APPLIED SCIENCES-BASEL, 2024, 14 (19):
  • [2] Hierarchical contrastive learning for multi-label text classification
    Wei Zhang
    Yun Jiang
    Yun Fang
    Shuai Pan
    Scientific Reports, 15 (1)
  • [3] An Effective Deployment of Contrastive Learning in Multi-label Text Classification
    Lin, Nankai
    Qin, Guanqiu
    Wang, Jigang
    Zhou, Dong
    Yang, Aimin
    Proceedings of the Annual Meeting of the Association for Computational Linguistics, 2023, : 8730 - 8744
  • [4] An Effective Deployment of Contrastive Learning in Multi-label Text Classification
    Lin, Nankai
    Qin, Guanqiu
    Wang, Jigang
    Zhou, Dong
    Yang, Aimin
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 8730 - 8744
  • [5] Hierarchical text classification with multi-label contrastive learning and KNN
    Zhang, Jun
    Li, Yubin
    Shen, Fanfan
    He, Yueshun
    Tan, Hai
    He, Yanxiang
    NEUROCOMPUTING, 2024, 577
  • [6] Multi-Label Text Classification Based on DistilBERT and Label Correlation
    Wang, Xuyang
    Geng, Liuqing
    Zhang, Xin
    Computer Engineering and Applications, 2024, 60 (23) : 168 - 175
  • [7] Exploring Contrastive Learning for Long-Tailed Multi-label Text Classification
    Audibert, Alexandre
    Gauffre, Aurelien
    Amini, Massih-Reza
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT VII, ECML PKDD 2024, 2024, 14947 : 245 - 261
  • [8] Multi-label text classification based on the label correlation mixture model
    He, Zhiyang
    Wu, Ji
    Lv, Ping
    INTELLIGENT DATA ANALYSIS, 2017, 21 (06) : 1371 - 1392
  • [9] LSPCL: Label-specific supervised prototype contrastive learning for multi-label text classification
    Wang, Gang
    Du, Yajun
    Jiang, Yurui
    KNOWLEDGE-BASED SYSTEMS, 2025, 309
  • [10] Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification
    Su, Xi'ao
    Wang, Ran
    Dai, Xinyu
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022): (SHORT PAPERS), VOL 2, 2022, : 672 - 679