Adversarial contrastive representation training with external knowledge injection for zero-shot stance detection

被引:0
|
作者
Ding, Yifan [1 ]
Lei, Ying [1 ]
Wang, Anqi [1 ]
Liu, Xiangrun [1 ]
Zhu, Tuanfei [2 ]
Li, Yizhou [1 ]
机构
[1] Sichuan Univ, Coll Cyber Sci & Engn, Chengdu, Peoples R China
[2] Changsha Univ, Sch Comp Sci & Engn, Changsha, Peoples R China
关键词
Natural language process; Stance detection; Contrastive learning; Zero-shot; Adversarial learning; Large language model;
D O I
10.1016/j.neucom.2024.128849
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection (ZSSD) is a task that involves identifying the author's perspective on specific issues in text, particularly when the target topic has not been encountered during the model training process, to address rapidly evolving topics on social media. This paper introduces a ZSSD framework named KEL-CA. To enable the model to more effectively utilize transferable stance features for representing unseen targets, the framework incorporates a multi-layer contrastive learning and adversarial domain transfer module. Unlike traditional contrastive or adversarial learning, our framework captures both correlations and distinctions between invariant and specific features, as well as between different stance labels, and enhances the generalization ability and robustness of the features. Subsequently, to address the problem of insufficient information about the target context, we designed a dual external knowledge injection module that uses a large language model (LLM) to extract external knowledge from a Wikipedia-based local knowledge base and a Chain-of-Thought (COT) process to ensure the timeliness and relevance of the knowledge to infer the stances of unseen targets. Experimental results demonstrate that our approach outperforms existing models on two benchmark datasets, thereby validating its efficacy in ZSSD tasks.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] CONNECTING TARGETS VIA LATENT TOPICS AND CONTRASTIVE LEARNING: A UNIFIED FRAMEWORK FOR ROBUST ZERO-SHOT AND FEW-SHOT STANCE DETECTION
    Liu, Rui
    Lin, Zheng
    Fu, Peng
    Liu, Yuanxin
    Wang, Weiping
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7812 - 7816
  • [32] Zero-shot stance detection based on multi-expert collaboration
    Zhao, Xuechen
    Ma, Guodong
    Pang, Shengnan
    Guo, Yanhui
    Zhao, Jianxiu
    Miao, Jinfeng
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [33] ZDDR: A Zero-Shot Defender for Adversarial Samples Detection and Restoration
    Chen, Musheng
    He, Guowei
    Wu, Junhua
    IEEE ACCESS, 2024, 12 : 39081 - 39094
  • [34] Zero-Shot Action Recognition with Knowledge Enhanced Generative Adversarial Networks
    Huang, Kaiqiang
    Miralles-Pechuan, Luis
    Mckeever, Susan
    PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL INTELLIGENCE (IJCCI), 2021, : 254 - 264
  • [35] Transformer-Based Zero-Shot Detection via Contrastive Learning
    Liu, Wei
    Chen, Hui
    Ma, Yongqiang
    Wang, Jianji
    Zheng, Nanning
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2022, PART I, 2022, 646 : 316 - 327
  • [36] Robust Zero-Shot Intent Detection via Contrastive Transfer Learning
    Maqbool, M. H.
    Khan, F. A.
    Siddique, A. B.
    Foroosh, Hassan
    2023 IEEE 17TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC, 2023, : 49 - 56
  • [37] Semantics-Guided Contrastive Network for Zero-Shot Object Detection
    Yan, Caixia
    Chang, Xiaojun
    Luo, Minnan
    Liu, Huan
    Zhang, Xiaoqin
    Zheng, Qinghua
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1530 - 1544
  • [38] Knowledge Enhanced Zero-Shot Visual Relationship Detection
    Ding, Nan
    Lai, Yong
    Liu, Jie
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2024, 2024, 14886 : 3 - 15
  • [39] Contrastive Embedding for Generalized Zero-Shot Learning
    Han, Zongyan
    Fu, Zhenyong
    Chen, Shuo
    Yang, Jian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2371 - 2381
  • [40] Zero-Shot and Few-Shot Stance Detection on Varied Topics via Conditional Generation
    Wen, Haoyang
    Hauptmann, Alexander G.
    61ST CONFERENCE OF THE THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 2, 2023, : 1491 - 1499