Feature Enhanced Zero-Shot Stance Detection via Contrastive Learning

被引:0
|
作者
Zhao, Xuechen [1 ]
Zou, Jiaying [1 ]
Zhang, Zhong [1 ]
Xie, Feng [1 ]
Zhou, Bin [1 ,2 ]
Tian, Lei [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha, Peoples R China
[2] Key Lab Software Engn Complex Syst, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection. In this paper, we propose a stance detection approach that can efficiently adapt to unseen targets, the core of which is to capture target-invariant syntactic expression patterns as transferable knowledge. Specifically, we first augment the data by masking the topic words of sentences, and then feed the augmented data to an unsupervised contrastive learning module to capture transferable features. Besides, to fit a specific target, we encode the raw text as target-specific features. Finally, we adopt an attention mechanism, which combines syntactic expression patterns with target-specific features to obtain enhanced features for predicting previously unseen targets. Experiments demonstrate that our model outperforms competitive baselines on four benchmark datasets.
引用
收藏
页码:900 / 908
页数:9
相关论文
共 50 条
  • [1] Zero-Shot Stance Detection via Contrastive Learning
    Liang, Bin
    Chen, Zixiao
    Gui, Lin
    He, Yulan
    Yang, Min
    Xu, Ruifeng
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2738 - 2747
  • [2] Zero-Shot Stance Detection via Sentiment-Stance Contrastive Learning
    Zou, Jiaying
    Zhao, Xuechen
    Xie, Feng
    Zhou, Bin
    Zhang, Zhong
    Tian, Lei
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 251 - 258
  • [3] Enhancing Zero-Shot Stance Detection with Contrastive and Prompt Learning
    Yao, Zhenyin
    Yang, Wenzhong
    Wei, Fuyuan
    ENTROPY, 2024, 26 (04)
  • [4] JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection
    Liang, Bin
    Zhu, Qinglin
    Li, Xiang
    Yang, Min
    Gui, Lin
    He, Yulan
    Xu, Ruifeng
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 81 - 91
  • [5] Zero-shot stance detection via multi-perspective contrastive with unlabeled data
    Jiang, Yan
    Gao, Jinhua
    Shen, Huawei
    Cheng, Xueqi
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (04)
  • [6] A meta-contrastive learning with data augmentation framework for zero-shot stance detection
    Wang, Chunling
    Zhang, Yijia
    Wang, Shilong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 250
  • [7] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Zhang, Yu
    Wang, Chunling
    Wang, Jia
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [8] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Yu Zhang
    Chunling Wang
    Jia Wang
    International Journal of Computational Intelligence Systems, 16
  • [9] Transformer-Based Zero-Shot Detection via Contrastive Learning
    Liu, Wei
    Chen, Hui
    Ma, Yongqiang
    Wang, Jianji
    Zheng, Nanning
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2022, PART I, 2022, 646 : 316 - 327
  • [10] Robust Zero-Shot Intent Detection via Contrastive Transfer Learning
    Maqbool, M. H.
    Khan, F. A.
    Siddique, A. B.
    Foroosh, Hassan
    2023 IEEE 17TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC, 2023, : 49 - 56