Zero-Shot Rumor Detection via Meta Multi-Task Prompt Learning

被引:0
|
作者
Shi, Yu [1 ]
Yu, Ning [1 ]
Sun, Yawei [1 ]
Liu, Jianyi [2 ]
机构
[1] Key Laboratory of Trustworthy Distributed Computing and Service, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing,100876, China
[2] School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing,100876, China
关键词
Adversarial machine learning - Contrastive Learning - Learning systems - Multi-task learning;
D O I
10.13190/j.jbupt.2023-270
中图分类号
学科分类号
摘要
To address the issue of the vast amount of memory usage associated with fine-tuning large language models in existing rumor detection methods, and to tackle the sensitivity of prompt learning to its initial point, a meta multi-task prompt learning method for zero-shot rumor detection is proposed. First, the objective of the zero-shot rumor detection task objective is modified based on the prompt learning, and the prompt template is designed to make its task objective align with the training task objective of large language models, fully leveraging the prior knowledge accumulated by large language models. Second, the parameter update strategy based on meta-learning is employed to rapidly identify suitable initial points of the prompt template for zero-shot rumor detection, and the meta-knowledge is learned from different meta-tasks to achieve parameter optimization. Finally, sentiment analysis is introduced as an auxiliary meta-task to further model parameter optimization. Extensive experiments conducted on real-world datasets demonstrate that the proposed model outperforms baseline methods in zero-shot rumor detection tasks, achieving the best performance across various metrics. © 2024 Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:77 / 82
相关论文
共 50 条
  • [31] Meta-Learning for Generalized Zero-Shot Learning
    Verma, Vinay Kumar
    Brahma, Dhanajit
    Rai, Piyush
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6062 - 6069
  • [32] Meta hyperbolic networks for zero-shot learning
    Xu, Yan
    Mu, Lifu
    Ji, Zhong
    Liu, Xiyao
    Han, Jungong
    NEUROCOMPUTING, 2022, 491 : 57 - 66
  • [33] Zero-shot Item-based Recommendation via Multi-task Product Knowledge Graph Pre-Training
    Fan, Ziwei
    Liu, Zhiwei
    Heinecke, Shelby
    Zhang, Jianguo
    Wang, Huan
    Xiong, Caiming
    Yu, Philip S.
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 483 - 493
  • [34] Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections
    Zhong, Ruiqi
    Lee, Kristy
    Zhang, Zheng
    Klein, Dan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 2856 - 2878
  • [35] Multi-Task Neural Sequence Labeling for Zero-Shot Cross-Language Boilerplate Removal
    Wu, Yu-Hao
    Chang, Chia-Hui
    2021 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY (WI-IAT 2021), 2021, : 326 - 334
  • [36] Zero-shot multi-label learning via label factorisation
    Shao, Hang
    Guo, Yuchen
    Ding, Guiguang
    Han, Jungong
    IET COMPUTER VISION, 2019, 13 (02) : 117 - 124
  • [37] Transformer-Based Zero-Shot Detection via Contrastive Learning
    Liu, Wei
    Chen, Hui
    Ma, Yongqiang
    Wang, Jianji
    Zheng, Nanning
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2022, PART I, 2022, 646 : 316 - 327
  • [38] Feature Enhanced Zero-Shot Stance Detection via Contrastive Learning
    Zhao, Xuechen
    Zou, Jiaying
    Zhang, Zhong
    Xie, Feng
    Zhou, Bin
    Tian, Lei
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 900 - 908
  • [39] Robust Zero-Shot Intent Detection via Contrastive Transfer Learning
    Maqbool, M. H.
    Khan, F. A.
    Siddique, A. B.
    Foroosh, Hassan
    2023 IEEE 17TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC, 2023, : 49 - 56
  • [40] Zero-shot Learning via Simultaneous Generating and Learning
    Yu, Hyeonwoo
    Lee, Beomhee
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32