Zero-Shot Rumor Detection via Meta Multi-Task Prompt Learning

被引:0
|
作者
Shi, Yu [1 ]
Yu, Ning [1 ]
Sun, Yawei [1 ]
Liu, Jianyi [2 ]
机构
[1] Key Laboratory of Trustworthy Distributed Computing and Service, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing,100876, China
[2] School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing,100876, China
关键词
Adversarial machine learning - Contrastive Learning - Learning systems - Multi-task learning;
D O I
10.13190/j.jbupt.2023-270
中图分类号
学科分类号
摘要
To address the issue of the vast amount of memory usage associated with fine-tuning large language models in existing rumor detection methods, and to tackle the sensitivity of prompt learning to its initial point, a meta multi-task prompt learning method for zero-shot rumor detection is proposed. First, the objective of the zero-shot rumor detection task objective is modified based on the prompt learning, and the prompt template is designed to make its task objective align with the training task objective of large language models, fully leveraging the prior knowledge accumulated by large language models. Second, the parameter update strategy based on meta-learning is employed to rapidly identify suitable initial points of the prompt template for zero-shot rumor detection, and the meta-knowledge is learned from different meta-tasks to achieve parameter optimization. Finally, sentiment analysis is introduced as an auxiliary meta-task to further model parameter optimization. Extensive experiments conducted on real-world datasets demonstrate that the proposed model outperforms baseline methods in zero-shot rumor detection tasks, achieving the best performance across various metrics. © 2024 Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:77 / 82
相关论文
共 50 条
  • [41] Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning
    Yue, Zhenrui
    Zeng, Huimin
    Lan, Mengfei
    Ji, Heng
    Wang, Dong
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 7928 - 7943
  • [42] Zero-Shot Learning via Visual Abstraction
    Antol, Stanislaw
    Zitnick, C. Lawrence
    Parikh, Devi
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 401 - 416
  • [43] Rumor Detection By Exploiting User Credibility Information, Attention and Multi-task Learning
    Li, Quanzhi
    Zhang, Qiong
    Si, Luo
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 1173 - 1179
  • [44] Zero-Shot Task Transfer
    Pal, Arghya
    Balasubramanian, Vineeth N.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2184 - 2193
  • [45] Transductive Learning for Zero-Shot Object Detection
    Rahman, Shafin
    Khan, Salman
    Barnes, Nick
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6081 - 6090
  • [46] XLPT-AMR: Cross-Lingual Pre-Training via Multi-Task Learning for Zero-Shot AMR Parsing and Text Generation
    Xu, Dongqin
    Li, Junhui
    Zhu, Muhua
    Zhang, Min
    Zhou, Guodong
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 896 - 907
  • [47] Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learning
    Wu, Zheng
    Xie, Yichen
    Lian, Wenzhao
    Wang, Changhao
    Guo, Yanjiang
    Chen, Jianyu
    Schaal, Stefan
    Tomizuka, Masayoshi
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 7169 - 7175
  • [48] Adaptive Multi-task Learning for Few-Shot Object Detection
    Ren, Yan
    Li, Yanling
    Kong, Adams Wai-Kin
    COMPUTER VISION-ECCV 2024, PT VII, 2025, 15065 : 297 - 314
  • [49] Few-shot Log Analysis with Prompt-based Multi-task Transfer Learning
    Zhou, Mingjie
    Yang, Weidong
    Ma, Lipeng
    Jiang, Sihang
    Xu, Bo
    Xiao, Yanghua
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2024, PT 2, 2025, 14851 : 466 - 475
  • [50] HOICS: ZERO-SHOT HOI DETECTION VIA COMPATIBILITY SELF-LEARNING
    Jiang, Miao
    Li, Min
    Ren, Junxing
    Huang, Weiqing
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4185 - 4189