Meta-prompt based learning for low-resource false information detection

被引:5
|
作者
Huang Y. [1 ,2 ]
Gao M. [1 ,2 ]
Wang J. [1 ,2 ]
Yin J. [1 ,2 ]
Shu K. [3 ]
Fan Q. [1 ,2 ]
Wen J. [1 ,2 ]
机构
[1] Key Laboratory of Dependable Service Computing in Cyber Physical Society (Chongqing University), Ministry of Education, Chongqing
[2] School of Big Data and Software Engineering, Chongqing University, Chongqing
[3] Department of Computer Science, Illinois Institute of Technology, Chicago, IL
来源
Information Processing and Management | 2023年 / 60卷 / 03期
基金
中国国家自然科学基金;
关键词
False information detection; Meta learning; Prompt learning;
D O I
10.1016/j.ipm.2023.103279
中图分类号
学科分类号
摘要
The wide spread of false information has detrimental effects on society, and false information detection has received wide attention. When new domains appear, the relevant labeled data is scarce, which brings severe challenges to the detection. Previous work mainly leverages additional data or domain adaptation technology to assist detection. The former would lead to a severe data burden; the latter underutilizes the pre-trained language model because there is a gap between the downstream task and the pre-training task, which is also inefficient for model storage because it needs to store a set of parameters for each domain. To this end, we propose a meta-prompt based learning (MAP) framework for low-resource false information detection. We excavate the potential of pre-trained language models by transforming the detection tasks into pre-training tasks by constructing template. To solve the problem of the randomly initialized template hindering excavation performance, we learn optimal initialized parameters by borrowing the benefit of meta learning in fast parameter training. The combination of meta learning and prompt learning for the detection is non-trivial: Constructing meta tasks to get initialized parameters suitable for different domains and setting up the prompt model's verbalizer for classification in the noisy low-resource scenario are challenging. For the former, we propose a multi-domain meta task construction method to learn domain-invariant meta knowledge. For the latter, we propose a prototype verbalizer to summarize category information and design a noise-resistant prototyping strategy to reduce the influence of noise data. Extensive experiments on real-world data demonstrate the superiority of the MAP in new domains of false information detection. © 2023 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [1] Meta-prompt based learning for low-resource false information detection
    Huang, Yinqiu
    Gao, Min
    Wang, Jia
    Yin, Junwei
    Shu, Kai
    Fan, Qilin
    Wen, Junhao
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (03)
  • [2] Meta-Prompt: Boosting Whisper's Performance in Low-Resource Speech Recognition
    Chen, Yaqi
    Niu, Tong
    Zhang, Hao
    Zhang, Wenlin
    Qu, Dan
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3039 - 3043
  • [3] Hypernymy Detection for Low-Resource Languages via Meta Learning
    Yu, Changlong
    Hang, Jialong
    Zhang, Haisong
    Ng, Wilfred
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3651 - 3656
  • [4] Meta Learning for Low-Resource Molecular Optimization
    Wang, Jiahao
    Zheng, Shuangjia
    Chen, Jianwen
    Yang, Yuedong
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2021, 61 (04) : 1627 - 1636
  • [5] Prompt-based for Low-Resource Tibetan Text Classification
    An, Bo
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (08)
  • [6] A Prompt-Based Topic-Modeling Method for Depression Detection on Low-Resource Data
    Guo, Yanrong
    Liu, Jilong
    Wang, Lei
    Qin, Wei
    Hao, Shijie
    Hong, Richang
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (01) : 1430 - 1439
  • [7] A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models
    Jin, Woojeong
    Cheng, Yu
    Shen, Yelong
    Chen, Weizhu
    Ren, Xiang
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 2763 - 2775
  • [8] Exploring low-resource medical image classification with weakly supervised prompt learning
    Zheng, Fudan
    Cao, Jindong
    Yu, Weijiang
    Chen, Zhiguang
    Xiao, Nong
    Lu, Yutong
    PATTERN RECOGNITION, 2024, 149
  • [9] Meta adversarial learning improves low-resource speech recognition
    Chen, Yaqi
    Yang, Xukui
    Zhang, Hao
    Zhang, Wenlin
    Qu, Dan
    Chen, Cong
    COMPUTER SPEECH AND LANGUAGE, 2024, 84
  • [10] Meta Auxiliary Learning for Low-resource Spoken Language Understanding
    Gao, Yingying
    Feng, Junlan
    Deng, Chao
    Zhang, Shilei
    INTERSPEECH 2022, 2022, : 2703 - 2707