Meta-prompt based learning for low-resource false information detection

被引:5
|
作者
Huang Y. [1 ,2 ]
Gao M. [1 ,2 ]
Wang J. [1 ,2 ]
Yin J. [1 ,2 ]
Shu K. [3 ]
Fan Q. [1 ,2 ]
Wen J. [1 ,2 ]
机构
[1] Key Laboratory of Dependable Service Computing in Cyber Physical Society (Chongqing University), Ministry of Education, Chongqing
[2] School of Big Data and Software Engineering, Chongqing University, Chongqing
[3] Department of Computer Science, Illinois Institute of Technology, Chicago, IL
来源
Information Processing and Management | 2023年 / 60卷 / 03期
基金
中国国家自然科学基金;
关键词
False information detection; Meta learning; Prompt learning;
D O I
10.1016/j.ipm.2023.103279
中图分类号
学科分类号
摘要
The wide spread of false information has detrimental effects on society, and false information detection has received wide attention. When new domains appear, the relevant labeled data is scarce, which brings severe challenges to the detection. Previous work mainly leverages additional data or domain adaptation technology to assist detection. The former would lead to a severe data burden; the latter underutilizes the pre-trained language model because there is a gap between the downstream task and the pre-training task, which is also inefficient for model storage because it needs to store a set of parameters for each domain. To this end, we propose a meta-prompt based learning (MAP) framework for low-resource false information detection. We excavate the potential of pre-trained language models by transforming the detection tasks into pre-training tasks by constructing template. To solve the problem of the randomly initialized template hindering excavation performance, we learn optimal initialized parameters by borrowing the benefit of meta learning in fast parameter training. The combination of meta learning and prompt learning for the detection is non-trivial: Constructing meta tasks to get initialized parameters suitable for different domains and setting up the prompt model's verbalizer for classification in the noisy low-resource scenario are challenging. For the former, we propose a multi-domain meta task construction method to learn domain-invariant meta knowledge. For the latter, we propose a prototype verbalizer to summarize category information and design a noise-resistant prototyping strategy to reduce the influence of noise data. Extensive experiments on real-world data demonstrate the superiority of the MAP in new domains of false information detection. © 2023 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [31] Knowledge-Enriched Prompt for Low-Resource Named Entity Recognition
    Hou, Wenlong
    Zhao, Weidong
    Liu, Xianhui
    Guo, Wenyan
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2024, 23 (05)
  • [32] PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching
    Wang, Pengfei
    Zeng, Xiaocan
    Chen, Lu
    Ye, Fan
    Mao, Yuren
    Zhu, Junhao
    Gao, Yunjun
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 16 (02): : 369 - 378
  • [33] Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages
    Nie, Ercong
    Liang, Sheng
    Schmid, Helmut
    Schuetze, Hinrich
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 8320 - 8340
  • [34] Low-resource multi-granularity academic function recognition based on multiple prompt knowledge
    Liu, Jiawei
    Xiong, Zi
    Jiang, Yi
    Ma, Yongqiang
    Lu, Wei
    Huang, Yong
    Cheng, Qikai
    ELECTRONIC LIBRARY, 2024, 42 (06): : 879 - 904
  • [35] Resource Construction and Ensemble Learning Based Sentiment Analysis for the Low-resource Language Uyghur
    Yusup, Azragul
    Chen, Degang
    Ge, Yifei
    Mao, Hongliang
    Wang, Nujian
    JOURNAL OF INTERNET TECHNOLOGY, 2023, 24 (04): : 1009 - 1016
  • [36] Improving Low-Resource Chinese Event Detection with Multi-task Learning
    Tong, Meihan
    Xu, Bin
    Wang, Shuai
    Hou, Lei
    Li, Juaizi
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 421 - 433
  • [37] Towards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning
    Huang, Yi
    Feng, Junlan
    Ma, Shuo
    Du, Xiaoyu
    Wu, Xiaoting
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 4123 - 4128
  • [38] Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generation
    Lin, Shuai
    Zhou, Pan
    Liang, Xiaodan
    Tang, Jianheng
    Zhao, Ruihui
    Chen, Ziliang
    Lin, Liang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13362 - 13370
  • [39] Investigating Meta-Learning Algorithms for Low-Resource Natural Language Understanding Tasks
    Dou, Zi-Yi
    Yu, Keyi
    Anastasopoulos, Antonios
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 1192 - 1197
  • [40] Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning
    Park, Cheonbok
    Tae, Yunwon
    Kim, Taehee
    Yang, Soyoung
    Khan, Mohammad Azam
    Park, Eunjeong
    Choo, Jaegul
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 2888 - 2901