Towards Detection of AI-Generated Texts and Misinformation

被引:2
|
作者
Najee-Ullah, Ahmad [1 ]
Landeros, Luis [1 ]
Balytskyi, Yaroslav [1 ]
Chang, Sang-Yoon [1 ]
机构
[1] Univ Colorado, Colorado Springs, CO 80918 USA
基金
美国国家科学基金会;
关键词
Misinformation detection; Bot detection; Artificial intelligence; Generative Pre-trained Transformer (GPT); Natural language processing; Machine learning; Neural networks; Bidirectional Encoder Representations from Transformers (BERT);
D O I
10.1007/978-3-031-10183-0_10
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Artificial Intelligence (AI) in the form of social text bots has emerged online in social media platforms such as Reddit, Facebook, Twitter, and Instagram. The increased cultural dependency on information and online interaction has given rise to bad actors who use text bots to generate and post texts on these platforms. Using the influence of social media, these actors are able to quickly disseminate misinformation and disinformation to change public perception on controversial political, economic, and social issues. To detect such AI-bot-based misinformation, we build a machine-learning-based algorithm and test it against the popular text generation algorithm, Generative Pre-trained Transformer (GPT), to show its effectiveness for distinguishing between AI-generated and human generated texts. Using a Neural Network with three hidden layers and Small BERT, we achieve a high accuracy performance between 97% and 99% depending on the loss function utilized for detection classification. This paper aims to facilitate future research in text bot detection in order to defend against misinformation and explore future research directions.
引用
收藏
页码:194 / 205
页数:12
相关论文
共 50 条
  • [1] Intrinsic Dimension Estimation for Robust Detection of AI-Generated Texts
    Tulchinskii, Eduard
    Kuznetsov, Kristian
    Kushnareva, Laida
    Cherniavskii, Daniil
    Nikolenko, Sergey
    Burnaev, Evgeny
    Barannikov, Serguei
    Piontkovskaya, Irina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] Detecting AI-Generated Texts in Cross-Domains
    Zhou, You
    Wang, Jie
    PROCEEDINGS OF THE 2024 ACM SYMPOSIUM ON DOCUMENT ENGINEERING, DOCENG 2024, 2024,
  • [3] Online Detection of AI-Generated Images
    Epstein, David C.
    Jain, Ishan
    Wang, Oliver
    Zhang, Richard
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 382 - 392
  • [4] AI-generated misinformation in the election year 2024: measures of European Union
    Shukla, Aditya Kumar
    Tripathi, Shraddha
    FRONTIERS IN POLITICAL SCIENCE, 2024, 6
  • [5] Human cognition and AI-generated texts: ethics in educational settings
    Doenyas, Ceymi
    HUMANITIES & SOCIAL SCIENCES COMMUNICATIONS, 2024, 11 (01):
  • [6] Testing of detection tools for AI-generated text
    Weber-Wulff, Debora
    Anohina-Naumeca, Alla
    Bjelobaba, Sonja
    Foltynek, Tomas
    Guerrero-Dib, Jean
    Popoola, Olumide
    Sigut, Petr
    Waddington, Lorna
    INTERNATIONAL JOURNAL FOR EDUCATIONAL INTEGRITY, 2023, 19 (01)
  • [7] Testing of detection tools for AI-generated text
    Debora Weber-Wulff
    Alla Anohina-Naumeca
    Sonja Bjelobaba
    Tomáš Foltýnek
    Jean Guerrero-Dib
    Olumide Popoola
    Petr Šigut
    Lorna Waddington
    International Journal for Educational Integrity, 19
  • [8] Detection of AI-Generated Emails - A Case Study
    Gryka, Pawel
    Gradon, Kacper
    Kozlowski, Marek
    Kutyla, Milosz
    Janicki, Artur
    19TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY, AND SECURITY, ARES 2024, 2024,
  • [9] Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions
    Zhou, Jiawei
    Zhang, Yixuan
    Luo, Qianni
    Parker, Andrea G.
    De Choudhury, Munmun
    PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2023), 2023,
  • [10] Towards Fair Detection of AI-Generated Essays in Large-Scale Writing Assessments
    Jiang, Yang
    Hao, Jiangang
    Fauss, Michael
    Li, Chen
    ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, 2024, 2151 : 317 - 324