Fake News Classification Methodology With Enhanced BERT

被引:0
|
作者
Oad, Ammar [1 ]
Farooq, Muhammad Hamza [2 ]
Zafar, Amna [3 ]
Akram, Beenish Ayesha [4 ]
Zhou, Ruogu [5 ]
Dong, Feng [1 ]
机构
[1] Shaoyang Univ, Fac Informat Engn, Shaoyang 422000, Peoples R China
[2] Univ Engn & Technol Lahore UET Lahore, Natl Ctr Artificial Intelligence, KICS, Lahore, Pakistan
[3] Univ Engn & Technol Lahore, Dept Comp Sci, Lahore 54890, Pakistan
[4] Univ Engn & Technol, Dept Comp Engn, Lahore 54890, Pakistan
[5] Hunan Vocat Coll Commerce, Changsha 410205, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Fake news; Accuracy; Social networking (online); Support vector machines; Long short term memory; Encoding; Bidirectional control; Cultural differences; Classification algorithms; Transformers; Bidirectional encoder representations from transformers (BERT); natural language processing; transformers; fake news classification; gradient boosting classifier; machine learning (ML); deep learning (DL); large language model (LLM);
D O I
10.1109/ACCESS.2024.3491376
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
News serves as a vital source of information for staying updated on various aspects of life worldwide. However, massive volume of information available on social media platforms makes it challenging to extract meaningful insights. Additionally, dispersion of false information has grown broader, often serving specific agendas. In this work, we present a novel fake news classification methodology based on an enhanced BERT deep learning model which is trained on self-developed PolitiTweet datasets along with benchmarked Buzzfeed dataset. The PolitiTweet dataset is augmented to solve class imbalance problem and improve data diversity to capture regional language nuances, cultural references that help in more accurate detection of fake news. For this purpose, We enhance BERTbase model by adding 3 additional layers namely Linear Layer, Dropout Layer, Activation Layer and fine tuned the model to train enhanced BERT classifier. The fine tuned BERT model trained on augmented dataset is capable of capturing patterns and nuances within the data, giving better classification results. Subsequently, the enhanced BERT model is evaluated against BERTbase model for further elaboration on the generalisibility and effective performance of the fine tuned model for real-world cases. The enhanced BERT model achieved an accuracy of 85% on Buzzfeed and 98% on PolitiTweet. In comparison the baseline BERT models achieved an average accuracy of 81% and 88%, respectively. The proposed Enhanced BERT model uses a mix of pre-training strategies with fine-tuning techniques to achieve better performance. The developed research data is available online at: https://www.kaggle.com/datasets/ameerhamza123/pak-tweets.
引用
收藏
页码:164491 / 164502
页数:12
相关论文
共 50 条
  • [1] Fake News Classification using transformer based enhanced LSTM and BERT
    Rai N.
    Kumar D.
    Kaushik N.
    Raj C.
    Ali A.
    International Journal of Cognitive Computing in Engineering, 2022, 3 : 98 - 105
  • [2] Fake News Detection Using Enhanced BERT
    Aljawarneh, Shadi A.
    Swedat, Safa Ahmad
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04): : 4843 - 4850
  • [3] AugFake-BERT: Handling Imbalance through Augmentation of Fake News Using BERT to Enhance the Performance of Fake News Classification
    Keya, Ashfia Jannat
    Wadud, Md Anwar Hussen
    Mridha, M. F.
    Alatiyyah, Mohammed
    Hamid, Md Abdul
    APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [4] Fake News Detection System, based on CBOW and BERT
    Vo, Trung Hung
    Felde, Imre
    Ninh, Khanh Chi
    ACTA POLYTECHNICA HUNGARICA, 2025, 22 (01) : 27 - 41
  • [5] A BERT-Based Semantic Enhanced Model for COVID-19 Fake News Detection
    Yin, Hui
    Liu, Xiao
    Wu, Yutao
    Aria, Hilya Mudrika
    Mohawesh, Rami
    WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 1 - 15
  • [6] Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection
    Nguyen Manh Duc Tuan
    Pham Quang Nhat Minh
    2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 43 - 48
  • [7] Fake News Detection Using BERT Model with Joint Learning
    Wesam Shishah
    Arabian Journal for Science and Engineering, 2021, 46 : 9115 - 9127
  • [8] Fake news detection based on a hybrid BERT and LightGBM models
    Ehab Essa
    Karima Omar
    Ali Alqahtani
    Complex & Intelligent Systems, 2023, 9 : 6581 - 6592
  • [9] Fake News Detection Using BERT Model with Joint Learning
    Shishah, Wesam
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2021, 46 (09) : 9115 - 9127
  • [10] Detection of Turkish Fake News From Tweets With BERT Models
    Koru, Gulsum Kayabasi
    Uluyol, Celebi
    IEEE ACCESS, 2024, 12 : 14918 - 14931