Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network

被引:7
|
作者
Arshed, Muhammad Asad [1 ,2 ]
Alwadain, Ayed [3 ]
Ali, Rao Faizan [2 ]
Mumtaz, Shahzad [4 ]
Ibrahim, Muhammad [1 ]
Muneer, Amgad [5 ,6 ]
机构
[1] Islamia Univ Bahawalpur, Dept Comp Sci, Bahawalpur 63100, Pakistan
[2] Univ Management & Technol, Sch Syst & Technol, Lahore 54770, Pakistan
[3] King Saud Univ, Community Coll, Comp Sci Dept, Riyadh 145111, Saudi Arabia
[4] Islamia Univ Bahawalpur, Dept Data Sci, Bahawalpur 63100, Pakistan
[5] Univ Texas MD Anderson Canc Ctr, Dept Imaging Phys, Houston, TX 77030 USA
[6] Univ Teknol Petronas, Dept Comp & Informat Sci, Seri Iskandar 32160, Malaysia
关键词
deepfake; identification; Vision Transformer; pretrained; fine tuning;
D O I
10.3390/math11173710
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
With the development of image-generating technologies, significant progress has been made in the field of facial manipulation techniques. These techniques allow people to easily modify media information, such as videos and images, by substituting the identity or facial expression of one person with the face of another. This has significantly increased the availability and accessibility of such tools and manipulated content termed 'deepfakes'. Developing an accurate method for detecting fake images needs time to prevent their misuse and manipulation. This paper examines the capabilities of the Vision Transformer (ViT), i.e., extracting global features to detect deepfake images effectively. After conducting comprehensive experiments, our method demonstrates a high level of effectiveness, achieving a detection accuracy, precision, recall, and F1 rate of 99.5 to 100% for both the original and mixture data set. According to our existing understanding, this study is a research endeavor incorporating real-world applications, specifically examining Snapchat-filtered images.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection
    Ba, Zhongjie
    Liu, Qingyu
    Liu, Zhenguang
    Wu, Shuang
    Lin, Feng
    Lu, Li
    Ren, Kui
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 719 - 728
  • [22] Enhancing Deepfake Detection Through Quantum Transfer Learning and Class-Attention Vision Transformer Architecture
    Kati, Bekir Eray
    Kucuksille, Ecir Ugur
    Sariman, Guencel
    APPLIED SCIENCES-BASEL, 2025, 15 (02):
  • [23] Self-Supervised Graph Transformer for Deepfake Detection
    Khormali, Aminollah
    Yuan, Jiann-Shiun
    IEEE ACCESS, 2024, 12 : 58114 - 58127
  • [24] HolisticDFD: Infusing spatiotemporal transformer embeddings for deepfake detection
    Raza, Muhammad Anas
    Malik, Khalid Mahmood
    Haq, Ijaz Ul
    INFORMATION SCIENCES, 2023, 645
  • [25] Unmasking deception: deepfake regulation in the context of South African law, could a rethinking of performers' protection rights be the answer?
    Gotora, Ngonidzaishe T.
    INTERNATIONAL JOURNAL OF LAW AND INFORMATION TECHNOLOGY, 2024, 32 (01):
  • [26] Spatio-temporal knowledge distilled video vision transformer (STKD-VViT) for multimodal deepfake detection
    Usmani, Shaheen
    Kumar, Sunil
    Sadhya, Debanjan
    NEUROCOMPUTING, 2025, 620
  • [27] Combining EfficientNet and Vision Transformers for Video Deepfake Detection
    Coccomini, Davide Alessandro
    Messina, Nicola
    Gennaro, Claudio
    Falchi, Fabrizio
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 219 - 229
  • [28] Empowering Network Security: BERT Transformer Learning Approach and MLP for Intrusion Detection in Imbalanced Network Traffic
    Ali, Zeeshan
    Tiberti, Walter
    Marotta, Andrea
    Cassioli, Dajana
    IEEE ACCESS, 2024, 12 : 137618 - 137633
  • [29] ConTrans-Detect: A Multi-Scale Convolution-Transformer Network for DeepFake Video Detection
    Sun, Weirong
    Ma, Yujun
    Zhang, Hong
    Wang, Ruili
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [30] Transformer-Based Feature Compensation and Aggregation for DeepFake Detection
    Tan, Zichang
    Yang, Zhichao
    Miao, Changtao
    Guo, Guodong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2183 - 2187