Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network

被引:7
|
作者
Arshed, Muhammad Asad [1 ,2 ]
Alwadain, Ayed [3 ]
Ali, Rao Faizan [2 ]
Mumtaz, Shahzad [4 ]
Ibrahim, Muhammad [1 ]
Muneer, Amgad [5 ,6 ]
机构
[1] Islamia Univ Bahawalpur, Dept Comp Sci, Bahawalpur 63100, Pakistan
[2] Univ Management & Technol, Sch Syst & Technol, Lahore 54770, Pakistan
[3] King Saud Univ, Community Coll, Comp Sci Dept, Riyadh 145111, Saudi Arabia
[4] Islamia Univ Bahawalpur, Dept Data Sci, Bahawalpur 63100, Pakistan
[5] Univ Texas MD Anderson Canc Ctr, Dept Imaging Phys, Houston, TX 77030 USA
[6] Univ Teknol Petronas, Dept Comp & Informat Sci, Seri Iskandar 32160, Malaysia
关键词
deepfake; identification; Vision Transformer; pretrained; fine tuning;
D O I
10.3390/math11173710
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
With the development of image-generating technologies, significant progress has been made in the field of facial manipulation techniques. These techniques allow people to easily modify media information, such as videos and images, by substituting the identity or facial expression of one person with the face of another. This has significantly increased the availability and accessibility of such tools and manipulated content termed 'deepfakes'. Developing an accurate method for detecting fake images needs time to prevent their misuse and manipulation. This paper examines the capabilities of the Vision Transformer (ViT), i.e., extracting global features to detect deepfake images effectively. After conducting comprehensive experiments, our method demonstrates a high level of effectiveness, achieving a detection accuracy, precision, recall, and F1 rate of 99.5 to 100% for both the original and mixture data set. According to our existing understanding, this study is a research endeavor incorporating real-world applications, specifically examining Snapchat-filtered images.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] MSVT: Multiple Spatiotemporal Views Transformer for DeepFake Video Detection
    Yu, Yang
    Ni, Rongrong
    Zhao, Yao
    Yang, Siyuan
    Xia, Fen
    Jiang, Ning
    Zhao, Guoqing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4462 - 4471
  • [32] CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Yao, Yongxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [33] CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Yao, Yongxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [34] Improving Video Vision Transformer for Deepfake Video Detection Using Facial Landmark, Depthwise Separable Convolution and Self Attention
    Ramadhani, Kurniawan Nur
    Munir, Rinaldi
    Utama, Nugraha Priya
    IEEE ACCESS, 2024, 12 : 8932 - 8939
  • [35] Unmasking deepfakes: A systematic review of deepfake detection and generation techniques using artificial intelligence
    Abbas, Fakhar
    Taeihagh, Araz
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [36] Unmasking the digital deception - a comprehensive survey on image forgery and detection techniques
    Bharathiraja, S.
    Kanna, B. Rajesh
    Geetha, S.
    Anusooya, G.
    AUSTRALIAN JOURNAL OF FORENSIC SCIENCES, 2024, 56 (06) : 635 - 683
  • [37] How Close Are Other Computer Vision Tasks to Deepfake Detection?
    Nguyen, Huy H.
    Yamagishi, Junichi
    Echizen, Isao
    2023 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS, IJCB, 2023,
  • [38] Multisemantic Path Neural Network for Deepfake Detection
    Wu, Nan
    Jin, Xin
    Jiang, Qian
    Wang, Puming
    Zhang, Ya
    Yao, Shaowen
    Zhou, Wei
    SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [39] A multi-label classification method based on transformer for deepfake detection
    Deng, Liwei
    Zhu, Yunlong
    Zhao, Dexu
    Chen, Fei
    IMAGE AND VISION COMPUTING, 2024, 152
  • [40] A Transformer-Based DeepFake-Detection Method for Facial Organs
    Xue, Ziyu
    Liu, Qingtong
    Shi, Haichao
    Zou, Ruoyu
    Jiang, Xiuhua
    ELECTRONICS, 2022, 11 (24)