An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System

被引:9
|
作者
Awotunde, Joseph Bamidele [1 ]
Jimoh, Rasheed Gbenga [1 ]
Imoize, Agbotiname Lucky [2 ,3 ]
Abdulrazaq, Akeem Tayo [1 ]
Li, Chun-Ta [4 ,5 ]
Lee, Cheng-Chi [6 ,7 ]
机构
[1] Univ Ilorin, Fac Informat & Commun Sci, Dept Comp Sci, Ilorin 240003, Nigeria
[2] Univ Lagos, Fac Engn, Dept Elect & Elect Engn, Akoka 100213, Lagos, Nigeria
[3] Ruhr Univ, Inst Digital Commun, Dept Elect Engn & Informat Technol, D-44801 Bochum, Germany
[4] Fu Jen Catholic Univ, Program Artificial Intelligence & Informat Secur, New Taipei City 24206, Taiwan
[5] Tainan Univ Technol, Dept Informat Management, Tainan 71002, Taiwan
[6] Fu Jen Catholic Univ, Res & Dev Ctr Phys Educ Hlth & Informat Technol, Dept Lib & Informat Sci, New Taipei City 24206, Taiwan
[7] Asia Univ, Dept Comp Sci & Informat Engn, Taichung 41354, Taiwan
关键词
convolutional neural networks; DeepFake facial reconstruction; deep learning; DeepFake video detection; image alteration; generative adversarial networks; rectifying linear unit; recurrent neural networks;
D O I
10.3390/electronics12010087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The privacy of individuals and entire countries is currently threatened by the widespread use of face-swapping DeepFake models, which result in a sizable number of fake videos that seem extraordinarily genuine. Because DeepFake production tools have advanced so much and since so many researchers and businesses are interested in testing their limits, fake media is spreading like wildfire over the internet. Therefore, this study proposes five-layered convolutional neural networks (CNNs) for a DeepFake detection and classification model. The CNN enhanced with ReLU is used to extract features from these faces once the model has extracted the face region from video frames. To guarantee model accuracy while maintaining a suitable weight, a CNN enabled with ReLU model was used for the DeepFake-detection-influenced video. The performance evaluation of the proposed model was tested using Face2Face, and first-order motion DeepFake datasets. Experimental results revealed that the proposed model has an average prediction rate of 98% for DeepFake videos and 95% for Face2Face videos under actual network diffusion circumstances. When compared with systems such as Meso4, MesoInception4, Xception, EfficientNet-B0, and VGG16 which utilizes the convolutional neural network, the suggested model produced the best results with an accuracy rate of 86%.
引用
收藏
页数:25
相关论文
共 50 条
  • [41] DeepFake Detection Using Deep Learning
    Mansoor, Nazneen
    Iliev, Alexander Iliev
    INTELLIGENT COMPUTING, VOL 3, 2024, 2024, 1018 : 202 - 213
  • [42] Deep Learning-Based Crack Detection and Classification for Concrete Structures Inspection
    Nguyen, C. K.
    Kawamura, K.
    Nakamura, H.
    PROCEEDINGS OF THE 17TH EAST ASIAN-PACIFIC CONFERENCE ON STRUCTURAL ENGINEERING AND CONSTRUCTION, EASEC-17 2022, 2023, 302 : 710 - 717
  • [43] An optimal deep learning-based framework for the detection and classification of android malware
    Bose, S. Jebin
    Kalaiselvi, R.
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (06) : 9297 - 9310
  • [44] Deep Learning-Based Multi-classification for Malware Detection in IoT
    Wang, Zhiqiang
    Liu, Qian
    Wang, Zhuoyue
    Chi, Yaping
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (17)
  • [45] Deep learning-based detection, classification, and localization of defects in semiconductor processes
    Patel, Dhruv, V
    Bonam, Ravi
    Oberai, Assad A.
    JOURNAL OF MICRO-NANOLITHOGRAPHY MEMS AND MOEMS, 2020, 19 (02):
  • [46] A deep learning-based method for classification, detection, and localization of weeds in turfgrass
    Jin, Xiaojun
    Bagavathiannan, Muthukumar
    McCullough, Patrick E.
    Chen, Yong
    Yu, Jialin
    PEST MANAGEMENT SCIENCE, 2022, 78 (11) : 4809 - 4821
  • [47] Deep learning-based detection and condition classification of bridge elastomeric bearings
    Liang, Dong
    Zhang, Shaojie
    Huang, Hai-Bin
    Zhang, Luomeng
    Hu, Yaozong
    AUTOMATION IN CONSTRUCTION, 2024, 166
  • [48] Systematic study on deep learning-based plant disease detection or classification
    C. K. Sunil
    C. D. Jaidhar
    Nagamma Patil
    Artificial Intelligence Review, 2023, 56 : 14955 - 15052
  • [49] Deep learning-based detection and condition classification of bridge steel bearings
    Wang, Wenjun
    Su, Chao
    AUTOMATION IN CONSTRUCTION, 2023, 156
  • [50] Systematic study on deep learning-based plant disease detection or classification
    Sunil, C. K.
    Jaidhar, C. D.
    Patil, Nagamma
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (12) : 14955 - 15052