A Performance Enhancement of Deepfake Video Detection through the use of a Hybrid CNN Deep Learning Model

被引:0
|
作者
Ikram, Sumaiya Thaseen [1 ]
Priya, V [1 ]
Chambial, Shourya [1 ]
Sood, Dhruv [1 ]
Arulkumar, V [2 ]
机构
[1] Engn Vellore Inst Technol, Sch Informat Technol, Vellore, Tamil Nadu, India
[2] Engn Vellore Inst Technol, Sch Comp Sci, Vellore, Tamil Nadu, India
关键词
Deepfake; Machine learning; Deep learning; Inception; Xception;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the current era, many fake videos and images are created with the help of various software and new AI (Artificial Intelligence) technologies, which leave a few hints of manipulation. There are many unethical ways videos can be used to threaten, fight, or create panic among people. It is important to ensure that such methods are not used to create fake videos. An AI-based technique for the synthesis of human images is called Deep Fake. They are created by combining and superimposing existing videos onto the source videos. In this paper, a system is developed that uses a hybrid Convolutional Neural Network (CNN) consisting of InceptionResnet v2 and Xception to extract frame-level features. Experimental analysis is performed using the DFDC deep fake detection challenge on Kaggle. These deep learning-based methods are optimized to increase accuracy and decrease training time by using this dataset for training and testing. We achieved a precision of 0.985, a recall of 0.96, an f1-score of 0.98, and support of 0.968.
引用
收藏
页码:169 / 178
页数:10
相关论文
共 50 条
  • [31] Deepfake detection: Enhancing performance with spatiotemporal texture and deep learning feature fusion
    Almestekawy, Abdelwahab
    Zayed, Hala H.
    Taha, Ahmed
    EGYPTIAN INFORMATICS JOURNAL, 2024, 27
  • [32] Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection
    Gu, Zhihao
    Yao, Taiping
    Chen, Yang
    Ding, Shouhong
    Ma, Lizhuang
    COMPUTER VISION, ECCV 2022, PT XII, 2022, 13672 : 596 - 613
  • [33] Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection
    Bondi, Luca
    Cannas, Edoardo Daniele
    Bestagini, Paolo
    Tubaro, Stefano
    2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
  • [34] Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning
    Lewis, John K.
    Toubal, Imad Eddine
    Chen, Helen
    Sandesera, Vishal
    Lomnitz, Michael
    Hampel-Arias, Zigfried
    Prasad, Calyam
    Palaniappan, Kannappan
    2020 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR): TRUSTED COMPUTING, PRIVACY, AND SECURING MULTIMEDIA, 2020,
  • [35] Fast Learning Through Deep Multi-Net CNN Model For Violence Recognition In Video Surveillance
    Mumtaz, Aqib
    Sargano, Allah Bux
    Habib, Zulfiqar
    COMPUTER JOURNAL, 2022, 65 (03): : 457 - 472
  • [36] Hybrid Deep Learning Approach Based on LSTM and CNN for Malware Detection
    Thakur, Preeti
    Kansal, Vineet
    Rishiwal, Vinay
    WIRELESS PERSONAL COMMUNICATIONS, 2024, 136 (03) : 1879 - 1901
  • [37] A Novel Deep Learning Approach for Deepfake Image Detection
    Raza, Ali
    Munir, Kashif
    Almutairi, Mubarak
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [38] Unsupervised Learning-Based Framework for Deepfake Video Detection
    Zhang, Li
    Qiao, Tong
    Xu, Ming
    Zheng, Ning
    Xie, Shichuang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4785 - 4799
  • [39] XAI - Empowered Ensemble Deep Learning for Deepfake Detection
    Kumar, Amidela Anil
    Dheepthi Priyangha, S.J.
    Meghana, P.
    Dheeraj, Muppalla
    Aarthi, R.
    2024 15th International Conference on Computing Communication and Networking Technologies, ICCCNT 2024, 2024,
  • [40] CNN-Informer: A hybrid deep learning model for seizure detection on long-term EEG
    Li, Chuanyu
    Li, Haotian
    Dong, Xingchen
    Zhong, Xiangwen
    Cui, Haozhou
    Ji, Dezan
    He, Landi
    Liu, Guoyang
    Zhou, Weidong
    NEURAL NETWORKS, 2025, 181