AN EFFICIENT DEEP VIDEO MODEL FOR DEEPFAKE DETECTION

被引:0
|
作者
Sun, Ruipeng [1 ,2 ]
Zhao, Ziyuan [1 ]
Shen, Li [1 ]
Zeng, Zeng [3 ]
Li, Yuxin [4 ]
Veeravalli, Bharadwaj [2 ]
Yang Xulei [1 ]
机构
[1] ASTAR, Inst Infocomm Res I2R, Singapore, Singapore
[2] Natl Univ Singapore NUS, Singapore, Singapore
[3] Shanghai Univ SHU, Shanghai, Peoples R China
[4] Nanyang Technol Univ NTU, Singapore, Singapore
关键词
Deepfake; Deep Video Model; Sequential-Parallel Networks; Spatio-temporal Modelling;
D O I
10.1109/ICIP49359.2023.10222682
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The use of deep learning technology to manipulate images and videos of people in ways that are difficult to distinguish from the real ones, known as deepfake, has become a matter of national security concern in recent years. As a result, many studies have been carried out to detect deepfake and manipulated media. Among these studies, deep video models based on convolutional neural networks have been the preferred method for detecting deepfake in videos. This study presents a novel deep video model called Sequential-Parallel Networks (SPNet) that provides efficient deepfake detection. The SPNet model consists of a simple yet innovative sequential-parallel block that first extracts spatial and temporal features sequentially, then concatenates them together in parallel. As a result, the presented SPNet possesses comparable spatio-temporal modeling abilities as most state-of-the-art deep video methods but with lower computation complexity and fewer parameters. The efficiency of the presented SPNet is demonstrated on a large-scale deepfake benchmark in terms of high recognition accuracy and low computational cost.
引用
收藏
页码:351 / 355
页数:5
相关论文
共 50 条
  • [11] An Approach to Deepfake Video Detection Based on ACO-PSO Features and Deep Learning
    Alhaji, Hanan Saleh
    Celik, Yuksel
    Goel, Sanjay
    ELECTRONICS, 2024, 13 (12)
  • [12] Deepfake Detection through Deep Learning
    Pan, Deng
    Sun, Lixian
    Wang, Rui
    Zhang, Xingjian
    Sinnott, Richard O.
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES (BDCAT 2020), 2020, : 134 - 143
  • [13] Video deepfake detection using Particle Swarm Optimization improved deep neural networks
    Cunha, Leandro
    Zhang, Li
    Lim, Chee Peng
    Sowan, Bilal
    Kong, Yinghui
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (15): : 8417 - 8453
  • [14] A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost
    Ismail, Aya
    Elpeltagy, Marwa
    S. Zaki, Mervat
    Eldahshan, Kamal
    SENSORS, 2021, 21 (16)
  • [15] DeepFake Detection Using Deep Learning
    Mansoor, Nazneen
    Iliev, Alexander Iliev
    INTELLIGENT COMPUTING, VOL 3, 2024, 2024, 1018 : 202 - 213
  • [16] Deepfake Video Detection with Spatiotemporal Dropout Transformer
    Zhang, Daichi
    Lin, Fanzhao
    Hua, Yingying
    Wang, Pengju
    Zeng, Dan
    Ge, Shiming
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5833 - 5841
  • [17] Deepfake video detection methods, approaches, and challenges
    Alrashoud, Mubarak
    Alexandria Engineering Journal, 2025, 125 : 265 - 277
  • [18] Analyzing temporal coherence for deepfake video detection
    Amin, Muhammad Ahmad
    Hu, Yongjian
    Hu, Jiankun
    ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (04): : 2621 - 2641
  • [19] Image Feature Detectors for Deepfake Video Detection
    Kharbat, Faten F.
    Elamsy, Tarik
    Mahmoud, Ahmed
    Abdullah, Rami
    2019 IEEE/ACS 16TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA 2019), 2019,
  • [20] TALL: Thumbnail Layout for Deepfake Video Detection
    Xu, Yuting
    Liang, Jian
    Jia, Gengyun
    Yang, Ziming
    Zhang, Yanhao
    He, Ran
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22601 - 22611