CSTAN: A Deepfake Detection Network with CST Attention for Superior Generalization

被引:0
|
作者
Yang, Rui [1 ,2 ]
You, Kang [2 ]
Pang, Cheng [1 ]
Luo, Xiaonan [1 ,2 ]
Lan, Rushi [1 ,3 ]
机构
[1] Guilin Univ Elect Technol, Guangxi Key Lab Image & G Intelligent Proc, Guilin 541004, Peoples R China
[2] Guilin Univ Elect Technol, Sch Comp Sci & Informat Secur, Guilin 541004, Peoples R China
[3] Guilin Univ Elect Technol, Int Joint Res Lab Spatio Temporal Informat Intelli, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake detection; attention mechanism; detection model; feature extraction;
D O I
10.3390/s24227101
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the advancement of deepfake forgery technology, highly realistic fake faces have posed serious security risks to sensor-based facial recognition systems. Recent deepfake detection models mainly use binary classification models based on deep learning. Despite achieving high detection accuracy on intra-datasets, these models lack generalization ability when applied to cross-datasets. We propose a deepfake detection model named Channel-Spatial-Triplet Attention Network (CSTAN), which focuses on the difference between real and fake features, thereby enhancing the generality of the detection model. To enhance the feature-learning ability of the model for image forgery regions, we have designed the Channel-Spatial-Triplet (CST) attention mechanism, which extracts subtle local information by capturing feature channels and the spatial correlation of three different scales. Additionally, we propose a novel feature extraction method, OD-ResNet-34, by embedding ODConv into the feature extraction network to enhance its dynamic adaptability to data features. Trained on the FF++ dataset and tested on the Celeb-DF-v1 and Celeb-DF-v2 datasets, the experimental results show that our model has stronger generalization ability in cross-datasets than similar models.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Data augmentation with attention framework for robust deepfake detection
    Mamarasulov, Sardor
    Chen, Lianggangxu
    Chen, Changgu
    Li, Yang
    Wang, Changbo
    VISUAL COMPUTER, 2024,
  • [22] Learning Face Forgery Detection in Unseen Domain with Generalization Deepfake Detector
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kim, Bo-Sung
    Kwon, Ki-Ryong
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [23] Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey
    Liu, Ping
    Tao, Qiqi
    Zhou, Joey Tianyi
    PROCEEDINGS OF THE 1ST ACM MULTIMEDIA WORKSHOP ON MULTI-MODAL MISINFORMATION GOVERNANCE IN THE ERA OF FOUNDATION MODELS, MIS 2024, 2024, : 3 - 11
  • [24] Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization
    Dong, Shichao
    Wang, Jin
    Ji, Renhe
    Liang, Jiajun
    Fan, Haoqing
    He, Zheng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3994 - 4004
  • [25] Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection
    Kawa, Piotr
    Plata, Marcin
    Syga, Piotr
    INTERSPEECH 2022, 2022, : 4023 - 4027
  • [26] LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection
    Nguyen, Dat
    Mejri, Nesryne
    Singh, Inder Pal
    Kuleshova, Polina
    Astrid, Marcella
    Kacem, Anis
    Ghorbel, Enjie
    Aouada, Djamila
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 17395 - 17405
  • [27] Improving Generalization in Deepfake Detection via Augmentation with Recurrent Adversarial Attacks
    Stanciu, Dan-Cristian
    Ionescu, Bogdan
    PROCEEDINGS OF THE 3RD ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2024, 2024, : 46 - 54
  • [28] IMPROVING THE GENERALIZATION ABILITY OF DEEPFAKE DETECTION VIA DISENTANGLED REPRESENTATION LEARNING
    Hu, Jiashang
    Wang, Shilin
    Li, Xiaoyong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3577 - 3581
  • [29] Multisemantic Path Neural Network for Deepfake Detection
    Wu, Nan
    Jin, Xin
    Jiang, Qian
    Wang, Puming
    Zhang, Ya
    Yao, Shaowen
    Zhou, Wei
    SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [30] Detection of Deepfake Videos Using Long-Distance Attention
    Lu, Wei
    Liu, Lingyi
    Zhang, Bolin
    Luo, Junwei
    Zhao, Xianfeng
    Zhou, Yicong
    Huang, Jiwu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9366 - 9379