Towards generalized face forgery detection with domain-robust representation learning

被引:0
|
作者
Li, Caiyu [1 ]
Wo, Yan [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
关键词
Generalized face forgery detection; Domain-robust; Style augmentation; Feature disentanglement; NETWORKS;
D O I
10.1016/j.dsp.2024.104792
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face forgery detection is crucial for the security of digital identities. However, existing methods often struggle to generalize effectively to unseen domains due to the domain shift between training and testing data. We propose a Domain-robust Representation Learning (DRRL) method for generalized face forgery detection. Specifically, we observe that domain shifts in face forgery detection tasks are often caused by forgery differences and content differences between domain data, while the limitations of training data lead the model to overfit to these feature expressions in the seen domain. Therefore, DRRL enhances the model's generalization to unseen domains by first adding representative data representations to mitigate overfitting to seen data and then removing the features of expressed domain information to learn a robust, discriminative representation of domain variation. Data augmentation is achieved by stylizing sample representations and exploring representative new styles to generate rich data variants, with the Content-style Augmentation (CSA) module and Forgery-style Augmentation (FSA) module implemented for content and forgery expression, respectively. Based on this, the Content Decorrelation (CTD) module and Sensitive Channels Drop (SCD) module are used to remove content features irrelevant to forgery and domain-sensitive forgery features, encouraging the model to focus on clean and robust forgery features, thereby achieving the goal of learning domain-robust representations. Extensive experiments on five large-scale datasets demonstrate that our method exhibits advanced and stable generalization performance in practical scenarios.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] ADAPTER-BASED INCREMENTAL LEARNING FOR FACE FORGERY DETECTION
    Gao, Caili
    Xu, Qisheng
    Qiao, Peng
    Xu, Kele
    Qian, Xifu
    Dou, Yong
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4690 - 4694
  • [42] Towards generalizable face forgery detection via mitigating spurious correlation
    Bai, Ningning
    Wang, Xiaofeng
    Han, Ruidong
    Hou, Jianpeng
    Wang, Qin
    Pang, Shanmin
    NEURAL NETWORKS, 2025, 182
  • [43] Face detection using representation learning
    Zhan, Shu
    Tao, Qin-Qin
    Li, Xiao-Hong
    NEUROCOMPUTING, 2016, 187 : 19 - 26
  • [44] Compressed Domain Invariant Adversarial Representation Learning for Robust Audio Deepfake Detection
    Yuan, Chengsheng
    Chen, Yifei
    Zhou, Zhili
    Xia, Zhihua
    Huang, Yongfeng
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 1111 - 1115
  • [45] Generalized face forgery detection with self-supervised face geometry information analysis network
    Zhang, Rui
    Wang, Hongxia
    Liu, Hanqing
    Zhou, Yang
    Zeng, Qiang
    APPLIED SOFT COMPUTING, 2024, 166
  • [46] Generalized Focal Loss: Towards Efficient Representation Learning for Dense Object Detection
    Li, Xiang
    Lv, Chengqi
    Wang, Wenhai
    Li, Gang
    Yang, Lingfeng
    Yang, Jian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3139 - 3153
  • [47] Confidence-Calibrated Face Image Forgery Detection with Contrastive Representation Distillation
    Yang, Puning
    Huang, Huaibo
    Wang, Zhiyong
    Yu, Aijing
    He, Ran
    COMPUTER VISION - ACCV 2022, PT IV, 2023, 13844 : 3 - 19
  • [48] Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
    Haliassos, Alexandros
    Vougioukas, Konstantinos
    Petridis, Stavros
    Pantic, Maja
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5037 - 5047
  • [49] Towards Robust Evaluation of Face Morphing Detection
    Spreeuwers, Luuk
    Schils, Maikel
    Veldhuis, Raymond
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1027 - 1031
  • [50] Robust face forgery detection integrating local texture and global texture information
    Gong, Rongrong
    He, Ruiyi
    Zhang, Dengyong
    Sangaiah, Arun Kumar
    Alenazi, Mohammed J. F.
    EURASIP JOURNAL ON INFORMATION SECURITY, 2025, 2025 (01):