Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [41] A Comprehensive Survey on Source-Free Domain Adaptation
    Li, Jingjing
    Yu, Zhiqi
    Du, Zhekai
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (08) : 5743 - 5762
  • [42] A Comparison of Strategies for Source-Free Domain Adaptation
    Su, Xin
    Zhao, Yiyun
    Bethard, Steven
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 8352 - 8367
  • [43] FLIP: Cross-domain Face Anti-spoofing with Language Guidance
    Srivatsan, Koushik
    Naseer, Muzammal
    Nandakumar, Karthik
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 19628 - 19639
  • [44] Domain Generalization for Face Anti-Spoofing via Negative Data Augmentation
    Wang, Weihang
    Liu, Peilin
    Zheng, Haoyuan
    Ying, Rendong
    Wen, Fei
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 2333 - 2344
  • [45] DEFAEK: Domain Effective Fast Adaptive Network for Face Anti-Spoofing
    Lin, Jiun-Da
    Han, Yue-Hua
    Huang, Po-Han
    Tan, Julianne
    Chen, Jun-Cheng
    Tanveer, M.
    Hua, Kai-Lung
    NEURAL NETWORKS, 2023, 161 : 83 - 92
  • [46] Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofing
    Wang, Zhuo
    Wang, Zezheng
    Yu, Zitong
    Deng, Weihong
    Li, Jiahong
    Gao, Tingting
    Wang, Zhongyuan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4113 - 4123
  • [47] From RGB to Depth: Domain Transfer Network for Face Anti-Spoofing
    Wang, Yahang
    Song, Xiaoning
    Xu, Tianyang
    Feng, Zhenhua
    Wu, Xiao-Jun
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 4280 - 4290
  • [48] Dual Teacher Knowledge Distillation With Domain Alignment for Face Anti-Spoofing
    Kong, Zhe
    Zhang, Wentian
    Wang, Tao
    Zhang, Kaihao
    Li, Yuexiang
    Tang, Xiaoying
    Luo, Wenhan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13177 - 13189
  • [49] MFAE: Masked Frequency Autoencoders for Domain Generalization Face Anti-Spoofing
    Zheng, Tianyi
    Li, Bo
    Wu, Shuang
    Wan, Ben
    Mu, Guodong
    Liu, Shice
    Ding, Shouhong
    Wang, Jia
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 (4058-4069) : 4058 - 4069
  • [50] Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less
    Cai, Rizhao
    Cui, Yawen
    Li, Zhi
    Yu, Zitong
    Li, Haoliang
    Hu, Yongjian
    Kot, Alex
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8003 - 8014