Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [21] Face anti-spoofing via conditional adversarial domain generalization
    Cai T.
    Chen F.
    Liu W.
    Xie X.
    Liu Z.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (12) : 16499 - 16512
  • [22] Quality-Invariant Domain Generalization for Face Anti-Spoofing
    Liu, Yongluo
    Li, Zun
    Xu, Yaowen
    Guo, Zhizhi
    Zou, Zhaofan
    Wu, Lifang
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (11) : 5239 - 5254
  • [23] Deep domain adaptation for anti-spoofing in speaker verification systems
    Himawan, Ivan
    Villavicencio, Fernando
    Sridharan, Sridha
    Fookes, Clinton
    COMPUTER SPEECH AND LANGUAGE, 2019, 58 : 377 - 402
  • [24] Multi-Domain Feature Alignment for Face Anti-Spoofing
    Zhang, Shizhe
    Nie, Wenhui
    SENSORS, 2023, 23 (08)
  • [25] Energy-Based Domain Generalization for Face Anti-Spoofing
    Du, Zhekai
    Li, Jingjing
    Zuo, Lin
    Zhu, Lei
    Lu, Ke
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1749 - 1757
  • [26] Gradient Alignment for Cross-Domain Face Anti-Spoofing
    Le, Binh M.
    Woo, Simon S.
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 188 - 199
  • [27] Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing
    Chen, Zhihong
    Yao, Taiping
    Sheng, Kekai
    Ding, Shouhong
    Tai, Ying
    Li, Jilin
    Huang, Feiyue
    Jin, Xinyu
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1132 - 1139
  • [28] Instance-Aware Domain Generalization for Face Anti-Spoofing
    Zhou, Qianyu
    Zhang, Ke-Yue
    Yao, Taiping
    Lu, Xuequan
    Yi, Ran
    Ding, Shouhong
    Ma, Lizhuang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 20453 - 20463
  • [29] Source bias reduction for source-free domain adaptation
    Tian, Liang
    Ye, Mao
    Zhou, Lihua
    Wang, Zhenbin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 883 - 893
  • [30] Source-free unsupervised domain adaptation: A survey
    Fang, Yuqi
    Yap, Pew-Thian
    Lin, Weili
    Zhu, Hongtu
    Liu, Mingxia
    NEURAL NETWORKS, 2024, 174