Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [1] Source-Free Domain Adaptation with Contrastive Domain Alignment and Self-supervised Exploration for Face Anti-spoofing
    Liu, Yuchen
    Chen, Yabo
    Dai, Wenrui
    Gou, Mengran
    Huang, Chun-Ting
    Xiong, Hongkai
    COMPUTER VISION, ECCV 2022, PT XII, 2022, 13672 : 511 - 528
  • [2] Generative Domain Adaptation for Face Anti-Spoofing
    Zhou, Qianyu
    Zhang, Ke-Yue
    Yao, Taiping
    Yi, Ran
    Sheng, Kekai
    Ding, Shouhong
    Ma, Lizhuang
    COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 335 - 356
  • [3] Unsupervised Domain Adaptation for Face Anti-Spoofing
    Li, Haoliang
    Li, Wen
    Cao, Hong
    Wang, Shiqi
    Huang, Feiyue
    Kot, Alex C.
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (07) : 1794 - 1809
  • [4] Self-Domain Adaptation for Face Anti-Spoofing
    Wang, Jingjing
    Zhang, Jingyi
    Bian, Ying
    Cai, Youyi
    Wang, Chunmao
    Pu, Shiliang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2746 - 2754
  • [5] Unsupervised Compound Domain Adaptation for Face Anti-Spoofing
    Panwar, Ankush
    Singh, Pratyush
    Saha, Suman
    Paudel, Danda Pani
    Van Gool, Luc
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [6] Generalized Source-free Domain Adaptation
    Yang, Shiqi
    Wang, Yaxing
    van de Weijer, Joost
    Herranz, Luis
    Jui, Shangling
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8958 - 8967
  • [7] Domain-Generalized Face Anti-Spoofing with Domain Adaptive Style Extraction
    Yang, Sunghun
    Lee, Jungho
    Jang, Sungjun
    Kang, Minseok
    Lee, Yongju
    Lee, Sangyoun
    2024 INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS, AND COMMUNICATIONS, ITC-CSCC 2024, 2024,
  • [8] A Domain Generalized Face Anti-Spoofing System Using Domain Adversarial Learning
    Chen, Ching-Yi
    Jhong, Sin-Ye
    Hsia, Chih-Hsien
    INTERNATIONAL JOURNAL OF ENGINEERING AND TECHNOLOGY INNOVATION, 2024, 14 (04) : 378 - 388
  • [9] DOMAIN-GENERALIZED FACE ANTI-SPOOFING WITH UNKNOWN ATTACKS
    Hong, Zong-Wei
    Lin, Yu-Chen
    Liu, Hsuan-Tung
    Yeh, Yi-Ren
    Chen, Chu-Song
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 820 - 824
  • [10] FACE ANTI-SPOOFING BASED ON MULTI-LAYER DOMAIN ADAPTATION
    Zhou, Fengshun
    Gao, Chenqiang
    Chen, Fang
    Li, Chaoyu
    Li, Xindou
    Yang, Feng
    Zhao, Yue
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 192 - 197