Dual-stream correlation exploration for face anti-Spoofing

被引:3
|
作者
Liu, Yongluo [1 ]
Wu, Lifang [1 ]
Li, Zun [1 ]
Wang, Zhuming [1 ]
机构
[1] Beijing Univ Technol, Beijing 100124, Peoples R China
关键词
Face anti -spoofing; Metric correlation learning; Liveness and content feature learning;
D O I
10.1016/j.patrec.2023.03.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face anti-spoofing (FAS) is an important technology to ensure the security of face recognition system. Previous methods generally focus on the representation of the spoof patterns. However, the hidden cor-relations between living and spoofing faces are ignored, making the generation and discrimination of face anti-spoofing less effective. In this paper, we propose a novel Dual-Stream Correlation Exploration method (DSCE) to simultaneously model the correlation between content and liveness features for the performance improvement. Specifically, DSCE devises two novel modules: the spoof cue generation mod-ule and the source face reconstruction module, at two streams respectively. The former one introduces pseudo negative feature to extend the diversity of attack types, and adopts a metric learning strategy to learn the correlation among liveness features. The latter one integrates liveness and content features to explores the potential relationship between the both features through source face reconstruction. Last, DSCE adaptively combines spoof cues and reconstructed faces to comprehensively consider the impor-tance of different correlations for face anti-spoofing. Comprehensive experimental results on both intra-dataset testing and cross-dataset testing clearly demonstrate the high discrimination and generalization of DSCE.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:17 / 23
页数:7
相关论文
共 50 条
  • [31] Channel difference transformer for face anti-spoofing
    Huang, Pei-Kai
    Chong, Jun-Xiong
    Hsu, Ming-Tsung
    Hsu, Fang-Yu
    Hsu, Chiou-Ting
    INFORMATION SCIENCES, 2025, 702
  • [32] Deep Learning for Face Anti-Spoofing: A Survey
    Yu, Zitong
    Qin, Yunxiao
    Li, Xiaobai
    Zhao, Chenxu
    Lei, Zhen
    Zhao, Guoying
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5609 - 5631
  • [33] A Robust Method with DropBlock for Face Anti-Spoofing
    Wu, Gang
    Zhou, Zhuo
    Guo, Zhenhua
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [34] Face Anti-spoofing based on Sharpness Profiles
    Karthik, Kannan
    Katika, Balaji Rao
    2017 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL AND INFORMATION SYSTEMS (ICIIS), 2017, : 123 - 128
  • [35] Dual Spoof Disentanglement Generation for Face Anti-Spoofing With Depth Uncertainty Learning
    Wu, Hangtong
    Zeng, Dan
    Hu, Yibo
    Shi, Hailin
    Mei, Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4626 - 4638
  • [36] Advanced Face Anti-Spoofing with Depth Segmentation
    Zhang, Licheng
    Sun, Nan
    Wu, Xihong
    Luo, Dingsheng
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] Unsupervised face anti-spoofing using dual cameras based feature matching
    Shen, Wang
    Liu, Jie
    He, Min
    Wang, Wenjin
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 1621 - 1624
  • [38] ONLINE ADAPTIVE PERSONALIZATION FOR FACE ANTI-SPOOFING
    Belli, Davide
    Das, Debasmit
    Major, Bence
    Porikli, Fatih
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 351 - 355
  • [39] Generative Domain Adaptation for Face Anti-Spoofing
    Zhou, Qianyu
    Zhang, Ke-Yue
    Yao, Taiping
    Yi, Ran
    Sheng, Kekai
    Ding, Shouhong
    Ma, Lizhuang
    COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 335 - 356
  • [40] Learning Meta Pattern for Face Anti-Spoofing
    Cai, Rizhao
    Li, Zhi
    Wan, Renjie
    Li, Haoliang
    Hu, Yongjian
    Kot, Alex C.
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 1201 - 1213