PATRON: Exploring respiratory signal derived from non-contact face videos for face anti-spoofing

被引:19
|
作者
Birla, Lokendra [1 ]
Gupta, Puneet [1 ]
机构
[1] Indian Inst Technol Indore, Indore, India
关键词
Face anti-spoofing; r-PPG; Face authentication systems; Respiratory signal; 3D face mask; LIVENESS;
D O I
10.1016/j.eswa.2021.115883
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face authentication provides non-contact, user-friendly, covert, and low-cost acquisition. Despite this, face authentication is avoided in safety-critical applications because an adversary can easily spoof it. Several methodologies have been explored in the literature, but all of them, including remote Photoplethysmography (rPPG), are insufficient to detect the 3D face mask. The 3D face mask attack is considered the most potent attack, and it cannot be correctly detected even after consolidating different methodologies. It motivates us to explore a different methodology for face anti-spoofing based on respiration rate because it provides complementary information with the existing methodologies. To achieve the best possible performance, our novel method, PATRON that is resPiration bAsed feaTuRes fOr 3D face mask aNti-spoofing is based on: i) different characteristics as that of rPPG methods; ii) appropriate selection of facial regions; iii) relevant feature selection; and iv) compact feature representation. Our extensive experimental results on a publicly available 3D face mask anti-spoofing dataset reveal that our proposed method PATRON performs similar to the several state-of-the-art methods, and respiration rate can be utilized for face anti-spoofing. Furthermore, it provides guidelines about proper facial region selection and feature extraction, which enables the respiratory signal for anti-spoofing.
引用
收藏
页数:12
相关论文
共 20 条
  • [1] Generalized face anti-spoofing by detecting pulse from face videos
    Li, Xiaobai
    Komulainen, Jukka
    Zhao, Guoying
    Yuen, Pong-Chi
    Pietikainen, Matti
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 4244 - 4249
  • [2] Exploring Masked Image Modeling for Face Anti-spoofing
    Ma, Xuetao
    Zhang, Jun
    Zhang, Yunfei
    Zhou, Daoxiang
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 814 - 826
  • [3] Face anti-spoofing from the perspective of data sampling
    Muhammad, Usman
    Oussalah, Mourad
    ELECTRONICS LETTERS, 2023, 59 (01)
  • [4] Understanding deep face anti-spoofing: from the perspective of data
    Sun, Yujing
    Xiong, Hao
    Yiu, Siu Ming
    VISUAL COMPUTER, 2021, 37 (05): : 1015 - 1028
  • [5] Understanding deep face anti-spoofing: from the perspective of data
    Yujing Sun
    Hao Xiong
    Siu Ming Yiu
    The Visual Computer, 2021, 37 : 1015 - 1028
  • [6] From RGB to Depth: Domain Transfer Network for Face Anti-Spoofing
    Wang, Yahang
    Song, Xiaoning
    Xu, Tianyang
    Feng, Zhenhua
    Wu, Xiao-Jun
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 4280 - 4290
  • [7] EXPLORING HYPERGRAPH REPRESENTATION ON FACE ANTI-SPOOFING BEYOND 2D ATTACKS
    Te, Gusi
    Hu, Wei
    Guo, Zongming
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [8] Eyeblink-based anti-spoofing in face recognition from a generic webcamera
    Pan, Gang
    Sun, Lin
    Wu, Zhaohui
    Lao, Shihong
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 1879 - 1886
  • [9] Non-Contact Atrial Fibrillation Detection From Face Videos by Learning Systolic Peaks
    Sun, Zhaodong
    Junttila, Juhani
    Tulppo, Mikko
    Seppanen, Tapio
    Li, Xiaobai
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (09) : 4587 - 4598
  • [10] Polarized Image Translation From Nonpolarized Cameras for Multimodal Face Anti-Spoofing
    Tian, Yu
    Huang, Yalin
    Zhang, Kunbo
    Liu, Yue
    Sun, Zhenan
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 5651 - 5664