Face antispoofing method based on single-modal and lightweight network

被引:0
|
作者
Tong, Guoxiang [1 ]
Yan, Xinrong [1 ]
机构
[1] Univ Shanghai Sci & Technol, Dept Opt Elect & Comp Engn, Shanghai, Peoples R China
关键词
face antispoofing; lightweight network; single modal; focal loss;
D O I
10.1117/1.JEI.33.3.033030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. In the field of face antispoofing, researchers are increasingly focusing their efforts on multimodal and feature fusion. While multimodal approaches are more effective than single-modal ones, they often come with a huge number of parameters, require significant computational resources, and pose challenges for execution on mobile devices. To address the real-time problem, we propose a fast and lightweight framework based on ShuffleNet V2. Our approach takes patch-level images as input, enhances unit performance by introducing an attention module, and addresses dataset sample imbalance issues through the focal loss function. The framework effectively tackles the real-time constraints of the model. We evaluate the performance of our model on CASIA-FASD, Replay-Attack, and MSU-MFSD datasets. The results demonstrate that our method outperforms the current state-of-the-art methods in both intratest and intertest scenarios. Furthermore, our network has only 0.84 M parameters and 0.81 GFlops, making it suitable for deployment in mobile and real-time settings. Our work can serve as a valuable reference for researchers seeking to develop single-modal face antispoofing methods suitable for mobile and real-time applications.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Lightweight network structure face recognition method based on cloud-edge collaboration
    Qi C.
    Huang J.
    Zhao X.
    Wang Z.
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2023, 53 (01): : 1 - 13
  • [22] Co-Training for Deep Object Detection: Comparing Single-Modal and Multi-Modal Approaches
    Gomez, Jose L.
    Villalonga, Gabriel
    Lopez, Antonio M.
    SENSORS, 2021, 21 (09)
  • [23] Lightweight face anti-spoofing method based on cross-fused multi-modal features
    He, Xiping
    Li, Yi
    He, Dan
    Yuan, Rui
    Huang, Ling
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [24] RGB-THERMAL BASED PEDESTRIAN DETECTION WITH SINGLE-MODAL AUGMENTATION AND ROI POOLING MULTISCALE FUSION
    Xiang, Jiajun
    Gou, Shuiping
    Li, Ruimin
    Zheng, Zhihui
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3532 - 3535
  • [25] Single-modal neuroimaging computer aided diagnosis for schizophrenia based on ensemble learning using privileged information
    Shen L.
    Wang Q.
    Shi J.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2020, 37 (03): : 405 - 411
  • [26] Face Recognition Method Based on Lightweight Network SE-ShuffleNet V2
    Jing, Hong-Rong
    Lin, Guo-Jun
    Liu, Zhong-Ling
    Jing-Li
    He, Li
    Li, Xuan-Han
    Zhang, Hong-Jie
    Zhou, Shun-Yong
    Journal of Computers (Taiwan), 2023, 34 (04) : 15 - 24
  • [27] A Face Recognition Method based on Lightweight Neural Network and Multi Hash Recognition Degree Weighting
    Wang, Shasha
    IAENG International Journal of Applied Mathematics, 2024, 54 (03) : 581 - 586
  • [28] Single-modal and multi-modal false arrhythmia alarm reduction using attention-based convolutional and recurrent neural networks
    Mousavi, Sajad
    Fotoohinasab, Atiyeh
    Afghah, Fatemeh
    PLOS ONE, 2020, 15 (01):
  • [29] Oscillating patterns based face antispoofing approach against video replay
    Buciu, Joan
    Goldenberg, Shmuel
    2015 11TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG): BIOMETRICS IN THE WILD (B-WILD 2015), VOL 2, 2015,
  • [30] Improving Single-Modal Neuroimaging Based Diagnosis of Brain Disorders via Boosted Privileged Information Learning Framework
    Zheng, Xiao
    Shi, Jun
    Ying, Shihui
    Zhang, Qi
    Li, Yan
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2016, 2016, 10019 : 95 - 103