Face antispoofing method based on single-modal and lightweight network

被引:0
|
作者
Tong, Guoxiang [1 ]
Yan, Xinrong [1 ]
机构
[1] Univ Shanghai Sci & Technol, Dept Opt Elect & Comp Engn, Shanghai, Peoples R China
关键词
face antispoofing; lightweight network; single modal; focal loss;
D O I
10.1117/1.JEI.33.3.033030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. In the field of face antispoofing, researchers are increasingly focusing their efforts on multimodal and feature fusion. While multimodal approaches are more effective than single-modal ones, they often come with a huge number of parameters, require significant computational resources, and pose challenges for execution on mobile devices. To address the real-time problem, we propose a fast and lightweight framework based on ShuffleNet V2. Our approach takes patch-level images as input, enhances unit performance by introducing an attention module, and addresses dataset sample imbalance issues through the focal loss function. The framework effectively tackles the real-time constraints of the model. We evaluate the performance of our model on CASIA-FASD, Replay-Attack, and MSU-MFSD datasets. The results demonstrate that our method outperforms the current state-of-the-art methods in both intratest and intertest scenarios. Furthermore, our network has only 0.84 M parameters and 0.81 GFlops, making it suitable for deployment in mobile and real-time settings. Our work can serve as a valuable reference for researchers seeking to develop single-modal face antispoofing methods suitable for mobile and real-time applications.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Promoting Single-Modal Optical Flow Network for Diverse Cross-Modal Flow Estimation
    Zhou, Shili
    Tan, Weimin
    Yan, Bo
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3562 - 3570
  • [2] EliMRec: Eliminating Single-modal Bias in Multimedia Recommendation
    Liu, Xiaohao
    Tao, Zhulin
    Shao, Jiahong
    Yang, Lifang
    Huang, Xianglin
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,
  • [3] Representation constraint-based dual-channel network for face antispoofing
    Li, Zuhe
    Cui, Yuhao
    Wang, Fengqin
    Liu, Weihua
    Yang, Yongshuang
    Yu, Zeqi
    Jiang, Bin
    Chen, Hui
    IET COMPUTER VISION, 2024, 18 (02) : 289 - 303
  • [4] Cross-Modal Consistency for Single-Modal MR Image Segmentation
    Xu, Wenxuan
    Li, Cangxin
    Bian, Yun
    Meng, Qingquan
    Zhu, Weifang
    Shi, Fei
    Chen, Xinjian
    Shao, Chengwei
    Xiang, Dehui
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2024, 71 (09) : 2557 - 2567
  • [5] A multimodal face antispoofing method based on multifeature vision transformer and multirank fusion
    Li, Zuhe
    Cui, Yuhao
    Wang, Fengqin
    Liu, Weihua
    Yang, Yongshuang
    Yu, Zeqi
    Jiang, Bin
    Chen, Hui
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (23):
  • [6] A single-modal linear ultrasonic motor based on multi vibration modes of PZT ceramics
    Lu, Danhong
    Lin, Qiuxiang
    Chen, Bingxun
    Jiang, Chunrong
    Hu, Xia
    ULTRASONICS, 2020, 107
  • [7] Comparing Single-modal and Multimodal Interaction in an Augmented Reality System
    Wang, Zhimin
    Yu, Huangyue
    Wang, Haofei
    Wang, Zongji
    Lu, Feng
    ADJUNCT PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT 2020), 2020, : 165 - 166
  • [8] Cross-modal and single-modal Probabilistic Category Learning in a Weather Prediction Task
    Sun Xunwei
    Fu Qiufang
    Fu Xiaolan
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2016, 51 : 833 - 833
  • [9] Lightweight network-based multi-modal feature fusion for face anti-spoofing
    Dan He
    Xiping He
    Rui Yuan
    Yue Li
    Chao Shen
    The Visual Computer, 2023, 39 : 1423 - 1435
  • [10] Lightweight network-based multi-modal feature fusion for face anti-spoofing
    He, Dan
    He, Xiping
    Yuan, Rui
    Li, Yue
    Shen, Chao
    VISUAL COMPUTER, 2023, 39 (04): : 1423 - 1435