PLFace: Progressive Learning for Face Recognition with Mask Bias

被引:20
|
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Wang, Guangcheng [1 ]
Jiang, Kui [1 ]
Han, Zhen [1 ]
Lu, Tao [2 ]
Liang, Chao [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan 430072, Peoples R China
[2] Wuhan Inst Technol, Sch Comp Sci & Engn, Wuhan 430205, Peoples R China
基金
中国国家自然科学基金;
关键词
Face recognition; Progressive learning; Mask bias;
D O I
10.1016/j.patcog.2022.109142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The outbreak of the COVID-19 coronavirus epidemic has promoted the development of masked face recognition (MFR). Nevertheless, the performance of regular face recognition is severely compromised when the MFR accuracy is blindly pursued. More facts indicate that MFR should be regarded as a mask bias of face recognition rather than an independent task. To mitigate mask bias, we propose a novel Pro-gressive Learning Loss (PLFace) that achieves a progressive training strategy for deep face recognition to learn balanced performance for masked/mask-free faces recognition based on margin losses. Particularly, our PLFace adaptively adjusts the relative importance of masked and mask-free samples during different training stages. In the early stage of training, PLFace mainly learns the feature representations of mask -free samples. At this time, the regular sample embeddings shrink to the corresponding prototype, which represents the center of each class while being stored in the last linear layer. In the later stage of train-ing, PLFace converges on mask-free samples and further focuses on masked samples until the masked sample embeddings are also gathered in the center of the class. The entire training process emphasizes the paradigm that normal samples shrink first and masked samples gather afterward. Extensive experi-mental results on popular regular and masked face benchmarks demonstrate that our proposed PLFace can effectively eliminate mask bias in face recognition. Compared to state-of-the-art competitors, PLFace significantly improves the accuracy of MFR while maintaining the performance of normal face recogni-tion.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Towards Mask-robust Face Recognition
    Feng, Tao
    Xu, Liangpeng
    Yuan, Hangjie
    Zhao, Yongfei
    Tang, Mingqian
    Wang, Mang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1492 - 1496
  • [22] A fast mask synthesis method for face recognition
    Kaiwen Guo
    Chaoyang Zhao
    Jinqiao Wang
    Visual Intelligence, 2 (1):
  • [23] THE MAN BEHIND THE MASK - DISGUISE AND FACE RECOGNITION
    DAVIES, G
    FLIN, R
    HUMAN LEARNING, 1984, 3 (02): : 83 - 95
  • [24] Face mask recognition from audio: The MASC database and an overview on the mask challenge
    Mohamed, Mostafa M.
    Nessiem, Mina A.
    Batliner, Anton
    Bergler, Christian
    Hantke, Simone
    Schmitt, Maximilian
    Baird, Alice
    Mallol-Ragolta, Adria
    Karas, Vincent
    Amiriparian, Shahin
    Schuller, Bjorn W.
    PATTERN RECOGNITION, 2022, 122
  • [25] Effects of experience on recognition of speech produced with a face mask
    Crinnion, Anne Marie
    Toscano, Joseph C.
    Toscano, Cheyenne M.
    COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS, 2022, 7 (01)
  • [26] Face recognition with facial mask application and neural networks
    Grassi, Marco
    Faundez-Zanuy, Marcos
    COMPUTATIONAL AND AMBIENT INTELLIGENCE, 2007, 4507 : 709 - +
  • [27] ON THE VULNERABILITY OF FACE RECOGNITION SYSTEMS TO SPOOFING MASK ATTACKS
    Kose, Neslihan
    Dugelay, Jean-Luc
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2357 - 2361
  • [28] Face Mask Recognition for Covid-19 Prevention
    Trong Hieu Luu
    Phan Nguyen Ky Phuc
    Yu, Zhiqiu
    Duy Dung Pham
    Huu Trong Cao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (02): : 3251 - 3262
  • [29] Spartan Face Mask Detection and Facial Recognition System
    Song, Ziwei
    Nguyen, Kristie
    Nguyen, Tien
    Cho, Catherine
    Gao, Jerry
    HEALTHCARE, 2022, 10 (01)
  • [30] Effects of experience on recognition of speech produced with a face mask
    Anne Marie Crinnion
    Joseph C. Toscano
    Cheyenne M. Toscano
    Cognitive Research: Principles and Implications, 7