Two Methods for Spoofing-Aware Speaker Verification: Multi-Layer Perceptron Score Fusion Model and Integrated Embedding Projector

被引:0
|
作者
Heo, Jungwoo [1 ]
Kim, Ju-ho [1 ]
Shin, Hyun-seo [1 ]
机构
[1] Univ Seoul, Sch Comp Sci, Seoul, South Korea
来源
基金
新加坡国家研究基金会;
关键词
Automatic speaker verification (ASV); Spoofing countermeasures (CM); Spoofing-aware speaker verification (SASV); SPEECH ENHANCEMENT; COUNTERMEASURES;
D O I
10.21437/Interspeech.2022-602
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The use of deep neural networks (DNN) has dramatically elevated the performance of automatic speaker verification (ASV) over the last decade. However, ASV systems can be easily neutralized by spoofing attacks. Therefore, the Spoofing-Aware Speaker Verification (SASV) challenge is designed and held to promote development of systems that can perform ASV considering spoofing attacks by integrating ASV and spoofing countermeasure (CM) systems. In this paper, we propose two back-end systems: multi-layer perceptron score fusion model (MSFM) and integrated embedding projector (IEP). The MSFM, score fusion back-end system, derived SASV score utilizing ASV and CM scores and embeddings. On the other hand, IEP combines ASV and CM embeddings into SASV embedding and calculates final SASV score based on the cosine similarity. We effectively integrated ASV and CM systems through proposed MSFM and IEP and achieved the SASV equal error rates 0.56%, 1.32% on the official evaluation trials of the SASV 2022 challenge.
引用
收藏
页码:2878 / 2882
页数:5
相关论文
共 15 条
  • [1] Spoofing-Aware Speaker Verification by Multi-Level Fusion
    Wu, Haibin
    Meng, Lingwei
    Kang, Jiawen
    Li, Jinchao
    Li, Xu
    Wu, Xixin
    Lee, Hung-yi
    Meng, Helen
    INTERSPEECH 2022, 2022, : 4357 - 4361
  • [2] Attentional multi-feature fusion for spoofing-aware speaker verification
    Shen Q.
    Guo M.
    Huang Y.
    Ma J.
    International Journal of Speech Technology, 2024, 27 (02) : 377 - 387
  • [3] Towards single integrated spoofing-aware speaker verification embeddings
    Mun, Sung Hwan
    Shim, Hye-jin
    Tak, Hemlata
    Wang, Xin
    Liu, Xuechen
    Sahidullah, Md
    Jeong, Myeonghun
    Han, Min Hyun
    Todisco, Massimiliano
    Lee, Kong Aik
    Yamagishi, Junichi
    Evans, Nicholas
    Kinnunen, Tomi
    Kim, Nam Soo
    Jung, Jee-weon
    INTERSPEECH 2023, 2023, : 3989 - 3993
  • [4] Integrated Replay Spoofing-Aware Text-Independent Speaker Verification
    Shim, Hye-jin
    Jung, Jee-weon
    Kim, Ju-ho
    Yu, Ha-jin
    APPLIED SCIENCES-BASEL, 2020, 10 (18):
  • [5] MULTI-LAYER PERCEPTRON BASED SPEECH ACTIVITY DETECTION FOR SPEAKER VERIFICATION
    Ganapathy, Sriram
    Rajan, Padmanabhan
    Hermansky, Hynek
    2011 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2011, : 321 - 324
  • [6] Two stage speaker verification using Self Organising Map and Multi layer Perceptron Neural Network
    Tashan, Tariq
    Allen, Tony
    RESEARCH AND DEVELOPMENT IN INTELLIGENT SYSTEMS XXVIII: INCORPORATING APPLICATIONS AND INNOVATIONS IN INTELLIGENT SYSTEMS XIX, 2011, : 109 - 122
  • [7] Integrating DNN–HMM Technique with Hierarchical Multi-layer Acoustic Model for Text-Dependent Speaker Verification
    Mohammad Azharuddin Laskar
    Rabul Hussain Laskar
    Circuits, Systems, and Signal Processing, 2019, 38 : 3548 - 3572
  • [8] Data fusion integrated network forecasting scheme classifier (DFI-NFSC) via multi-layer perceptron decomposition architecture
    Cakan, Erdem
    Rodoplu, Volkan
    Guzelis, Cuneyt
    INTERNET OF THINGS, 2024, 28
  • [9] Integrating DNN-HMM Technique with Hierarchical Multi-layer Acoustic Model for Text-Dependent Speaker Verification
    Laskar, Mohammad Azharuddin
    Laskar, Rabul Hussain
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2019, 38 (08) : 3548 - 3572
  • [10] Identification of Significant Rainfall Stations in Kelantan River Using Z-Score for Multi-Layer Perceptron (MLP) Model Development
    Jaafar, Khairah
    Ismail, Nurlaila
    Tajjudin, Mazidah
    Adnan, Ramli
    Rahiman, Mohd Hezri Fazalul
    2016 IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC CONTROL AND INTELLIGENT SYSTEMS (I2CACIS), 2016, : 151 - 155