Enhancing speaker identification in criminal investigations through clusterization and rank-based scoring

被引:0
|
作者
Moura, Antonio Artur [1 ]
Nepomuceno, Napoleao [1 ]
Furtado, Vasco [1 ,2 ]
机构
[1] Univ Fortaleza, Grad Program Appl Informat, Ave Washington Soares 1321, BR-60811905 Fortaleza, Ceara, Brazil
[2] Empresa Tecnol Informacao Ceara, Ave Pontes Vieira 220, BR-60130240 Fortaleza, Ceara, Brazil
关键词
Digital forensic; Audio analytics; Speaker recognition;
D O I
10.1016/j.fsidi.2024.301765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces an approach that supports speaker identification in criminal investigations, specifically addressing challenges associated with large volumes of audio recordings featuring unknown speaker identities. Our approach clusters related recordings - potentially from the same person - based on representative voice embeddings extracted using the ECAPA-TDNN speaker recognition model. Grouping audio recordings from the same person enhances variability and richness in voice patterns, thereby improving confidence in automatic speaker recognition. We propose a combination of cosine similarity and a rank-based adjustment function to determine matches of audio clusters with individuals in an enrollment database. Our approach was validated through experiments on a Common Voice-based synthesized dataset and a real-life application involving cell phones seized in prisons, which contained thousands of conversational audio recordings. Results demonstrated satisfactory performance and stability, consistently reducing the pool of candidate speakers for subsequent analysis by a human investigator.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A novel rank-based classifier combination scheme for speaker identification
    Altinçay, H
    Demirekler, M
    2000 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS, VOLS I-VI, 2000, : 1209 - 1212
  • [2] Rank-Based Frame Classification for Usable Speech Detection in Speaker Identification Systems
    Ethridge, James
    Ramachandran, Ravi P.
    2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, : 292 - 296
  • [3] Rank-based autoregressive order identification
    Garel, B
    Hallin, M
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1999, 94 (448) : 1357 - 1371
  • [4] Rank-Based Nondomination Set Identification with Preprocessing
    Palakonda, Vikas
    Mallipeddi, Rammohan
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2016, PT II, 2016, 9713 : 150 - 157
  • [5] Enhancing Adaptive Differential Evolution Algorithms with Rank-Based Mutation Adaptation
    Leon, Miguel
    Xiong, Ning
    2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 103 - 109
  • [6] Rank-based shrinkage estimation for identification in semiparametric additive models
    Jing Yang
    Hu Yang
    Fang Lu
    Statistical Papers, 2019, 60 : 1255 - 1281
  • [7] Rank-based shrinkage estimation for identification in semiparametric additive models
    Yang, Jing
    Yang, Hu
    Lu, Fang
    STATISTICAL PAPERS, 2019, 60 (04) : 1255 - 1281
  • [8] Weakly Supervised Learning through Rank-based Contextual Measures
    Camacho Presotto, Joao Gabriel
    Valem, Lucas Pascotti
    de Sa, Nikolas Gomes
    Guimaraes Pedronette, Daniel Carlos
    Papa, Joao Paulo
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5752 - 5759
  • [9] Personal Re-identification Using Rank-based Manifold Ranking
    Hsieh, Cheng-Ta
    Han, Chin-Chun
    Fan, Kuo-Chin
    49TH ANNUAL IEEE INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY (ICCST), 2015, : 391 - 394
  • [10] Rank-Based Record Linkage for Re-Identification Risk Assessment
    Muralidhar, Krishnamurty
    Domingo-Ferrer, Josep
    PRIVACY IN STATISTICAL DATABASES: UNESCO CHAIR IN DATA PRIVACY, 2016, 9867 : 225 - 236