Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings

被引:3
|
作者
Hemmerling, Daria [1 ]
Wodzinski, Marek [1 ,2 ]
Orozco-Arroyave, Juan Rafael [3 ,4 ]
Sztaho, David [5 ]
Daniol, Mateusz [1 ]
Jemiolo, Pawel [1 ]
Wojcik-Pedziwiatr, Magdalena [6 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Biomed Engn, Krakow, Poland
[2] Univ Appl Sci Western Switzerland, Inst Informat Syst, HES SO Valais, Sierre, Switzerland
[3] Univ Antioquia, Medellin, Colombia
[4] Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[5] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, Budapest, Hungary
[6] Krakow Univ, Dept Neurol, Krakow, Poland
关键词
Deep Learning; Vision Transformer; Voice Processing; Neurodegenerative Diseases; Hypokinetic Dysarthria;
D O I
10.1109/EMBC40787.2023.10340478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's disease (PD) is the 2(nd) most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Pronunciation characteristics of patients with Parkinson's disease based on sustained vowel speech
    Wen, Y.
    Zou, X.
    MOVEMENT DISORDERS, 2022, 37 : S379 - S379
  • [2] Classification of Alzheimer's Disease via Vision Transformer
    Lyu, Yanjun
    Yu, Xiaowei
    Zhu, Dajiang
    Zhang, Lu
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2022, 2022, : 463 - 468
  • [3] Analysis of voice recordings features for Classification of Parkinson's Disease
    Perez-Sanchez, Beatriz
    Sanchez-Marono, Noelia
    Diaz-Freire, Miguel A.
    39TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2024, 2024, : 531 - 532
  • [4] Classification of Parkinson’s Disease Genotypes in Drosophila Using Spatiotemporal Profiling of Vision
    Ryan J.H. West
    Christopher J.H. Elliott
    Alex R. Wade
    Scientific Reports, 5
  • [5] Classification of Parkinson's Disease Genotypes in Drosophila Using Spatiotemporal Profiling of Vision
    West, Ryan J. H.
    Elliott, Christopher J. H.
    Wade, Alex R.
    SCIENTIFIC REPORTS, 2015, 5
  • [6] An efficient vision transformer for Alzheimer's disease classification using magnetic resonance images
    Lu, Si-Yuan
    Zhang, Yu-Dong
    Yao, Yu-Dong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 101
  • [7] Vowel articulation in Parkinson's disease
    Skodda, S.
    Groenheit, W.
    Schlegel, U.
    MOVEMENT DISORDERS, 2010, 25 (07) : S365 - S365
  • [8] Vowel Articulation in Parkinson's Disease
    Skodda, Sabine
    Visser, Wenke
    Schlegel, Uwe
    JOURNAL OF VOICE, 2011, 25 (04) : 467 - 472
  • [9] Diagnosis of Parkinson's Diseases Using Classification Based on Voice Recordings
    Rajagopal, P. Chitra
    Choudhury, Tanupriya
    Sharma, Archana
    Kumar, Praveen
    EMERGING TRENDS IN EXPERT APPLICATIONS AND SECURITY, 2019, 841 : 575 - 581
  • [10] Premotor cortex is hypoactive during sustained vowel production in individuals with Parkinson's disease and hypophonia
    Manes, Jordan L.
    Kurani, Ajay S.
    Herschel, Ellen
    Roberts, Angela C.
    Tjaden, Kris
    Parrish, Todd
    Corcos, Daniel M.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17