Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings

被引:3
|
作者
Hemmerling, Daria [1 ]
Wodzinski, Marek [1 ,2 ]
Orozco-Arroyave, Juan Rafael [3 ,4 ]
Sztaho, David [5 ]
Daniol, Mateusz [1 ]
Jemiolo, Pawel [1 ]
Wojcik-Pedziwiatr, Magdalena [6 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Biomed Engn, Krakow, Poland
[2] Univ Appl Sci Western Switzerland, Inst Informat Syst, HES SO Valais, Sierre, Switzerland
[3] Univ Antioquia, Medellin, Colombia
[4] Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[5] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, Budapest, Hungary
[6] Krakow Univ, Dept Neurol, Krakow, Poland
关键词
Deep Learning; Vision Transformer; Voice Processing; Neurodegenerative Diseases; Hypokinetic Dysarthria;
D O I
10.1109/EMBC40787.2023.10340478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's disease (PD) is the 2(nd) most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.
引用
收藏
页数:4
相关论文
共 50 条
  • [41] Abnormalities of vision and colour vision in Parkinson's disease
    Weil, Rimona
    ACTA OPHTHALMOLOGICA, 2019, 97
  • [42] Subthalamic Stimulation Reduces Vowel Space at the Initiation of Sustained Production: Implications for Articulatory Motor Control in Parkinson's Disease
    Sidtis, John J.
    Alken, Amy G.
    Tagliati, Michele
    Alterman, Ron
    Sidtis, Diana Van Lancker
    JOURNAL OF PARKINSONS DISEASE, 2016, 6 (02) : 361 - 370
  • [43] Fusing Various Audio Feature Sets for Detection of Parkinson's Disease from Sustained Voice and Speech Recordings
    Vaiciukynas, Evaldas
    Verikas, Antanas
    Gelzinis, Adas
    Bacauskiene, Marija
    Vaskevicius, Kestutis
    Uloza, Virgilijus
    Padervinskis, Evaldas
    Ciceliene, Jolita
    SPEECH AND COMPUTER, 2016, 9811 : 328 - 337
  • [44] Deep Learning Approach to Parkinson's Disease Detection Using Voice Recordings and Convolutional Neural Network Dedicated to Image Classification
    Wodzinski, Marek
    Skalski, Andrzej
    Hemmerling, Dania
    Rafael Orozco-Arroyave, Juan
    Noeth, Elmar
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 717 - 720
  • [45] Impact of the LSVT on vowel articulation and coarticulation in Parkinson's disease
    Sauvageau, Vincent Martel
    Roy, Johanna-Pascale
    Langlois, Melanie
    Macoir, Joel
    CLINICAL LINGUISTICS & PHONETICS, 2015, 29 (06) : 424 - 440
  • [46] Hybrid Machine Learning Framework for Multistage Parkinson's Disease Classification Using Acoustic Features of Sustained Korean Vowels
    Mondol, S. I. M. M. Raton
    Kim, Ryul
    Lee, Sangmin
    BIOENGINEERING-BASEL, 2023, 10 (08):
  • [47] Electrophysiological recordings of subthalamic neurons in Parkinson's disease
    Fietzek, UM
    Weinert, D
    Hamel, A
    Volkmann, J
    Jan, R
    MOVEMENT DISORDERS, 2002, 17 : S196 - S196
  • [48] Parkinson's disease and the effect of lexical factors on vowel articulation
    Watson, Peter J.
    Munson, Benjamin
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2008, 124 (05): : EL291 - EL295
  • [49] A ViT Vision Transformer Model for Rose Leaf Disease Classification
    Saini, Archana
    Guleria, Kalpna
    Sharma, Shagun
    2024 2ND WORLD CONFERENCE ON COMMUNICATION & COMPUTING, WCONF 2024, 2024,
  • [50] Genomics transformer for diagnosing Parkinson's disease
    Reyes, Diego Machado
    Kim, Mansu
    Chaoh, Hanqing
    Hahn, Juergen
    Shen, Li
    Yan, Pingkun
    2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22), 2022,