Decoding of imagined speech electroencephalography neural signals using transfer learning method

被引:4
|
作者
Mahapatra, Nrushingh Charan [1 ,2 ]
Bhuyan, Prachet [2 ]
机构
[1] Intel Technol India Pvt Ltd, Bengaluru 560103, India
[2] Kalinga Inst Ind Technol, Sch Comp Engn, Bhubaneswar 751024, India
来源
JOURNAL OF PHYSICS COMMUNICATIONS | 2023年 / 7卷 / 09期
关键词
brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); imagined speech; signal processing; transfer learning (TL); EEG; ARTIFACTS;
D O I
10.1088/2399-6528/ad0197
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The use of brain-computer interfaces to produce imagined speech from brain waves has the potential to assist individuals with difficulty producing speech or communicating silently. The decoding of covert speech has been observed to have limited efficacy due to the diverse nature of the associated measured brain waves and the limited number of covert speech databases. As a result, traditional machine learning algorithms for learning and inference are challenging, and one of the real alternatives could be to leverage transfer of learning. The main goals of this research were to create a new deep learning (DL) framework for decoding imagined speech electroencephalography (EEG) signals tasks using transfer learning and to transfer the model learning of the source task of an imagined speech EEG dataset to the model training on the target task of another imagined speech EEG dataset, essentially the cross-task learning transfer of discriminative characteristics of the source task to the target task of imagined speech. The experiment was carried out using two distinct open-access EEG datasets, FEIS and KaraOne, that recorded the imagined speech classes of neural signals from multiple individuals. The target FEIS model and the target KaraOne model for multiclass classification exhibit overall accuracy of 89.01% and 82.35%, respectively, according to the proposed transfer learning. The experiment results indicate that the cross-task deep transfer learning design reliably classifies the imagined speech EEG signals by applying the source task learning to the target task learning. The findings suggest the feasibility of a consistent strategy for classifying multiclass imagined speech with transfer learning, which could thereby open up the possibility of future investigation into cross-task imagined speech classification knowledge usability for generalization of new imagined speech prompts.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Transfer learning in imagined speech EEG-based BCIs
    Garcia-Salinas, Jesus S.
    Villasenor-Pineda, Luis
    Reyes-Garcia, Carlos A.
    Torres-Garcia, Alejandro A.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2019, 50 : 151 - 157
  • [22] Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals
    Dash, Debadatta
    Ferrari, Paul
    Wang, Jun
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [23] Imagined Speech Reconstruction From Neural Signals-An Overview of Sources and Methods
    Tang, Jiye
    Chen, Junxin
    Xu, Xu
    Liu, Aiping
    Chen, Xun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [24] A neural speech decoding framework leveraging deep learning and speech synthesis
    Chen, Xupeng
    Wang, Ran
    Khalilian-Gourtani, Amirhossein
    Yu, Leyao
    Dugan, Patricia
    Friedman, Daniel
    Doyle, Werner
    Devinsky, Orrin
    Wang, Yao
    Flinker, Adeen
    NATURE MACHINE INTELLIGENCE, 2024, 6 (04) : 467 - 480
  • [25] Transfer learning to detect neonatal seizure from electroencephalography signals
    Abdullah Caliskan
    Suleyman Rencuzogullari
    Neural Computing and Applications, 2021, 33 : 12087 - 12101
  • [26] Transfer learning to detect neonatal seizure from electroencephalography signals
    Caliskan, Abdullah
    Rencuzogullari, Suleyman
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (18): : 12087 - 12101
  • [27] Speech decoding using cortical and subcortical electrophysiological signals
    Wu, Hemmings
    Cai, Chengwei
    Ming, Wenjie
    Chen, Wangyu
    Zhu, Zhoule
    Feng, Chen
    Jiang, Hongjie
    Zheng, Zhe
    Sawan, Mohamad
    Wang, Ting
    Zhu, Junming
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [28] Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG
    Cooney, Ciaran
    Korik, Attila
    Folli, Raffaella
    Coyle, Damien
    SENSORS, 2020, 20 (16) : 1 - 22
  • [29] A Bimodal Deep Learning Architecture for EEG-fNIRS Decoding of Overt and Imagined Speech
    Cooney, Ciaran
    Folli, Raffaella
    Coyle, Damien
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (06) : 1983 - 1994
  • [30] Diff-E: Diffusion-based Learning for Decoding Imagined Speech EEG
    Kim, Soowon
    Lee, Young-Eun
    Lee, Seo-Hyun
    Lee, Seong-Whan
    INTERSPEECH 2023, 2023, : 1159 - 1163