Speech Imagery Decoding Using EEG Signals and Deep Learning: A Survey

被引:0
|
作者
Zhang, Liying [1 ]
Zhou, Yueying [2 ]
Gong, Peiliang [1 ]
Zhang, Daoqiang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Artificial Intelligence, Key Lab Brain Machine Intelligence Technol, Minist Educ, Nanjing 211106, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Electroencephalography; Decoding; Task analysis; Reviews; Deep learning; Speech; Recording; Brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); speech imagery (SI); BRAIN-COMPUTER INTERFACE; IMAGINED SPEECH; CLASSIFICATION; WERNICKE; STATE;
D O I
10.1109/TCDS.2024.3431224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery (SI)-based brain-computer interface (BCI) using electroencephalogram (EEG) signal is a promising area of research for individuals with severe speech production disorders. Recent advances in deep learning (DL) have led to significant improvements in this domain. However, there is a lack of comprehensive review that covers the application of DL methods for decoding imagined speech via EEG. In this article, we survey SI and DL literature to address critical questions regarding preferred paradigms, preprocessing necessity, optimal input formulations, and current trends in DL-based techniques. Specifically, we first search major databases across science and engineering disciplines for relevant studies. Then, we analyze the DL-based techniques applied in SI decoding from five main perspectives: dataset, preprocessing, input formulation, DL architecture, and performance evaluation. Moreover, we summarize the key findings of this work and propose a set of practical recommendations. Finally, we highlight the practical challenges of DL-based imagined speech decoding and suggest future research directions.
引用
收藏
页码:22 / 39
页数:18
相关论文
共 50 条
  • [21] Deep learning multimodal fNIRS and EEG signals for bimanual grip force decoding
    Ortega, Pablo
    Faisal, A. Aldo
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
  • [22] Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning
    Rehman, Madiha
    Anwer, Humaira
    Garay, Helena
    Alemany-Iturriaga, Josep
    Diez, Isabel De la Torre
    Siddiqui, Hafeez ur Rehman
    Ullah, Saleem
    SENSORS, 2024, 24 (21)
  • [23] Decoding of Motor Imagery Movements from EEG Signals using SpiNNaker Neuromorphic Hardware
    Tayeb, Zied
    Ercelik, Emec
    Conradt, Joerg
    2017 8TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2017, : 263 - 266
  • [24] A Small-Sample Method with EEG Signals Based on Abductive Learning for Motor Imagery Decoding
    Zhong, Tianyang
    Wei, Xiaozheng
    Shi, Enze
    Gao, Jiaxing
    Ma, Chong
    Wei, Yaonai
    Zhang, Songyao
    Guo, Lei
    Han, Junwei
    Liu, Tianming
    Zhang, Tuo
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 416 - 424
  • [25] Speech decoding from stereo-electroencephalography (sEEG) signals using advanced deep learning methods
    Wu, Xiaolong
    Wellington, Scott
    Fu, Zhichun
    Zhang, Dingguo
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (03)
  • [26] Imagined Speech Classification Using EEG and Deep Learning
    Abdulghani, Mokhles M.
    Walters, Wilbur L.
    Abed, Khalid H.
    BIOENGINEERING-BASEL, 2023, 10 (06):
  • [27] Decoding of the speech envelope from EEG using the VLAAI deep neural network
    Bernd Accou
    Jonas Vanthornhout
    Hugo Van hamme
    Tom Francart
    Scientific Reports, 13
  • [28] Decoding of the speech envelope from EEG using the VLAAI deep neural network
    Accou, Bernd
    Vanthornhout, Jonas
    Van Hamme, Hugo
    Francart, Tom
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [29] Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG
    Cooney, Ciaran
    Korik, Attila
    Folli, Raffaella
    Coyle, Damien
    SENSORS, 2020, 20 (16) : 1 - 22
  • [30] A Bimodal Deep Learning Architecture for EEG-fNIRS Decoding of Overt and Imagined Speech
    Cooney, Ciaran
    Folli, Raffaella
    Coyle, Damien
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (06) : 1983 - 1994