Speech Imagery Decoding Using EEG Signals and Deep Learning: A Survey

被引:0
|
作者
Zhang, Liying [1 ]
Zhou, Yueying [2 ]
Gong, Peiliang [1 ]
Zhang, Daoqiang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Artificial Intelligence, Key Lab Brain Machine Intelligence Technol, Minist Educ, Nanjing 211106, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Electroencephalography; Decoding; Task analysis; Reviews; Deep learning; Speech; Recording; Brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); speech imagery (SI); BRAIN-COMPUTER INTERFACE; IMAGINED SPEECH; CLASSIFICATION; WERNICKE; STATE;
D O I
10.1109/TCDS.2024.3431224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery (SI)-based brain-computer interface (BCI) using electroencephalogram (EEG) signal is a promising area of research for individuals with severe speech production disorders. Recent advances in deep learning (DL) have led to significant improvements in this domain. However, there is a lack of comprehensive review that covers the application of DL methods for decoding imagined speech via EEG. In this article, we survey SI and DL literature to address critical questions regarding preferred paradigms, preprocessing necessity, optimal input formulations, and current trends in DL-based techniques. Specifically, we first search major databases across science and engineering disciplines for relevant studies. Then, we analyze the DL-based techniques applied in SI decoding from five main perspectives: dataset, preprocessing, input formulation, DL architecture, and performance evaluation. Moreover, we summarize the key findings of this work and propose a set of practical recommendations. Finally, we highlight the practical challenges of DL-based imagined speech decoding and suggest future research directions.
引用
收藏
页码:22 / 39
页数:18
相关论文
共 50 条
  • [1] A Deep Learning Framework for Decoding Motor Imagery Tasks of the Same Hand Using EEG Signals
    Alazrai, Rami
    Abuhijleh, Motaz
    Alwanni, Hisham
    Daoud, Mohammad, I
    IEEE ACCESS, 2019, 7 : 109612 - 109627
  • [2] Classification of motor imagery EEG signals using deep learning
    Rahma, Boungab
    Aicha, Reffad
    Kamel, Mebarkia
    PROGRAM OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATIC CONTROL, ICEEAC 2024, 2024,
  • [3] Decoding Hand Motor Imagery Tasks Within the Same Limb From EEG Signals Using Deep Learning
    Achanccaray, David
    Hayashibe, Mitsuhiro
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2020, 2 (04): : 692 - 699
  • [4] Decoding EEG and LFP Signals using Deep Learning: Heading TrueNorth
    Nurse, Ewan
    Mashford, Benjamin S.
    Yepes, Antonio Jimeno
    Kiral-Kornek, Isabell
    Harrer, Stefan
    Freestone, Dean R.
    PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS (CF'16), 2016, : 259 - 266
  • [5] Using articulated speech EEG signals for imagined speech decoding
    Bras, Chris
    Patel, Tanvina
    Scharenborg, Odette
    INTERSPEECH 2024, 2024, : 407 - 411
  • [6] Inner Speech Classification using EEG Signals: A Deep Learning Approach
    Van den Berg, Bram
    Van Donkelaar, Sander
    Alimardani, Maryam
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2021, : 258 - 261
  • [7] Hybrid deep neural network using transfer learning for EEG motor imagery decoding
    Zhang, Ruilong
    Zong, Qun
    Dou, Liqian
    Zhao, Xinyi
    Tang, Yifan
    Li, Zhiyu
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
  • [8] Deep learning in motor imagery EEG signal decoding: A Systematic Review
    Saibene, Aurora
    Ghaemi, Hafez
    Dagdevir, Eda
    NEUROCOMPUTING, 2024, 610
  • [9] An efficient deep learning approach for automatic speech recognition using EEG signals
    Chinta, Babu
    Pampana, Madhuri
    Moorthi, M.
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2025,
  • [10] Classification of Motor Imagery EEG Signals with Deep Learning Models
    Shen, Yurun
    Lu, Hongtao
    Jia, Jie
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING, ISCIDE 2017, 2017, 10559 : 181 - 190