Speech Imagery Decoding Using EEG Signals and Deep Learning: A Survey

被引:0
|
作者
Zhang, Liying [1 ]
Zhou, Yueying [2 ]
Gong, Peiliang [1 ]
Zhang, Daoqiang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Artificial Intelligence, Key Lab Brain Machine Intelligence Technol, Minist Educ, Nanjing 211106, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Electroencephalography; Decoding; Task analysis; Reviews; Deep learning; Speech; Recording; Brain-computer interface (BCI); deep learning (DL); electroencephalography (EEG); speech imagery (SI); BRAIN-COMPUTER INTERFACE; IMAGINED SPEECH; CLASSIFICATION; WERNICKE; STATE;
D O I
10.1109/TCDS.2024.3431224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery (SI)-based brain-computer interface (BCI) using electroencephalogram (EEG) signal is a promising area of research for individuals with severe speech production disorders. Recent advances in deep learning (DL) have led to significant improvements in this domain. However, there is a lack of comprehensive review that covers the application of DL methods for decoding imagined speech via EEG. In this article, we survey SI and DL literature to address critical questions regarding preferred paradigms, preprocessing necessity, optimal input formulations, and current trends in DL-based techniques. Specifically, we first search major databases across science and engineering disciplines for relevant studies. Then, we analyze the DL-based techniques applied in SI decoding from five main perspectives: dataset, preprocessing, input formulation, DL architecture, and performance evaluation. Moreover, we summarize the key findings of this work and propose a set of practical recommendations. Finally, we highlight the practical challenges of DL-based imagined speech decoding and suggest future research directions.
引用
收藏
页码:22 / 39
页数:18
相关论文
共 50 条
  • [41] Classification of Alcoholic EEG Signals Using a Deep Learning Method
    Farsi, Leila
    Siuly, Siuly
    Kabir, Enamul
    Wang, Hua
    IEEE SENSORS JOURNAL, 2021, 21 (03) : 3552 - 3560
  • [42] Consumer Preference Estimation Using EEG Signals and Deep Learning
    Ceylan, Burak
    Cekic, Yalcin
    Akan, Aydin
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [43] EEG Classification of Motor Imagery Using a Novel Deep Learning Framework
    Dai, Mengxi
    Zheng, Dezhi
    Na, Rui
    Wang, Shuai
    Zhang, Shuailei
    SENSORS, 2019, 19 (03)
  • [44] Decoding of imagined speech electroencephalography neural signals using transfer learning method
    Mahapatra, Nrushingh Charan
    Bhuyan, Prachet
    JOURNAL OF PHYSICS COMMUNICATIONS, 2023, 7 (09):
  • [45] Classification of group speech imagined EEG signals based on attention mechanism and deep learning
    Zhou, Yifan
    Zhang, Lingwei
    Zhou, Zhengdong
    Cai, Zhi
    Yuan, Mengyao
    Yuan, Xiaoxi
    Yang, Zeyi
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (12): : 2540 - 2546
  • [46] Cross-Channel Specific-Mutual Feature Transfer Learning for Motor Imagery EEG Signals Decoding
    Li, Donglin
    Wang, Jianhui
    Xu, Jiacan
    Fang, Xiaoke
    Ji, Ying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13472 - 13482
  • [47] Decoding Visual Imagery from EEG Signals using Visual Perception Guided Network Training Method
    Kwon, Byoung-Hee
    Lee, Byeong-Hoo
    Cho, Jeong-Hyun
    Jeong, Ji-Hoon
    10TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI2022), 2022,
  • [48] A System for the Study of Emotions with EEG Signals Using Machine Learning and Deep Learning
    Jaswanth, Vasupalli
    Naren, J.
    COGNITIVE INFORMATICS AND SOFT COMPUTING, 2020, 1040 : 59 - 65
  • [49] A Decoding Scheme for Incomplete Motor Imagery EEG With Deep Belief Network
    Chu, Yaqi
    Zhao, Xingang
    Zou, Yijun
    Xu, Weiliang
    Han, Jianda
    Zhao, Yiwen
    FRONTIERS IN NEUROSCIENCE, 2018, 12
  • [50] A Complete Scheme for Multi-Character Classification Using EEG Signals From Speech Imagery
    Pan, Hongguang
    Wang, Yiran
    Li, Zhuoyi
    Chu, Xin
    Teng, Bingyang
    Gao, Hongzheng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2024, 71 (08) : 2454 - 2462