Decoding Imagined Speech using Wavelet Features and Deep Neural Networks

被引:24
|
作者
Panachakel, Jerrin Thomas [1 ]
Ramakrishnan, A. G. [1 ]
Ananthapadmanabha, T., V [2 ]
机构
[1] Indian Inst Sci, Bangalore, Karnataka, India
[2] Voice & Speech Syst, Bangalore, Karnataka, India
来源
2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019) | 2019年
关键词
imagined speech; brain-computer interaction; deep neural network; commone spatial pattern; EEG; EEG; CLASSIFICATION; BRAIN;
D O I
10.1109/indicon47234.2019.9028925
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a novel approach that uses deep neural networks for classifying imagined speech, significantly increasing the classification accuracy. The proposed approach employs only the EEG channels over specific areas of the brain for classification, and derives distinct feature vectors from each of those channels. This gives us more data to train a classifier, enabling us to use deep learning approaches. Wavelet and temporal domain features are extracted from each channel. The final class label of each test trial is obtained by applying a majority voting on the classification results of the individual channels considered in the trial. This approach is used for classifying all the 11 prompts in the KaraOne dataset of imagined speech. The proposed architecture and the approach of treating the data have resulted in an average classification accuracy of 57.15%, which is an improvement of around 35% over the state-of-the-art results.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Decoding High-level Imagined Speech using Attention-based Deep Neural Networks
    Lee, Dae-Hyeok
    Kim, Sung-Jin
    Lee, Keon-Woo
    10TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI2022), 2022,
  • [2] Towards Neural Decoding of Imagined Speech based on Spoken Speech
    Lee, Seo-Hyun
    Lee, Young-Eun
    Kim, Soowon
    Ko, Byung-Kwan
    Lee, Seong-Whan
    2023 11TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI, 2023,
  • [3] Identification of discriminative features for decoding overt and imagined speech using stereotactic electroencephalography
    Meng, Kevin
    Grayden, David B.
    Cook, Mark J.
    Vogrin, Simon
    Goodarzy, Farhad
    2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 105 - 110
  • [4] Combining Speech Features for Aggression Detection Using Deep Neural Networks
    Jaafar, Noussaiba
    Lachiri, Zied
    2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP'2020), 2020,
  • [5] Efficient deep neural networks for speech synthesis using bottleneck features
    Joo, Young-Sun
    Jun, Won-Suk
    Kang, Hong-Goo
    2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [6] Decoding of imagined speech electroencephalography neural signals using transfer learning method
    Mahapatra, Nrushingh Charan
    Bhuyan, Prachet
    JOURNAL OF PHYSICS COMMUNICATIONS, 2023, 7 (09):
  • [7] Using articulated speech EEG signals for imagined speech decoding
    Bras, Chris
    Patel, Tanvina
    Scharenborg, Odette
    INTERSPEECH 2024, 2024, : 407 - 411
  • [8] Modulation spectral features for speech emotion recognition using deep neural networks
    Singh, Premjeet
    Sahidullah, Md
    Saha, Goutam
    SPEECH COMMUNICATION, 2023, 146 : 53 - 69
  • [9] Speech Bandwidth Extension Using Bottleneck Features and Deep Recurrent Neural Networks
    Gu, Yu
    Ling, Zhen-Hua
    Dai, Li-Rong
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 297 - 301
  • [10] Regularized sparse features for noisy speech enhancement using deep neural networks
    Khattak, Muhammad Irfan
    Saleem, Nasir
    Gao, Jiechao
    Verdu, Elena
    Fuente, Javier Parra
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 100