A Deep Learning Framework for Decoding Motor Imagery Tasks of the Same Hand Using EEG Signals

被引:41
|
作者
Alazrai, Rami [1 ]
Abuhijleh, Motaz [1 ]
Alwanni, Hisham [2 ]
Daoud, Mohammad, I [1 ]
机构
[1] German Jordanian Univ, Sch Elect Engn & Informat Technol, Dept Comp Engn, Amman 11180, Jordan
[2] Univ Freiburg, Fac Engn, D-79098 Freiburg, Germany
来源
IEEE ACCESS | 2019年 / 7卷
关键词
Convolutional neural networks (CNN); deep learning; electroencephalography (EEG); motor imagery; time-frequency distribution; BRAIN-COMPUTER INTERFACES; SINGLE-TRIAL EEG; DISCRIMINATION; CLASSIFICATION;
D O I
10.1109/ACCESS.2019.2934018
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study aims to increase the control's dimensions of the electroencephalography (EEG)-based brain-computer interface (BCI) systems by distinguishing between the motor imagery (MI) tasks associated with fine body-parts of the same hand, such as the wrist and fingers. This in turn can enable individuals who are suffering from transradial amputations to better control prosthetic hands and to perform various dexterous hand tasks. In particular, we present a novel three-stage framework for decoding MI tasks of the same hand. The three stages of the proposed framework are the input, feature extraction, and classification stages. At the input stage, we employ a quadratic time-frequency distribution (QTFD) to analyze the EEG signals in the joint time-frequency domain. The use of a QTFD enables to transform the EEG signals into a set of two-dimensional (2D) time-frequency images (TFIs) that describe the distribution of the energy encapsulated within the EEG signals in terms of the time, frequency, and electrode position. At the feature extraction stage, we design a new convolutional neural network (CNN) architecture that can automatically analyze and extract salient features from the TFIs created at the input stage. Finally, the features obtained at the feature extraction stage are passed to the classification stage to assign each input TFI to one of the eleven MI tasks that are considered in the current study. The performance of our proposed framework is evaluated using EEG signals that were acquired from eighteen able-bodied subjects and four transradial amputated subjects while performing eleven MI tasks within the same hand. The average classification accuracies obtained for the able-bodied and transradial amputated subjects are 73.7% and 72.8%, respectively. Moreover, our proposed framework yields 14.5% and 11.2% improvements over the results obtained for the able-bodied and transradial amputated subjects, respectively, using conventional QTFD-based handcrafted features and a multi-class support vector machine classifier. The results demonstrate the efficacy of the proposed framework to decode the MI tasks associated with the same hand for able-bodied and transradial amputated subjects.
引用
收藏
页码:109612 / 109627
页数:16
相关论文
共 50 条
  • [21] EEG based method for the decoding of complex arm motor imagery tasks
    Zhang, Shuailei
    Wang, Shuai
    Zheng, Dezhi
    Na, Rui
    Zhu, Kai
    Ma, Kang
    Li, Dapeng
    2018 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2018, : 18 - 23
  • [22] Decoding of Motor Imagery Movements from EEG Signals using SpiNNaker Neuromorphic Hardware
    Tayeb, Zied
    Ercelik, Emec
    Conradt, Joerg
    2017 8TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2017, : 263 - 266
  • [23] Effect of Hand Dominance When Decoding Motor Imagery Grasping Tasks
    Nergard, Katrine Linnea
    Endestad, Tor
    Torresen, Jim
    COMPUTATIONAL NEUROSCIENCE, LAWCN 2021, 2022, 1519 : 233 - 249
  • [24] A Small-Sample Method with EEG Signals Based on Abductive Learning for Motor Imagery Decoding
    Zhong, Tianyang
    Wei, Xiaozheng
    Shi, Enze
    Gao, Jiaxing
    Ma, Chong
    Wei, Yaonai
    Zhang, Songyao
    Guo, Lei
    Han, Junwei
    Liu, Tianming
    Zhang, Tuo
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 416 - 424
  • [25] Decoding EEG and LFP Signals using Deep Learning: Heading TrueNorth
    Nurse, Ewan
    Mashford, Benjamin S.
    Yepes, Antonio Jimeno
    Kiral-Kornek, Isabell
    Harrer, Stefan
    Freestone, Dean R.
    PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS (CF'16), 2016, : 259 - 266
  • [26] Multibranch convolutional neural network with contrastive representation learning for decoding same limb motor imagery tasks
    Phunruangsakao, Chatrin
    Achanccaray, David
    Izumi, Shin-Ichi
    Hayashibe, Mitsuhiro
    FRONTIERS IN HUMAN NEUROSCIENCE, 2022, 16
  • [27] EEG-Based Brain-Computer Interface for Decoding Motor Imagery Tasks within the Same Hand Using Choi-Williams Time-Frequency Distribution
    Alazrai, Rami
    Alwanni, Hisham
    Baslan, Yara
    Alnuman, Nasim
    Daoud, Mohammad I.
    SENSORS, 2017, 17 (09)
  • [28] An efficient shallow convolutional decoding network for motor imagery EEG signals
    Li W.
    Xu G.
    Zhang K.
    Zhang S.
    Zhao L.
    Li H.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2023, 57 (10): : 11 - 19
  • [29] Temporal Pyramid Pooling for Decoding Motor-Imagery EEG Signals
    Ha, Kwon-Woo
    Jeong, Jin-Woo
    IEEE ACCESS, 2021, 9 : 3112 - 3125
  • [30] Federated deep transfer learning for EEG decoding using multiple BCI tasks
    Wei, Xiaoxi
    Faisal, A. Aldo
    2023 11TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, NER, 2023,