EEG-ITNet: An Explainable Inception Temporal Convolutional Network for Motor Imagery Classification

被引:41
|
作者
Salami, Abbas [1 ]
Andreu-Perez, Javier [1 ,2 ,3 ,4 ]
Gillmeister, Helge [2 ,3 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[2] Univ Essex, Dept Psychol, Colchester CO4 3SQ, Essex, England
[3] Univ Essex, Ctr Computat Intelligence, Inst Publ Hlth & Wellbeing, Smart Hlth Technol Grp, Colchester CO4 3SQ, Essex, England
[4] Univ Jaen, Dept Comp Sci, Simbad2, Jaen 23071, Spain
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Convolution; Feature extraction; Electroencephalography; Computer architecture; Visualization; Kernel; Convolutional neural networks; Brain-computer interface; deep learning; deep neural network visualisation; inception module; motor imagery; temporal convolutional network; BRAIN-COMPUTER INTERFACES; MODULATION;
D O I
10.1109/ACCESS.2022.3161489
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, neural networks and especially deep architectures have received substantial attention for EEG signal analysis in the field of brain-computer interfaces (BCIs). In this ongoing research area, the end-to-end models are more favoured than traditional approaches requiring signal transformation pre-classification. They can eliminate the need for prior information from experts and the extraction of handcrafted features. However, although several deep learning algorithms have been already proposed in the literature, achieving high accuracies for classifying motor movements or mental tasks, they often face a lack of interpretability and therefore are not quite favoured by the neuroscience community. The reasons behind this issue can be the high number of parameters and the sensitivity of deep neural networks to capture tiny yet unrelated discriminative features. We propose an end-to-end deep learning architecture called EEG-ITNet and a more comprehensible method to visualise the network learned patterns. Using inception modules and causal convolutions with dilation, our model can extract rich spectral, spatial, and temporal information from multi-channel EEG signals with less complexity (in terms of the number of trainable parameters) than other existing end-to-end architectures, such as EEG-Inception and EEG-TCNet. By an exhaustive evaluation on dataset 2a from BCI competition IV and OpenBMI motor imagery dataset, EEG-ITNet shows up to 5.9% improvement in the classification accuracy in different scenarios with statistical significance compared to its competitors. We also comprehensively explain and support the validity of network illustration from a neuroscientific perspective. We have also made our code freely accessible at https://github.com/AbbasSalami/EEG-ITNet.
引用
收藏
页码:36672 / 36685
页数:14
相关论文
共 50 条
  • [41] EEG Representation in Deep Convolutional Neural Networks for Classification of Motor Imagery
    Robinson, Neethu
    Lee, Seong-Whan
    Guan, Cuntai
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 1322 - 1326
  • [42] Attention-Based Multiscale Spatial-Temporal Convolutional Network for Motor Imagery EEG Decoding
    Zhang, Yu
    Li, Penghai
    Cheng, Longlong
    Li, Mingji
    Li, Hongji
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 2423 - 2434
  • [43] Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model
    Yu, Shiqi
    Wang, Zedong
    Wang, Fei
    Chen, Kai
    Yao, Dezhong
    Xu, Peng
    Zhang, Yong
    Wang, Hesong
    Zhang, Tao
    CEREBRAL CORTEX, 2024, 34 (02)
  • [44] Recurrent convolutional neural network model based on temporal and spatial feature for motor imagery classification
    Lee, Seung-Bo
    Kim, Hakseung
    Jeong, Ji-Hoon
    Wang, In-Nea
    Lee, Seong-Whan
    Kim, Dong-Joo
    2019 7TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2019, : 152 - 155
  • [45] A brain topography graph embedded convolutional neural network for EEG-based motor imagery classification
    Shi, Ji
    Tang, Jiaming
    Lu, Zhihuan
    Zhang, Ruolin
    Yang, Jun
    Guo, Qiuquan
    Zhang, Dongxing
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [46] An improved model using convolutional sliding window-attention network for motor imagery EEG classification
    Huang, Yuxuan
    Zheng, Jianxu
    Xu, Binxing
    Li, Xuhang
    Liu, Yu
    Wang, Zijian
    Feng, Hua
    Cao, Shiqi
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [47] IMH-Net: a convolutional neural network for end-to-end EEG motor imagery classification
    Liu, Menghao
    Li, Tingting
    Zhang, Xu
    Yang, Yang
    Zhou, Zhiyong
    Fu, Tianhao
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2024, 27 (15) : 2175 - 2188
  • [48] Classification of Motor Imagery EEG Signals with multi-input Convolutional Neural Network by augmenting STFT
    Shovon, Tanvir Hasan
    Al Nazi, Zabir
    Dash, Shovon
    Hossain, Md Foisal
    2019 5TH INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL ENGINEERING (ICAEE), 2019, : 398 - 403
  • [49] Simple Convolutional Neural Network for Left-Right Hands Motor Imagery EEG Signals Classification
    Tian, Geliang
    Liu, Yue
    INTERNATIONAL JOURNAL OF COGNITIVE INFORMATICS AND NATURAL INTELLIGENCE, 2019, 13 (03) : 36 - 49
  • [50] Classification of Motor Imagery Tasks Using EEG Based on Wavelet Scattering Transform and Convolutional Neural Network
    Buragohain, Rantu
    Ajaybhai, Jejariya
    Nathwani, Karan
    Abrol, Vinayak
    IEEE SENSORS LETTERS, 2024, 8 (12)