EEG-ITNet: An Explainable Inception Temporal Convolutional Network for Motor Imagery Classification

被引:41
|
作者
Salami, Abbas [1 ]
Andreu-Perez, Javier [1 ,2 ,3 ,4 ]
Gillmeister, Helge [2 ,3 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[2] Univ Essex, Dept Psychol, Colchester CO4 3SQ, Essex, England
[3] Univ Essex, Ctr Computat Intelligence, Inst Publ Hlth & Wellbeing, Smart Hlth Technol Grp, Colchester CO4 3SQ, Essex, England
[4] Univ Jaen, Dept Comp Sci, Simbad2, Jaen 23071, Spain
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Convolution; Feature extraction; Electroencephalography; Computer architecture; Visualization; Kernel; Convolutional neural networks; Brain-computer interface; deep learning; deep neural network visualisation; inception module; motor imagery; temporal convolutional network; BRAIN-COMPUTER INTERFACES; MODULATION;
D O I
10.1109/ACCESS.2022.3161489
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, neural networks and especially deep architectures have received substantial attention for EEG signal analysis in the field of brain-computer interfaces (BCIs). In this ongoing research area, the end-to-end models are more favoured than traditional approaches requiring signal transformation pre-classification. They can eliminate the need for prior information from experts and the extraction of handcrafted features. However, although several deep learning algorithms have been already proposed in the literature, achieving high accuracies for classifying motor movements or mental tasks, they often face a lack of interpretability and therefore are not quite favoured by the neuroscience community. The reasons behind this issue can be the high number of parameters and the sensitivity of deep neural networks to capture tiny yet unrelated discriminative features. We propose an end-to-end deep learning architecture called EEG-ITNet and a more comprehensible method to visualise the network learned patterns. Using inception modules and causal convolutions with dilation, our model can extract rich spectral, spatial, and temporal information from multi-channel EEG signals with less complexity (in terms of the number of trainable parameters) than other existing end-to-end architectures, such as EEG-Inception and EEG-TCNet. By an exhaustive evaluation on dataset 2a from BCI competition IV and OpenBMI motor imagery dataset, EEG-ITNet shows up to 5.9% improvement in the classification accuracy in different scenarios with statistical significance compared to its competitors. We also comprehensively explain and support the validity of network illustration from a neuroscientific perspective. We have also made our code freely accessible at https://github.com/AbbasSalami/EEG-ITNet.
引用
收藏
页码:36672 / 36685
页数:14
相关论文
共 50 条
  • [21] Fusion Convolutional Neural Network for Cross-Subject EEG Motor Imagery Classification
    Roots, Karel
    Muhammad, Yar
    Muhammad, Naveed
    COMPUTERS, 2020, 9 (03) : 1 - 9
  • [22] Convolutional neural network with support vector machine for motor imagery EEG signal classification
    Echtioui, Amira
    Zouch, Wassim
    Ghorbel, Mohamed
    Mhiri, Chokri
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (29) : 45891 - 45911
  • [23] Image-based Motor Imagery EEG Classification using Convolutional Neural Network
    Yang, Tao
    Phua, Kok Soon
    Yu, Juanhong
    Selvaratnam, Thevapriya
    Toh, Valerie
    Ng, Wai Hoe
    Ang, Kai Keng
    So, Rosa Q.
    2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
  • [24] Flashlight-Net: A Modular Convolutional Neural Network for Motor Imagery EEG Classification
    Dang, Weidong
    Lv, Dongmei
    Tang, Mengxiao
    Sun, Xinlin
    Liu, Yong
    Grebogi, Celso
    Gao, Zhongke
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (07): : 4507 - 4516
  • [25] Classification of EEG Motor Imagery Using Support Vector Machine and Convolutional Neural Network
    Wu, Yu-Te
    Huang, Tzu Hsuan
    Lin, Chun Yi
    Tsai, Sheng Jia
    Wang, Po-Shan
    2018 INTERNATIONAL AUTOMATIC CONTROL CONFERENCE (CACS), 2018,
  • [26] Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network
    Zhang, Kaishuo
    Robinson, Neethu
    Lee, Seong-Whan
    Guan, Cuntai
    NEURAL NETWORKS, 2021, 136 : 1 - 10
  • [27] Subject adaptation convolutional neural network for EEG-based motor imagery classification
    Liu, Siwei
    Zhang, Jia
    Wang, Andong
    Wu, Hanrui
    Zhao, Qibin
    Long, Jinyi
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (06)
  • [28] Subject-Independent Motor Imagery EEG Classification Based on Graph Convolutional Network
    Lee, Juho
    Choi, Jin Woo
    Jo, Sungho
    PATTERN RECOGNITION, ACPR 2021, PT II, 2022, 13189 : 268 - 281
  • [29] Convolutional neural network with support vector machine for motor imagery EEG signal classification
    Amira Echtioui
    Wassim Zouch
    Mohamed Ghorbel
    Chokri Mhiri
    Multimedia Tools and Applications, 2023, 82 : 45891 - 45911
  • [30] Three-Branch Temporal-Spatial Convolutional Transformer for Motor Imagery EEG Classification
    Chen, Weiming
    Luo, Yiqing
    Wang, Jie
    IEEE ACCESS, 2024, 12 : 79754 - 79764