EEG-ITNet: An Explainable Inception Temporal Convolutional Network for Motor Imagery Classification

被引:41
|
作者
Salami, Abbas [1 ]
Andreu-Perez, Javier [1 ,2 ,3 ,4 ]
Gillmeister, Helge [2 ,3 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[2] Univ Essex, Dept Psychol, Colchester CO4 3SQ, Essex, England
[3] Univ Essex, Ctr Computat Intelligence, Inst Publ Hlth & Wellbeing, Smart Hlth Technol Grp, Colchester CO4 3SQ, Essex, England
[4] Univ Jaen, Dept Comp Sci, Simbad2, Jaen 23071, Spain
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Convolution; Feature extraction; Electroencephalography; Computer architecture; Visualization; Kernel; Convolutional neural networks; Brain-computer interface; deep learning; deep neural network visualisation; inception module; motor imagery; temporal convolutional network; BRAIN-COMPUTER INTERFACES; MODULATION;
D O I
10.1109/ACCESS.2022.3161489
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, neural networks and especially deep architectures have received substantial attention for EEG signal analysis in the field of brain-computer interfaces (BCIs). In this ongoing research area, the end-to-end models are more favoured than traditional approaches requiring signal transformation pre-classification. They can eliminate the need for prior information from experts and the extraction of handcrafted features. However, although several deep learning algorithms have been already proposed in the literature, achieving high accuracies for classifying motor movements or mental tasks, they often face a lack of interpretability and therefore are not quite favoured by the neuroscience community. The reasons behind this issue can be the high number of parameters and the sensitivity of deep neural networks to capture tiny yet unrelated discriminative features. We propose an end-to-end deep learning architecture called EEG-ITNet and a more comprehensible method to visualise the network learned patterns. Using inception modules and causal convolutions with dilation, our model can extract rich spectral, spatial, and temporal information from multi-channel EEG signals with less complexity (in terms of the number of trainable parameters) than other existing end-to-end architectures, such as EEG-Inception and EEG-TCNet. By an exhaustive evaluation on dataset 2a from BCI competition IV and OpenBMI motor imagery dataset, EEG-ITNet shows up to 5.9% improvement in the classification accuracy in different scenarios with statistical significance compared to its competitors. We also comprehensively explain and support the validity of network illustration from a neuroscientific perspective. We have also made our code freely accessible at https://github.com/AbbasSalami/EEG-ITNet.
引用
收藏
页码:36672 / 36685
页数:14
相关论文
共 50 条
  • [31] Electroencephalography-based motor imagery classification using temporal convolutional network fusion
    Musallam, Yazeed K.
    AlFassam, Nasser I.
    Muhammad, Ghulam
    Amin, Syed Umar
    Alsulaiman, Mansour
    Abdul, Wadood
    Altaheri, Hamdi
    Bencherif, Mohamed A.
    Algabri, Mohammed
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 69
  • [32] Convolutional Neural Network Based Approach Towards Motor Imagery Tasks EEG Signals Classification
    Chaudhary, Shalu
    Taran, Sachin
    Bajaj, Varun
    Sengur, Abdulkadir
    IEEE SENSORS JOURNAL, 2019, 19 (12) : 4494 - 4500
  • [33] Fusion Convolutional Neural Network for Multi-Class Motor Imagery of EEG Signals Classification
    Echtioui, Amira
    Zouch, Wassim
    Ghorbel, Mohamed
    Mhiri, Chokri
    Hamam, Habib
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 1642 - 1647
  • [34] Spatial Component-wise Convolutional Network (SCCNet) for Motor-Imagery EEG Classification
    Wei, Chun-Shu
    Koike-Akino, Toshiaki
    Wang, Ye
    2019 9TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2019, : 328 - 331
  • [35] Classification of Motor Imagery EEG Signals Based on Deep Autoencoder and Convolutional Neural Network Approach
    Hwaidi, Jamal F.
    Chen, Thomas M.
    IEEE ACCESS, 2022, 10 : 48071 - 48081
  • [36] EEG-inception: an accurate and robust end-to-end neural network for EEG-based motor imagery classification
    Zhang, Ce
    Kim, Young-Keun
    Eskandarian, Azim
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
  • [37] EEG-BCI-based motor imagery classification using double attention convolutional network
    Sireesha, V.
    Tallapragada, V. V. Satyanarayana
    Naresh, M.
    Pradeep Kumar, G. V.
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2025, 28 (05) : 581 - 600
  • [38] A New Convolutional Neural Network for Motor Imagery Classification
    Zhang, Ruilong
    Gong, Qun
    Zhao, Xinyi
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 8428 - 8432
  • [39] MOTOR IMAGERY FOR EEG BIOMETRICS USING CONVOLUTIONAL NEURAL NETWORK
    Das, Rig
    Maiorana, Emanuele
    Campisi, Patrizio
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2062 - 2066
  • [40] Wasserstein generative adversarial network with gradient penalty and convolutional neural network based motor imagery EEG classification
    Xiong, Hui
    Li, Jiahe
    Liu, Jinzhen
    Song, Jinlong
    Han, Yuqing
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (04)