An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network

被引:0
|
作者
Chen, Di [1 ,2 ]
Huang, Haiyun [2 ,3 ]
Guan, Zijing [1 ,2 ]
Pan, Jiahui [2 ,3 ]
Li, Yuanqing [1 ,2 ]
机构
[1] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou, Peoples R China
[2] Pazhou Lab, Res Ctr Brain Comp Interface, Pazhou, Peoples R China
[3] South China Normal Univ, Sch Software, Guangzhou 510630, Peoples R China
基金
中国国家自然科学基金;
关键词
Index Terms -Electroencephalography (EEG); intersubject; attention decoding; offline analysis; domain-adversarial training neural network (DANN); online brain- computer interface (BCI); EEG; NEUROFEEDBACK; DEPRESSION; ALERTNESS; POWER;
D O I
10.1109/TBME.2024.3404131
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
- Objective: Attention decoding plays a vital role in daily life, where electroencephalography (EEG) has been widely involved. However, training a universally effective model for everyone is impractical due to substantial interindividual variability in EEG signals. To tackle the above challenge, we propose an end-to-end brain-computer interface (BCI) framework, including temporal and spatial one-dimensional (1D) convolutional neural network and domain-adversarial training strategy, namely DA-TSnet. Method: Specifically, DA-TSnet extracts temporal and spatial features of EEG, while it is jointly supervised by task loss and domain loss. During training, DA-TSnet aims to maximize the domain loss while simultaneously minimizing the task loss. We conduct an offline analysis, simulate online experiments on a self-collected dataset of 85 subjects, and real online experiments on 22 subjects. Main results: DA-TSnet achieves a leave-one-subject-out (LOSO) cross-validation (CV) classification accuracy of 89.40% +/- 9.96%, outperforming several state-of-the-art attention EEG decoding methods. In simulated online experiments, DA-TSnet achieves an outstanding accuracy of 88.07% +/- 11.22%. In real online experiments, it achieves an average accuracy surpassing 86%. Significance: An end-to-end network framework does not rely on elaborate preprocessing and feature extraction steps, which saves time and human workload. Moreover, our framework utilizes domain-adversarial training neural network (DANN) to tackle the challenge posed by the high interindividual variability in EEG signals, which has significant reference value for handling other EEG signal decoding issues. Last, the performance of the DA-TSnet framework in offline and online experiments underscores its potential to facilitate more reliable applications.
引用
收藏
页码:2956 / 2967
页数:12
相关论文
共 50 条
  • [21] Quantum Neural Network-Based EEG Filtering for a Brain-Computer Interface
    Gandhi, Vaibhav
    Prasad, Girijesh
    Coyle, Damien
    Behera, Laxmidhar
    McGinnity, Thomas Martin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (02) : 278 - 288
  • [22] Cross-subject emotion recognition in brain-computer interface based on frequency band attention graph convolutional adversarial neural networks
    Chen, Shinan
    Wang, Yuchen
    Lin, Xuefen
    Sun, Xiaoyong
    Li, Weihua
    Ma, Weifeng
    JOURNAL OF NEUROSCIENCE METHODS, 2024, 411
  • [23] EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
    Lawhern, Vernon J.
    Solon, Amelia J.
    Waytowich, Nicholas R.
    Gordon, Stephen M.
    Hung, Chou P.
    Lance, Brent J.
    JOURNAL OF NEURAL ENGINEERING, 2018, 15 (05)
  • [24] A Domain-Adversarial Wide-Kernel Convolutional Neural Network for Noisy Domain Adaptive Diesel Engine Misfire Diagnosis
    Xu, Senhan
    Lei, Junbo
    Qin, Chengjin
    Zhang, Zhinan
    Tao, Jianfeng
    Liu, Chengliang
    IEEE Transactions on Instrumentation and Measurement, 2024, 73 : 1 - 19
  • [25] Overlapping filter bank convolutional neural network for multisubject multicategory motor imagery brain-computer interface
    Luo, Jing
    Li, Jundong
    Mao, Qi
    Shi, Zhenghao
    Liu, Haiqin
    Ren, Xiaoyong
    Hei, Xinhong
    BIODATA MINING, 2023, 16 (01)
  • [26] Overlapping filter bank convolutional neural network for multisubject multicategory motor imagery brain-computer interface
    Jing Luo
    Jundong Li
    Qi Mao
    Zhenghao Shi
    Haiqin Liu
    Xiaoyong Ren
    Xinhong Hei
    BioData Mining, 16
  • [27] Application of Continuous Wavelet Transform and Convolutional Neural Network in Decoding Motor Imagery Brain-Computer Interface
    Lee, Hyeon Kyu
    Choi, Young-Seok
    ENTROPY, 2019, 21 (12)
  • [28] A Spiking Neural Network Based on Neural Manifold for Augmenting Intracortical Brain-Computer Interface Data
    Zheng, Shengjie
    Li, Wenyi
    Qian, Lang
    He, Chenggang
    Li, Xiaojian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT III, 2022, 13531 : 519 - 530
  • [29] A Domain-Adversarial Wide-Kernel Convolutional Neural Network for Noisy Domain Adaptive Diesel Engine Misfire Diagnosis
    Xu, Senhan
    Lei, Junbo
    Qin, Chengjin
    Zhang, Zhinan
    Tao, Jianfeng
    Liu, Chengliang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 19
  • [30] FBN-TCN: Temporal convolutional neural network based on spatial domain fusion brain networks for affective brain-computer interfaces
    Bi, Jinying
    Wang, Fei
    Ping, Jingyu
    Qu, Gangguo
    Hu, Fangzhou
    Li, Hao
    Han, Shuai
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 94