Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
|
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [1] A Study on SSVEP-Based BCI
    ZhengHua Wu is with School of Computer Science EngineeringUniversity of Electronic Science and Technology of ChinaChengduChina DeZhong Yao is with the Key Laboratory for NeuroInformation of Ministry of EducationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
    Journal of Electronic Science and Technology of China, 2009, 7 (01) : 7 - 11
  • [2] A Study on SSVEP-Based BCI
    Zheng-Hua Wu is with School of Computer Science Engineering
    Journal of Electronic Science and Technology, 2009, 7 (01) : 7 - 11
  • [3] An improved cross-subject spatial filter transfer method for SSVEP-based BCI
    Yan, Wenqiang
    Wu, Yongcheng
    Du, Chenghang
    Xu, Guanghua
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (04)
  • [4] SSVEP-based BCI classification using power cepstrum analysis
    Chen, Yeou-Jiunn
    See, Aaron Raymond Ang
    Chen, Shih-Chung
    ELECTRONICS LETTERS, 2014, 50 (10) : 735 - U186
  • [5] A transformer-based deep neural network model for SSVEP classification
    Chen, Jianbo
    Zhang, Yangsong
    Pan, Yudong
    Xu, Peng
    Guan, Cuntai
    NEURAL NETWORKS, 2023, 164 : 521 - 534
  • [6] Wavelet Transform in Detection of the Subject Specific Frequencies for SSVEP-Based BCI
    Rejer, Izabela
    HARD AND SOFT COMPUTING FOR ARTIFICIAL INTELLIGENCE, MULTIMEDIA AND SECURITY, 2017, 534 : 146 - 155
  • [7] An Error Aware SSVEP-based BCI
    Kalaganis, Fotis
    Chatzilari, Elisavet
    Georgiadis, Kostas
    Nikolopoulos, Spiros
    Laskaris, Nikos
    Kompatsiaris, Yiannis
    2017 IEEE 30TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2017, : 775 - 780
  • [8] Stimulator selection in SSVEP-based BCI
    Wu, Zhenghua
    Lai, Yongxiu
    Xia, Yang
    Wu, Dan
    Yao, Dezhong
    MEDICAL ENGINEERING & PHYSICS, 2008, 30 (08) : 1079 - 1088
  • [9] Review and Evaluation of Trending SSVEP-Based BCI Extraction and Classification Methods
    Shahab, Bayar
    PROCEEDINGS OF SEVENTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2022, VOL. 3, 2023, 464 : 55 - 71
  • [10] Sequential Selection of Window Length for Improved SSVEP-Based BCI Classification
    Johnson, Erik C.
    Norton, James J. S.
    Jun, David
    Bretl, Timothy
    Jones, Douglas L.
    2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 7060 - 7063