Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
|
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [41] Subject-independent, SSVEP-based BCI: trading off among accuracy, responsiveness and complexity
    Mora, N.
    De Munari, I.
    Ciampolini, P.
    2015 7TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2015, : 146 - 149
  • [42] Direct information transfer rate optimisation for SSVEP-based BCI
    Ingel, Anti
    Kuzovkin, Ilya
    Vicente, Raul
    JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
  • [43] Vigilance Estimating in SSVEP-Based BCI Using Multimodal Signals
    Wang, Kangning
    Qiu, Shuang
    Wei, Wei
    Zhang, Chuncheng
    He, Huiguang
    Xu, Minpeng
    Ming, Dong
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 5974 - 5978
  • [44] Alpha neurofeedback training improves SSVEP-based BCI performance
    Wan, Feng
    da Cruz, Janir Nuno
    Nan, Wenya
    Wong, Chi Man
    Vai, Mang I.
    Rosa, Agostinho
    JOURNAL OF NEURAL ENGINEERING, 2016, 13 (03)
  • [45] Exploring the Possibilities and Limitations of Multitarget SSVEP-based BCI Applications
    Gembler, Felix
    Stawicki, Piotr
    Volosyak, Ivan
    2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 1488 - 1491
  • [46] Review of Riemannian Distances and Divergences, Applied to SSVEP-based BCI
    S. Chevallier
    E. K. Kalunga
    Q. Barthélemy
    E. Monacelli
    Neuroinformatics, 2021, 19 : 93 - 106
  • [47] An Analysis of Deep Learning Models in SSVEP-Based BCI: A Survey
    Xu, Dongcen
    Tang, Fengzhen
    Li, Yiping
    Zhang, Qifeng
    Feng, Xisheng
    BRAIN SCIENCES, 2023, 13 (03)
  • [48] Age-related differences in SSVEP-based BCI performance
    Volosyak, Ivan
    Gembler, Felix
    Stawicki, Piotr
    NEUROCOMPUTING, 2017, 250 : 57 - 64
  • [49] SSVEP-Based BCI for Manipulating Three Dimensional Contents and Devices
    Mun, Sungchul
    Cho, Sungjin
    Whang, Mincheol
    Ju, Byeong-Kwon
    Park, Min-Chul
    THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2012, 2012, 8384
  • [50] A Dynamic Selection Method for Reference Electrode in SSVEP-Based BCI
    Wu, Zhenghua
    Su, Sheng
    PLOS ONE, 2014, 9 (08):