Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
|
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [21] The element of user training for SSVEP-based BCI
    Szalowski, Artur
    Picovici, Dorel
    2019 30TH IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC), 2019,
  • [22] Control of an electrical prosthesis with an SSVEP-based BCI
    Mueller-Putz, Gernot R.
    Pfurtscheller, Gert
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2008, 55 (01) : 361 - 364
  • [23] Word Prediction Support Model for SSVEP-Based BCI Web Speller
    Saboor, Abdul
    Benda, Mihaly
    Gembler, Felix
    Volosyak, Ivan
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2019, PT I, 2019, 11506 : 430 - 441
  • [24] Motion Visual Stimulus for SSVEP-based BCI system
    Punsawad, Yunyong
    Wongsawat, Yodchanan
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 3837 - 3840
  • [25] A prototype of SSVEP-based BCI for home appliances control
    Anindya, Sinantya Feranti
    Rachmat, Hendi Handian
    Sutjiredjeki, Ediana
    2016 1ST INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING (IBIOMED): EMPOWERING BIOMEDICAL TECHNOLOGY FOR BETTER FUTURE, 2016, : 5 - 10
  • [26] Effect of posterized naturalistic stimuli on SSVEP-based BCI
    Ng, Kian B.
    Bradley, Andrew P.
    Cunnington, Ross
    2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 3105 - 3108
  • [27] Online SSVEP-based BCI using Riemannian geometry
    Kalunga, Emmanuel K.
    Chevallier, Sylvain
    Barthelemy, Quentin
    Djouani, Karim
    Monacelli, Eric
    Hamam, Yskandar
    NEUROCOMPUTING, 2016, 191 : 55 - 68
  • [28] SSVEP-based BCI control of the DASHER writing system
    Garrido-del Angel, Pavel
    Bojorges-Valdez, Erik
    Yanez-Suarez, Oscar
    2011 5TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2011, : 446 - 448
  • [29] Using Modular Neural Network to SSVEP-based BCI
    Chen, Yeou-Jiunn
    Chen, Shih-Chung
    Wu, Chung-Min
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON APPLIED SYSTEM INNOVATION (ICASI), 2016,
  • [30] Control of the robotic arm system with an SSVEP-based BCI
    Fu, Rongrong
    Feng, Xiaolei
    Wang, Shiwei
    Shi, Ye
    Jia, Chengcheng
    Zhao, Jing
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (05)