Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
|
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [31] A comprehensive benchmark dataset for SSVEP-based hybrid BCI
    Sadeghi, Sahar
    Maleki, Ali
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
  • [32] An SSVEP-Based BCI System for SMS in a Mobile Phone
    Lin, Jzau-Sheng
    Wang, Mei
    Lia, Pei-Yu
    Li, Zejin
    APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 412 - 415
  • [33] The Effect of Harmonics Count on SSVEP-Based BCI Results
    Kancaoglu, Murat
    Kuntalp, Mehmet
    2019 INNOVATIONS IN INTELLIGENT SYSTEMS AND APPLICATIONS CONFERENCE (ASYU), 2019, : 110 - 113
  • [34] A high-ITR SSVEP-based BCI speller
    Chen, Xiaogang
    Chen, Zhikai
    Gao, Shangkai
    Gao, Xiaorong
    BRAIN-COMPUTER INTERFACES, 2014, 1 (3-4) : 181 - 191
  • [35] Information Bottleneck as Optimisation Method for SSVEP-Based BCI
    Ingel, Anti
    Vicente, Raul
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [36] A multimodal approach to estimating vigilance in SSVEP-based BCI
    Wang, Kangning
    Qiu, Shuang
    Wei, Wei
    Zhang, Yukun
    Wang, Shengpei
    He, Huiguang
    Xu, Minpeng
    Jung, Tzyy-Ping
    Ming, Dong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 225
  • [37] A phase-coding framework for SSVEP-based BCI
    Yang, Qiuling
    Wu, Pingdong
    SIXTH INTERNATIONAL CONFERENCE ON ELECTRONICS AND INFORMATION ENGINEERING, 2015, 9794
  • [38] Online Adaptation Boosts SSVEP-Based BCI Performance
    Wong, Chi Man
    Wang, Ze
    Nakanishi, Masaki
    Wang, Boyu
    Rosa, Agostinho
    Chen, C. L. Philip
    Jung, Tzyy-Ping
    Wan, Feng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (06) : 2018 - 2028
  • [39] Convolutional denoising autoencoder based SSVEP signal enhancement to SSVEP-based BCIs
    Chia-Chun Chuang
    Chien-Ching Lee
    Chia-Hong Yeng
    Edmund-Cheung So
    Bor-Shyh Lin
    Yeou-Jiunn Chen
    Microsystem Technologies, 2022, 28 : 237 - 244
  • [40] Convolutional denoising autoencoder based SSVEP signal enhancement to SSVEP-based BCIs
    Chuang, Chia-Chun
    Lee, Chien-Ching
    Yeng, Chia-Hong
    So, Edmund-Cheung
    Lin, Bor-Shyh
    Chen, Yeou-Jiunn
    MICROSYSTEM TECHNOLOGIES-MICRO-AND NANOSYSTEMS-INFORMATION STORAGE AND PROCESSING SYSTEMS, 2022, 28 (01): : 237 - 244