Brain Topology Modeling With EEG-Graphs for Auditory Spatial Attention Detection

被引:7
|
作者
Cai, Siqi [1 ]
Schultz, Tanja [2 ]
Li, Haizhou [1 ,3 ,4 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore, Singapore
[2] Univ Bremen, Cognit Syst Lab, Bremen, Germany
[3] Chinese Univ Hong Kong, Shenzhen Res Inst Big Data, Sch Data Sci, Shenzhen 518172, Peoples R China
[4] Univ Bremen, Machine Listening Lab, D-28359 Bremen, Germany
关键词
Auditory spatial attention; brain-computer interface; channel-wise attention; electroencephalography; graph convolutional network; SELECTIVE ATTENTION; CORTICAL TRACKING; ATTENDED SPEECH; OSCILLATIONS; MODULATION; DYNAMICS; NETWORK;
D O I
10.1109/TBME.2023.3294242
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective: Despite recent advances, the decoding of auditory attention from brain signals remains a challenge. A key solution is the extraction of discriminative features from high-dimensional data, such as multi-channel electroencephalography (EEG). However, to our knowledge, topological relationships between individual channels have not yet been considered in any study. In this work, we introduced a novel architecture that exploits the topology of the human brain to perform auditory spatial attention detection (ASAD) from EEG signals. Methods: We propose EEG-Graph Net, an EEG-graph convolutional network, which employs a neural attention mechanism. This mechanism models the topology of the human brain in terms of the spatial pattern of EEG signals as a graph. In the EEG-Graph, each EEG channel is represented by a node, while the relationship between two EEG channels is represented by an edge between the respective nodes. The convolutional network takes the multi-channel EEG signals as a time series of EEG-graphs and learns the node and edge weights from the contribution of the EEG signals to the ASAD task. The proposed architecture supports the interpretation of the experimental results by data visualization. Results: We conducted experiments on two publicly available databases. The experimental results showed that EEG-Graph Net significantly outperforms the state-of-the-art methods in terms of decoding performance. In addition, the analysis of the learned weight patterns provides insights into the processing of continuous speech in the brain and confirms findings from neuroscientific studies. Conclusion: We showed that modeling brain topology with EEG-graphs yields highly competitive results for auditory spatial attention detection. Significance: The proposed EEG-Graph Net is more lightweight and accurate than competing baselines and provides explanations for the results. Also, the architecture can be easily transferred to other brain-computer interface (BCI) tasks.
引用
收藏
页码:171 / 182
页数:12
相关论文
共 50 条
  • [21] Detecting the locus of auditory attention based on the spectro-spatial-temporal analysis of EEG
    Jiang, Yifan
    Chen, Ning
    Jin, Jing
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (05)
  • [22] EEG-Based Auditory Attention Detection With Spiking Graph Convolutional Network
    Cai, Siqi
    Zhang, Ran
    Zhang, Malu
    Wu, Jibin
    Li, Haizhou
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (05) : 1698 - 1706
  • [23] Neural tracking to go: auditory attention decoding and saliency detection with mobile EEG
    Straetmans, L.
    Holtze, B.
    Debener, S.
    Jaeger, M.
    Mirkovic, B.
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (06)
  • [24] A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection
    Cai, Siqi
    Li, Peiwen
    Su, Enze
    Liu, Qi
    Xie, Longhan
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (04) : 668 - 676
  • [25] EEG-based detection of the locus of auditory attention with convolutional neural networks
    Vandecappelle, Servaas
    Deckers, Lucas
    Das, Neetha
    Ansari, Amir Hossein
    Bertrand, Alexander
    Francart, Tom
    ELIFE, 2021, 10
  • [26] Attention-guided graph structure learning network for EEG-enabled auditory attention detection
    Zeng, Xianzhang
    Cai, Siqi
    Xie, Longhan
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (03)
  • [27] EEG-based Auditory Attention Detection with Spatiotemporal Graph and Graph Convolutional Network
    Wang, Ruicong
    Cai, Siqi
    Li, Haizhou
    INTERSPEECH 2023, 2023, : 1144 - 1148
  • [28] The effect of miniaturization and galvanic separation of EEG sensor devices in an auditory attention detection task
    Narayanan, Abhijith Mundanad
    Bertrand, Alexander
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 77 - 80
  • [29] Selective auditory attention detection based on effective connectivity by single-trial EEG
    Geravanchizadeh, Masoud
    Gavgani, Sahar Bakhshalipour
    JOURNAL OF NEURAL ENGINEERING, 2020, 17 (02)
  • [30] Decoding auditory and tactile attention for use in an EEG-based brain-computer interface
    An, Winko W.
    Si-Mohammed, Hakim
    Huang, Nicholas
    Gamper, Hannes
    Lee, Adrian K. C.
    Holz, Christian
    Johnston, David
    Jalobeanu, Mihai
    Emmanouilidou, Dimitra
    Cutrell, Edward
    Wilson, Andrew
    Tashev, Ivan
    2020 8TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2020, : 42 - 47