Brain Topology Modeling With EEG-Graphs for Auditory Spatial Attention Detection

被引:7
|
作者
Cai, Siqi [1 ]
Schultz, Tanja [2 ]
Li, Haizhou [1 ,3 ,4 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore, Singapore
[2] Univ Bremen, Cognit Syst Lab, Bremen, Germany
[3] Chinese Univ Hong Kong, Shenzhen Res Inst Big Data, Sch Data Sci, Shenzhen 518172, Peoples R China
[4] Univ Bremen, Machine Listening Lab, D-28359 Bremen, Germany
关键词
Auditory spatial attention; brain-computer interface; channel-wise attention; electroencephalography; graph convolutional network; SELECTIVE ATTENTION; CORTICAL TRACKING; ATTENDED SPEECH; OSCILLATIONS; MODULATION; DYNAMICS; NETWORK;
D O I
10.1109/TBME.2023.3294242
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective: Despite recent advances, the decoding of auditory attention from brain signals remains a challenge. A key solution is the extraction of discriminative features from high-dimensional data, such as multi-channel electroencephalography (EEG). However, to our knowledge, topological relationships between individual channels have not yet been considered in any study. In this work, we introduced a novel architecture that exploits the topology of the human brain to perform auditory spatial attention detection (ASAD) from EEG signals. Methods: We propose EEG-Graph Net, an EEG-graph convolutional network, which employs a neural attention mechanism. This mechanism models the topology of the human brain in terms of the spatial pattern of EEG signals as a graph. In the EEG-Graph, each EEG channel is represented by a node, while the relationship between two EEG channels is represented by an edge between the respective nodes. The convolutional network takes the multi-channel EEG signals as a time series of EEG-graphs and learns the node and edge weights from the contribution of the EEG signals to the ASAD task. The proposed architecture supports the interpretation of the experimental results by data visualization. Results: We conducted experiments on two publicly available databases. The experimental results showed that EEG-Graph Net significantly outperforms the state-of-the-art methods in terms of decoding performance. In addition, the analysis of the learned weight patterns provides insights into the processing of continuous speech in the brain and confirms findings from neuroscientific studies. Conclusion: We showed that modeling brain topology with EEG-graphs yields highly competitive results for auditory spatial attention detection. Significance: The proposed EEG-Graph Net is more lightweight and accurate than competing baselines and provides explanations for the results. Also, the architecture can be easily transferred to other brain-computer interface (BCI) tasks.
引用
收藏
页码:171 / 182
页数:12
相关论文
共 50 条
  • [41] Impoverished auditory cues limit engagement of brain networks controlling spatial selective attention
    Deng, Yuqi
    Choi, Inyong
    Shinn-Cunningham, Barbara
    Baumgartner, Robert
    NEUROIMAGE, 2019, 202
  • [42] Modeling spatial auditory attention in ACT-R: a constraint-based approach
    Scheuernaan, Jaelle
    Venable, K. Brent
    Anderson, Maxwell T.
    Golob, Edward J.
    POSTPROCEEDINGS OF THE 9TH ANNUAL INTERNATIONAL CONFERENCE ON BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES (BICA 2018), 2018, 145 : 797 - 804
  • [43] Brain Signal Detection Methodology for Attention Training using minimal EEG channels
    Yaomanee, Kridsakon
    Pan-ngum, Setha
    Ayuthaya, Pasin Israsena Na
    2012 TENTH INTERNATIONAL CONFERENCE ON ICT AND KNOWLEDGE ENGINEERING, 2012, : 84 - 89
  • [44] What are we really decoding? Unveiling biases in EEG-based decoding of the spatial focus of auditory attention
    Rotaru, Iustina
    Geirnaert, Simon
    Heintz, Nicolas
    van de Ryck, Iris
    Bertrand, Alexander
    Francart, Tom
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (01)
  • [45] Analysis of Miniaturization Effects and Channel Selection Strategies for EEG Sensor Networks With Application to Auditory Attention Detection
    Narayanan, Abhijith Mundanad
    Bertrand, Alexander
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (01) : 234 - 244
  • [46] Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention
    Mahjoory, Keyvan
    Bahmer, Andreas
    Henry, Molly J.
    PLOS COMPUTATIONAL BIOLOGY, 2024, 20 (08)
  • [47] Effects of perceptual context on event-related brain potentials during auditory spatial attention
    Arnott, SR
    Alain, C
    PSYCHOPHYSIOLOGY, 2002, 39 (05) : 625 - 632
  • [48] Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario
    Biesmans, Wouter
    Das, Neetha
    Francart, Tom
    Bertrand, Alexander
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (05) : 402 - 412
  • [49] DECODING MUSIC ATTENTION FROM "EEG HEADPHONES": A USER-FRIENDLY AUDITORY BRAIN-COMPUTER INTERFACE
    An, Winko W.
    Shinn-Cunningham, Barbara
    Gamper, Hannes
    Emmanouilidou, Dimitra
    Johnston, David
    Jalobeanu, Mihai
    Cutrell, Edward
    Wilson, Andrew
    Chiang, Kuan-Jung
    Tashev, Ivan
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 985 - 989
  • [50] EEG-BASED FAST AUDITORY ATTENTION DETECTION IN REAL-LIFE SCENARIOS USING TIME-FREQUENCY ATTENTION MECHANISM
    Xie, Zhuang
    Wei, Jianguo
    Lu, Wenhuan
    Li, ZhongJie
    Wang, Chunli
    Zhang, Gaoyan
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 1741 - 1745