Subject-independent auditory spatial attention detection based on brain topology modeling and feature distribution alignment

被引:0
|
作者
Niu, Yixiang [1 ]
Chen, Ning [1 ]
Zhu, Hongqing [1 ]
Li, Guangqiang [1 ]
Chen, Yibo [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
Auditory spatial attention detection; Electroencephalogram; Domain generalization; Brain functional connectivity; Graph neural network; COCKTAIL PARTY; SPEECH;
D O I
10.1016/j.heares.2024.109104
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Auditory spatial attention detection (ASAD) seeks to determine which speaker in a surround sound field a listener is focusing on based on the one's brain biosignals. Although existing studies have achieved ASAD from a single- trial electroencephalogram (EEG), the huge inter-subject variability makes them generally perform poorly in cross-subject scenarios. Besides, most ASAD methods do not take full advantage of topological relationships between EEG channels, which are crucial for high-quality ASAD. Recently, some advanced studies have introduced graph-based brain topology modeling into ASAD, but how to calculate edge weights in a graph to better capture actual brain connectivity is worthy of further investigation. To address these issues, we propose a new ASAD method in this paper. First, we model a multi-channel EEG segment as a graph, where differential entropy serves as the node feature, and a static adjacency matrix is generated based on inter-channel mutual information to quantify brain functional connectivity. Then, different subjects' EEG graphs are encoded into a shared embedding space through a total variation graph neural network. Meanwhile, feature distribution alignment based on multi-kernel maximum mean discrepancy is adopted to learn subject-invariant patterns. Note that we align EEG embeddings of different subjects to reference distributions rather than align them to each other for the purpose of privacy preservation. A series of experiments on open datasets demonstrate that the proposed model outperforms state-of-the-art ASAD models in cross-subject scenarios with relatively low computational complexity, and feature distribution alignment improves the generalizability of the proposed model to a new subject.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Modeling spatial auditory attention in ACT-R: a constraint-based approach
    Scheuernaan, Jaelle
    Venable, K. Brent
    Anderson, Maxwell T.
    Golob, Edward J.
    POSTPROCEEDINGS OF THE 9TH ANNUAL INTERNATIONAL CONFERENCE ON BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES (BICA 2018), 2018, 145 : 797 - 804
  • [42] Low-Latency Auditory Spatial Attention Detection Based on Spectro-Spatial Features from EEG
    Cai, Siqi
    Sun, Pengcheng
    Schultz, Tanja
    Li, Haizhou
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 5812 - 5815
  • [43] Object detection in natural scenes: Independent effects of spatial and category-based attention
    Timo Stein
    Marius V. Peelen
    Attention, Perception, & Psychophysics, 2017, 79 : 738 - 752
  • [44] Object detection in natural scenes: Independent effects of spatial and category-based attention
    Stein, Timo
    Peelen, Marius V.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2017, 79 (03) : 738 - 752
  • [45] Multilevel Feature Alignment Based on Spatial Attention Deformable Convolution for Cross-Scene Hyperspectral Image Classification
    Zhu, Wenxiang
    Zhao, Chunhui
    Feng, Shou
    Qin, Boao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [46] MT-FANet: A Morphology and Topology-Based Feature Alignment Network for SAR Ship Rotation Detection
    Liu, Qianqian
    Li, Dong
    Jiang, Renjie
    Liu, Shuang
    Liu, Hongqing
    Li, Suqi
    REMOTE SENSING, 2023, 15 (12)
  • [47] A novel convolutional neural network method for subject-independent driver drowsiness detection based on single-channel data and EEG alpha spindles
    Houshmand, Sara
    Kazemi, Reza
    Salmanzadeh, Hamed
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART H-JOURNAL OF ENGINEERING IN MEDICINE, 2021, 235 (09) : 1069 - 1078
  • [48] Learning Invariant Patterns Based on a Convolutional Neural Network and Big Electroencephalography Data for Subject-Independent P300 Brain-Computer Interfaces
    Gao, Wei
    Yu, Tianyou
    Yu, Jin-Gang
    Gu, Zhenghui
    Li, Kendi
    Huang, Yong
    Yu, Zhu Liang
    Li, Yuanqing
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1047 - 1057
  • [49] A Pyramidal Spatial-Based Feature Attention Network for Schizophrenia Detection Using Electroencephalography Signals
    Karnati, Mohan
    Sahu, Geet
    Gupta, Abhishek
    Seal, Ayan
    Krejcar, Ondrej
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (03) : 935 - 946
  • [50] DGSD: Dynamical graph self-distillation for EEG-based auditory spatial attention detection
    Fan, Cunhang
    Zhang, Hongyu
    Huang, Wei
    Xue, Jun
    Tao, Jianhua
    Yi, Jiangyan
    Lv, Zhao
    Wu, Xiaopei
    NEURAL NETWORKS, 2024, 179