Multi-view brain functional connectivity and hierarchical fusion for EEG-based emotion recognition

被引:0
|
作者
Fu, Baole [1 ,4 ]
Yu, Xiangkun [2 ,4 ]
Wu, Feng [1 ,4 ]
Liu, Yinhua [1 ,2 ,3 ,4 ]
机构
[1] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
[2] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[3] Shandong Key Lab Ind Control Technol, Qingdao 266071, Peoples R China
[4] Qingdao Univ, Inst Future, Qingdao 266071, Peoples R China
关键词
Emotion recognition; Multi-view; Brain functional connectivity; Cross-attention; Feature fusion; Electroencephalogram;
D O I
10.1016/j.measurement.2024.116046
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Emotional states evolve gradually from their onset to full manifestation, reflected in changes in brain functional connectivity. Existing research often focuses only on the final emotional state, missing the rich, dynamic information of emotional evolution. This paper proposes a novel network framework leveraging global and local brain functional connectivity through a multi-view approach. We introduce a global and local connectivity modeling method using electroencephalogram signals to simulate brain connectivity changes across time and specific moments. A residual-based local detail feature extractor combined with a coordinate attention module captures long-range dependencies and maintains positional accuracy. A global feature extractor is also designed for the effective extraction of emotional information. Finally, a hierarchical multi-scale cross-attention feature fusion module integrates features across different levels to enhance emotion recognition performance and robustness. Extensive experiments on three publicly available datasets demonstrate the framework's superiority and generalization capability.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Identifying Functional Brain Connectivity Patterns for EEG-Based Emotion Recognition
    Wu, Xun
    Zheng, Wei-Long
    Lu, Bao-Liang
    2019 9TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2019, : 235 - 238
  • [2] Multi-view domain-adaptive representation learning for EEG-based emotion recognition
    Li, Chao
    Bian, Ning
    Zhao, Ziping
    Wang, Haishuai
    Schuller, Bjoern W.
    INFORMATION FUSION, 2024, 104
  • [3] Investigating EEG-based functional connectivity patterns for multimodal emotion recognition
    Wu, Xun
    Zheng, Wei-Long
    Li, Ziyi
    Lu, Bao-Liang
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (01)
  • [4] DECISION FUSION FOR EEG-BASED EMOTION RECOGNITION
    Wang, Shuai
    Du, Jiachen
    Xu, Ruifeng
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 883 - 889
  • [5] EEG-based Emotion Recognition with Feature Fusion Networks
    Gao, Qiang
    Yang, Yi
    Kang, Qiaoju
    Tian, Zekun
    Song, Yu
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (02) : 421 - 429
  • [6] EEG-based Emotion Recognition with Feature Fusion Networks
    Qiang Gao
    Yi Yang
    Qiaoju Kang
    Zekun Tian
    Yu Song
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 421 - 429
  • [7] Adaptive construction of critical brain functional networks for EEG-based emotion recognition
    Zhao, Ying
    He, Hong
    Bi, Xiaoying
    Lu, Yue
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (06)
  • [8] Developing an EEG-Based Emotion Recognition Using Ensemble Deep Learning Methods and Fusion of Brain Effective Connectivity Maps
    Bagherzadeh, Sara
    Shalbaf, Ahmad
    Shoeibi, Afshin
    Jafari, Mahboobeh
    Tan, Ru-San
    Acharya, U. Rajendra
    IEEE ACCESS, 2024, 12 : 50949 - 50965
  • [9] Multi-View Hierarchical Attention Graph Convolutional Network with Domain Adaptation for EEG Emotion Recognition
    Li, Chao
    Wang, Feng
    Bian, Ning
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CRYPTOGRAPHY, NETWORK SECURITY AND COMMUNICATION TECHNOLOGY, CNSCT 2024, 2024, : 624 - 630
  • [10] Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
    Jinpeng Li
    Zhaoxiang Zhang
    Huiguang He
    Cognitive Computation, 2018, 10 : 368 - 380