Multi-view brain functional connectivity and hierarchical fusion for EEG-based emotion recognition

被引:0
|
作者
Fu, Baole [1 ,4 ]
Yu, Xiangkun [2 ,4 ]
Wu, Feng [1 ,4 ]
Liu, Yinhua [1 ,2 ,3 ,4 ]
机构
[1] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
[2] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[3] Shandong Key Lab Ind Control Technol, Qingdao 266071, Peoples R China
[4] Qingdao Univ, Inst Future, Qingdao 266071, Peoples R China
关键词
Emotion recognition; Multi-view; Brain functional connectivity; Cross-attention; Feature fusion; Electroencephalogram;
D O I
10.1016/j.measurement.2024.116046
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Emotional states evolve gradually from their onset to full manifestation, reflected in changes in brain functional connectivity. Existing research often focuses only on the final emotional state, missing the rich, dynamic information of emotional evolution. This paper proposes a novel network framework leveraging global and local brain functional connectivity through a multi-view approach. We introduce a global and local connectivity modeling method using electroencephalogram signals to simulate brain connectivity changes across time and specific moments. A residual-based local detail feature extractor combined with a coordinate attention module captures long-range dependencies and maintains positional accuracy. A global feature extractor is also designed for the effective extraction of emotional information. Finally, a hierarchical multi-scale cross-attention feature fusion module integrates features across different levels to enhance emotion recognition performance and robustness. Extensive experiments on three publicly available datasets demonstrate the framework's superiority and generalization capability.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] HIERARCHICAL ATTENTION-BASED TEMPORAL CONVOLUTIONAL NETWORKS FOR EEG-BASED EMOTION RECOGNITION
    Li, Chao
    Chen, Boyang
    Zhao, Ziping
    Cummins, Nicholas
    Schuller, Bjorn W.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1240 - 1244
  • [32] Brain Rhythm Sequencing and Its Application for EEG-based Emotion Recognition
    Li, Jia Wen
    Barma, Shovan
    Pun, Sio Hang
    Vai, Mang, I
    Wan, Feng
    Liu, Wai Sun
    Mak, Peng Un
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (IEEE CIVEMSA 2021), 2021,
  • [33] EEG-based emotion recognition by analyzing multi-frequency bands
    Zhang, Jiarui
    Wang, Gang
    Wang, Siyuan
    2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836
  • [34] Enhancing local representation learning through global–local integration with functional connectivity for EEG-based emotion recognition
    Fu B.
    Yu X.
    Jiang G.
    Sun N.
    Liu Y.
    Computers in Biology and Medicine, 2024, 179
  • [35] CONVOLUTIONAL NEURAL NETWORK APPROACH FOR EEG-BASED EMOTION RECOGNITION USING BRAIN CONNECTIVITY AND ITS SPATIAL INFORMATION
    Moon, Seong-Eun
    Jang, Soobeom
    Lee, Jong-Seok
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2556 - 2560
  • [36] Fusion of EEG-Based Activation, Spatial, and Connection Patterns for Fear Emotion Recognition
    Pan, Jiahui
    Yang, Fuzhou
    Qiu, Lina
    Huang, Haiyun
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [37] A Semi-automatic Feature Fusion Model for EEG-based Emotion Recognition
    Zhang, Gaotian
    Li, Shiqian
    Wang, Jiabao
    Zhou, Yun
    Xu, Tao
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [38] EEG-based Emotion Recognition of Quran Listeners
    Fattouh, Anas
    Albidewi, Ibrahim
    Baterfi, Bader
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 1338 - 1342
  • [39] EEG-Based Emotion Recognition in Music Listening
    Lin, Yuan-Pin
    Wang, Chi-Hong
    Jung, Tzyy-Ping
    Wu, Tien-Lin
    Jeng, Shyh-Kang
    Duann, Jeng-Ren
    Chen, Jyh-Horng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (07) : 1798 - 1806
  • [40] EEG-Based BCI Emotion Recognition: A Survey
    Torres, Edgar P.
    Torres, Edgar A.
    Hernandez-Alvarez, Myriam
    Yoo, Sang Guun
    SENSORS, 2020, 20 (18) : 1 - 36