Multi-view brain functional connectivity and hierarchical fusion for EEG-based emotion recognition

被引:0
|
作者
Fu, Baole [1 ,4 ]
Yu, Xiangkun [2 ,4 ]
Wu, Feng [1 ,4 ]
Liu, Yinhua [1 ,2 ,3 ,4 ]
机构
[1] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
[2] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[3] Shandong Key Lab Ind Control Technol, Qingdao 266071, Peoples R China
[4] Qingdao Univ, Inst Future, Qingdao 266071, Peoples R China
关键词
Emotion recognition; Multi-view; Brain functional connectivity; Cross-attention; Feature fusion; Electroencephalogram;
D O I
10.1016/j.measurement.2024.116046
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Emotional states evolve gradually from their onset to full manifestation, reflected in changes in brain functional connectivity. Existing research often focuses only on the final emotional state, missing the rich, dynamic information of emotional evolution. This paper proposes a novel network framework leveraging global and local brain functional connectivity through a multi-view approach. We introduce a global and local connectivity modeling method using electroencephalogram signals to simulate brain connectivity changes across time and specific moments. A residual-based local detail feature extractor combined with a coordinate attention module captures long-range dependencies and maintains positional accuracy. A global feature extractor is also designed for the effective extraction of emotional information. Finally, a hierarchical multi-scale cross-attention feature fusion module integrates features across different levels to enhance emotion recognition performance and robustness. Extensive experiments on three publicly available datasets demonstrate the framework's superiority and generalization capability.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Familiarity effects in EEG-based emotion recognition
    Thammasan N.
    Moriyama K.
    Fukui K.-I.
    Numao M.
    Brain Informatics, 2017, 4 (1) : 39 - 50
  • [42] Efficient approach for EEG-based emotion recognition
    Senguer, D.
    Siuly, S.
    ELECTRONICS LETTERS, 2020, 56 (25) : 1361 - 1364
  • [43] EEG-based Emotion Recognition in the Investment Activities
    Razi, Nurul Izzati Mat
    Othman, Marini
    Yaacob, Hamwira
    2016 6TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY FOR THE MUSLIM WORLD (ICT4M), 2016, : 325 - 329
  • [44] Improved EEG-based emotion recognition through information enhancement in connectivity feature map
    Akhand, M. A. H.
    Maria, Mahfuza Akter
    Kamal, Md Abdus Samad
    Murase, Kazuyuki
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [45] Improved EEG-based emotion recognition through information enhancement in connectivity feature map
    M. A. H. Akhand
    Mahfuza Akter Maria
    Md Abdus Samad Kamal
    Kazuyuki Murase
    Scientific Reports, 13
  • [46] Emotion Recognition Based on Fusion of Local Cortial Activations and Dynamic Functional Networks Connectivity: An EEG Study
    Al-Shargie, Fares
    Tariq, Usman
    Alex, Meera
    Mir, Hasan
    Al-Nashash, Hasan
    IEEE ACCESS, 2019, 7 (143550-143562): : 143550 - 143562
  • [47] Deep Multi-View Feature Learning for EEG-Based Epileptic Seizure Detection
    Tian, Xiaobin
    Deng, Zhaohong
    Ying, Wenhao
    Choi, Kup-Sze
    Wu, Dongrui
    Qin, Bin
    Wang, Jun
    Shen, Hongbin
    Wang, Shitong
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (10) : 1962 - 1972
  • [48] Multimodal and Multi-view Models for Emotion Recognition
    Aguilar, Gustavo
    Rozgic, Viktor
    Wang, Weiran
    Wang, Chao
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 991 - 1002
  • [49] STAFNet: an adaptive multi-feature learning network via spatiotemporal fusion for EEG-based emotion recognition
    Hu, Fo
    He, Kailun
    Qian, Mengyuan
    Liu, Xiaofeng
    Qiao, Zukang
    Zhang, Lekai
    Xiong, Junlong
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [50] A Resource-Efficient Multi-Entropy Fusion Method and Its Application for EEG-Based Emotion Recognition
    Li, Jiawen
    Feng, Guanyuan
    Ling, Chen
    Ren, Ximing
    Liu, Xin
    Zhang, Shuang
    Wang, Leijun
    Chen, Yanmei
    Zeng, Xianxian
    Chen, Rongjun
    ENTROPY, 2025, 27 (01)