MSBiLSTM-Attention: EEG Emotion Recognition Model Based on Spatiotemporal Feature Fusion

被引:0
|
作者
Ma, Yahong [1 ]
Huang, Zhentao [1 ]
Yang, Yuyao [1 ]
Chen, Zuowen [1 ]
Dong, Qi [2 ]
Zhang, Shanwen [1 ]
Li, Yuan [3 ]
机构
[1] Xijing Univ, Sch Elect Informat, Xian Key Lab High Precis Ind Intelligent Vis Measu, Xian 710123, Peoples R China
[2] Zhengzhou Univ, Sch Math & Stat, Zhengzhou 710003, Peoples R China
[3] Aba Teachers Coll, Sch Phys & Elect Elect Engn, Wenchuan 623002, Peoples R China
基金
中国国家自然科学基金;
关键词
emotion recognition; multi-scale; convolutional neural network (CNN); bidirectional long short-term memory (Bi-LSTM); attention mechanism;
D O I
10.3390/biomimetics10030178
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Emotional states play a crucial role in shaping decision-making and social interactions, with sentiment analysis becoming an essential technology in human-computer emotional engagement, garnering increasing interest in artificial intelligence research. In EEG-based emotion analysis, the main challenges are feature extraction and classifier design, making the extraction of spatiotemporal information from EEG signals vital for effective emotion classification. Current methods largely depend on machine learning with manual feature extraction, while deep learning offers the advantage of automatic feature extraction and classification. Nonetheless, many deep learning approaches still necessitate manual preprocessing, which hampers accuracy and convenience. This paper introduces a novel deep learning technique that integrates multi-scale convolution and bidirectional long short-term memory networks with an attention mechanism for automatic EEG feature extraction and classification. By using raw EEG data, the method applies multi-scale convolutional neural networks and bidirectional long short-term memory networks to extract and merge features, selects key features via an attention mechanism, and classifies emotional EEG signals through a fully connected layer. The proposed model was evaluated on the SEED dataset for emotion classification. Experimental results demonstrate that this method effectively classifies EEG-based emotions, achieving classification accuracies of 99.44% for the three-class task and 99.85% for the four-class task in single validation, with average 10-fold-cross-validation accuracies of 99.49% and 99.70%, respectively. These findings suggest that the MSBiLSTM-Attention model is a powerful approach for emotion recognition.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] EEG and fNIRS emotion recognition based on modality attention graph convolution feature fusion
    Zhao Q.
    Zhang X.-Y.
    Chen G.-J.
    Zhang J.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (10): : 1987 - 1997
  • [2] Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion Recognition
    Zhao, Yimin
    Gu, Jin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 276 - 285
  • [3] EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution
    Zhu, Xiaoliang
    Liu, Chen
    Zhao, Liang
    Wang, Shengming
    SENSORS, 2024, 24 (11)
  • [4] EEG-based Emotion Recognition with Feature Fusion Networks
    Qiang Gao
    Yi Yang
    Qiaoju Kang
    Zekun Tian
    Yu Song
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 421 - 429
  • [5] EEG-based Emotion Recognition with Feature Fusion Networks
    Gao, Qiang
    Yang, Yi
    Kang, Qiaoju
    Tian, Zekun
    Song, Yu
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (02) : 421 - 429
  • [6] Emotion Recognition in EEG Based on Multilevel Multidomain Feature Fusion
    Li, Zhao Long
    Cao, Hui
    Zhang, Ji Sai
    IEEE ACCESS, 2024, 12 : 87237 - 87247
  • [7] A Semi-automatic Feature Fusion Model for EEG-based Emotion Recognition
    Zhang, Gaotian
    Li, Shiqian
    Wang, Jiabao
    Zhou, Yun
    Xu, Tao
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [8] EEG Emotion Recognition Model Based on Attention and GAN
    Qiao, Wenxuan
    Sun, Li
    Wu, Jinhui
    Wang, Pinshuo
    Li, Jiubo
    Zhao, Minjie
    IEEE ACCESS, 2024, 12 : 32308 - 32319
  • [9] Multiview Feature Fusion Attention Convolutional Recurrent Neural Networks for EEG-Based Emotion Recognition
    Xin, Ruihao
    Miao, Fengbo
    Cong, Ping
    Zhang, Fan
    Xin, Yongxian
    Feng, Xin
    JOURNAL OF SENSORS, 2023, 2023
  • [10] EEG emotion recognition based on the TimesNet fusion model
    Han, Luyao
    Zhang, Xiangliang
    Yin, Jibin
    APPLIED SOFT COMPUTING, 2024, 159