EEG-based affective computing in virtual reality with a balancing of the computational efficiency and recognition accuracy

被引:6
|
作者
Pei, Guanxiong [1 ]
Shang, Qian [2 ]
Hua, Shizhen [1 ]
Li, Taihao [1 ]
Jin, Jia [3 ,4 ]
机构
[1] Zhejiang Lab, Res Inst Artificial Intelligence, Res Ctr Multimodal Intelligence, 1818 Wenyixi Rd, Hangzhou 311132, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Management, Hangzhou, Peoples R China
[3] Shanghai Int Studies Univ, Sch Business & Management, Key Lab Brain Machine Intelligence Informat Behav, Minist Educ & Shanghai, 550 Dalian West Rd, Shanghai 200083, Peoples R China
[4] Guangdong Inst Intelligence Sci & Technol, Joint Lab Finance & Business Intelligence, Zhuhai, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; Affective computing; Emotional valence recognition; Machine learning; Virtual reality; EMOTION RECOGNITION; NEURAL-NETWORK; RANDOM FOREST; SELECTION; CLASSIFIER; AROUSAL; MUSIC; 2D; 3D;
D O I
10.1016/j.chb.2023.108085
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The field of VR-EEG affective computing is rapidly progressing. However, it faces challenges such as lacking a solid psychological theory foundation, limited classification accuracy, and high computational costs. This study established a standardized VR video library to elicit emotions. Participants viewed positive, negative, and neutral VR videos while EEG data was collected. Grounded in the Affective Style Theory, this research proposes an emotion valence recognition strategy in VR that balances computational efficiency and classification accuracy through multidimensional complementary feature extraction from EEG signals, feature selection or dimension-ality reduction coupled with classifiers, and optimal frequency band selection. The research findings indicate that multidimensional complementary feature extraction in frequency and spatial domains can enhance recognition performance. Notably, the theta frequency band features are pivotal in emotion valence recognition within VR environments. Strategies like PCA-RF and RBFNN outperform existing methods, achieving an average classifi-cation accuracy of up to 95.6% while maintaining computational efficiency. In terms of theoretical contributions, the study enhances our understanding of emotional perception consistency and variability under the Affective Style Theory, offering insights into individual emotional state recognition. In practical terms, it emphasizes efficiency-accuracy balance, making integrating VR-EEG affective computation technology into a broader range of applications feasible.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] EEG-based Person Recognition: Analysis and criticism
    Boubakeur, Meriem Romaissa
    Wang, Guoyin
    Zhang, Chenglin
    Liu, Ke
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (IEEE ICBK 2017), 2017, : 155 - 160
  • [32] EEG-Based communication: A pattern recognition approach
    Penny, WD
    Roberts, SJ
    Curran, EA
    Stokes, MJ
    IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (02): : 214 - 215
  • [33] EEG-based Emotion Recognition of Quran Listeners
    Fattouh, Anas
    Albidewi, Ibrahim
    Baterfi, Bader
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 1338 - 1342
  • [34] EEG-BASED BIOMETRIC RECOGNITION USING EIGENBRAINS
    Maiorana, Emanuele
    La Rocca, Daria
    Campisi, Patrizio
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2015,
  • [35] EEG-Based Emotion Recognition in Music Listening
    Lin, Yuan-Pin
    Wang, Chi-Hong
    Jung, Tzyy-Ping
    Wu, Tien-Lin
    Jeng, Shyh-Kang
    Duann, Jeng-Ren
    Chen, Jyh-Horng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (07) : 1798 - 1806
  • [36] A hybrid model for EEG-based gender recognition
    Wang, Ping
    Hu, Jianfeng
    COGNITIVE NEURODYNAMICS, 2019, 13 (06) : 541 - 554
  • [37] A hybrid model for EEG-based gender recognition
    Ping Wang
    Jianfeng Hu
    Cognitive Neurodynamics, 2019, 13 : 541 - 554
  • [38] Frequency Filter Networks for EEG-based recognition
    Yanagimoto, Miku
    Sugimoto, Chika
    Nagao, Tomoharu
    2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 270 - 275
  • [39] EEG-Based BCI Emotion Recognition: A Survey
    Torres, Edgar P.
    Torres, Edgar A.
    Hernandez-Alvarez, Myriam
    Yoo, Sang Guun
    SENSORS, 2020, 20 (18) : 1 - 36
  • [40] DECISION FUSION FOR EEG-BASED EMOTION RECOGNITION
    Wang, Shuai
    Du, Jiachen
    Xu, Ruifeng
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 883 - 889