EEG-based affective computing in virtual reality with a balancing of the computational efficiency and recognition accuracy

被引:6
|
作者
Pei, Guanxiong [1 ]
Shang, Qian [2 ]
Hua, Shizhen [1 ]
Li, Taihao [1 ]
Jin, Jia [3 ,4 ]
机构
[1] Zhejiang Lab, Res Inst Artificial Intelligence, Res Ctr Multimodal Intelligence, 1818 Wenyixi Rd, Hangzhou 311132, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Management, Hangzhou, Peoples R China
[3] Shanghai Int Studies Univ, Sch Business & Management, Key Lab Brain Machine Intelligence Informat Behav, Minist Educ & Shanghai, 550 Dalian West Rd, Shanghai 200083, Peoples R China
[4] Guangdong Inst Intelligence Sci & Technol, Joint Lab Finance & Business Intelligence, Zhuhai, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; Affective computing; Emotional valence recognition; Machine learning; Virtual reality; EMOTION RECOGNITION; NEURAL-NETWORK; RANDOM FOREST; SELECTION; CLASSIFIER; AROUSAL; MUSIC; 2D; 3D;
D O I
10.1016/j.chb.2023.108085
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The field of VR-EEG affective computing is rapidly progressing. However, it faces challenges such as lacking a solid psychological theory foundation, limited classification accuracy, and high computational costs. This study established a standardized VR video library to elicit emotions. Participants viewed positive, negative, and neutral VR videos while EEG data was collected. Grounded in the Affective Style Theory, this research proposes an emotion valence recognition strategy in VR that balances computational efficiency and classification accuracy through multidimensional complementary feature extraction from EEG signals, feature selection or dimension-ality reduction coupled with classifiers, and optimal frequency band selection. The research findings indicate that multidimensional complementary feature extraction in frequency and spatial domains can enhance recognition performance. Notably, the theta frequency band features are pivotal in emotion valence recognition within VR environments. Strategies like PCA-RF and RBFNN outperform existing methods, achieving an average classifi-cation accuracy of up to 95.6% while maintaining computational efficiency. In terms of theoretical contributions, the study enhances our understanding of emotional perception consistency and variability under the Affective Style Theory, offering insights into individual emotional state recognition. In practical terms, it emphasizes efficiency-accuracy balance, making integrating VR-EEG affective computation technology into a broader range of applications feasible.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] EEG-based workload estimation across affective contexts
    Muehl, Christian
    Jeunet, Camille
    Lotte, Fabien
    FRONTIERS IN NEUROSCIENCE, 2014, 8
  • [22] Affective EEG-Based Person Identification With Continual Learning
    Jin, Jiarui
    Chen, Zongnan
    Cai, Honghua
    Pan, Jiahui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 16
  • [23] Attention Recognition in EEG-Based Affective Learning Research Using CFS plus KNN Algorithm
    Hu, Bin
    Li, Xiaowei
    Sun, Shuting
    Ratcliffe, Martyn
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2018, 15 (01) : 38 - 45
  • [24] Recognition of Affective Haptic stimuli Conveyed by different Fabrics using EEG-based Sparse SVM
    Greco, Alberto
    Nardelli, Mimma
    Bianchi, Matteo
    Valenza, Gaetano
    Scilingo, Enzo Pasquale
    2017 IEEE 3RD INTERNATIONAL FORUM ON RESEARCH AND TECHNOLOGIES FOR SOCIETY AND INDUSTRY (RTSI), 2017, : 482 - 486
  • [25] Estimation of Affective States in Virtual Reality Environments using EEG
    Kumar, Meghan
    Delaney, Connor
    Krusienski, Dean J.
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2022, 2022, : 396 - 401
  • [26] EEG-Based assessment of driver cognitive responses in a dynamic virtual-reality driving environment
    Lin, Chin-Teng
    Chung, I-Fang
    Ko, Li-Wei
    Chen, Yu-Chieh
    Liang, Sheng-Fu
    Duann, Jeng-Ren
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2007, 54 (07) : 1349 - 1352
  • [27] Characterization of Affective States in Virtual Reality Environments using EEG
    Kumar, Meghan
    Delaney, Connor
    Soroush, Pedram Zanganeh
    Yamani, Yusuke
    Krusienski, Dean J.
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2689 - 2693
  • [28] EEG-based asynchronous BCI control of a car in 3D virtual reality environments
    Zhao QiBin
    Zhang LiQing
    Cichocki, Andrzej
    CHINESE SCIENCE BULLETIN, 2009, 54 (01): : 78 - 87
  • [29] EEG-based asynchronous BCI control of a car in 3D virtual reality environments
    CICHOCKI Andrzej
    Science Bulletin, 2009, (01) : 78 - 87
  • [30] EEG-Based Brain-Computer Interactions in Immersive Virtual and Augmented Reality: A Systematic Review
    Nwagu C.
    Alslaity A.
    Orji R.
    Proceedings of the ACM on Human-Computer Interaction, 2023, 7 (EICS)