EEG-based affective computing in virtual reality with a balancing of the computational efficiency and recognition accuracy

被引:6
|
作者
Pei, Guanxiong [1 ]
Shang, Qian [2 ]
Hua, Shizhen [1 ]
Li, Taihao [1 ]
Jin, Jia [3 ,4 ]
机构
[1] Zhejiang Lab, Res Inst Artificial Intelligence, Res Ctr Multimodal Intelligence, 1818 Wenyixi Rd, Hangzhou 311132, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Management, Hangzhou, Peoples R China
[3] Shanghai Int Studies Univ, Sch Business & Management, Key Lab Brain Machine Intelligence Informat Behav, Minist Educ & Shanghai, 550 Dalian West Rd, Shanghai 200083, Peoples R China
[4] Guangdong Inst Intelligence Sci & Technol, Joint Lab Finance & Business Intelligence, Zhuhai, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; Affective computing; Emotional valence recognition; Machine learning; Virtual reality; EMOTION RECOGNITION; NEURAL-NETWORK; RANDOM FOREST; SELECTION; CLASSIFIER; AROUSAL; MUSIC; 2D; 3D;
D O I
10.1016/j.chb.2023.108085
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The field of VR-EEG affective computing is rapidly progressing. However, it faces challenges such as lacking a solid psychological theory foundation, limited classification accuracy, and high computational costs. This study established a standardized VR video library to elicit emotions. Participants viewed positive, negative, and neutral VR videos while EEG data was collected. Grounded in the Affective Style Theory, this research proposes an emotion valence recognition strategy in VR that balances computational efficiency and classification accuracy through multidimensional complementary feature extraction from EEG signals, feature selection or dimension-ality reduction coupled with classifiers, and optimal frequency band selection. The research findings indicate that multidimensional complementary feature extraction in frequency and spatial domains can enhance recognition performance. Notably, the theta frequency band features are pivotal in emotion valence recognition within VR environments. Strategies like PCA-RF and RBFNN outperform existing methods, achieving an average classifi-cation accuracy of up to 95.6% while maintaining computational efficiency. In terms of theoretical contributions, the study enhances our understanding of emotional perception consistency and variability under the Affective Style Theory, offering insights into individual emotional state recognition. In practical terms, it emphasizes efficiency-accuracy balance, making integrating VR-EEG affective computation technology into a broader range of applications feasible.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Ten challenges for EEG-based affective computing
    Xin Hu
    Jingjing Chen
    Fei Wang
    Dan Zhang
    Brain Science Advances, 2019, 5 (01) : 1 - 20
  • [2] EEG-based subject independent affective computing models
    Bozhkov, Lachezar
    Georgieva, Petia
    Santos, Isabel
    Pereira, Ana
    Silva, Carlos
    INNS CONFERENCE ON BIG DATA 2015 PROGRAM, 2015, 53 : 375 - 382
  • [3] A Literature Review of EEG-Based Affective Computing in Marketing
    Pei, Guanxiong
    Li, Taihao
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [4] EEG-Based Emotion Recognition and Its Interface with Augmented Reality
    Amoolya, Gali
    Ashna, K. K.
    Swetha, Gadde Sai Venkata
    Das, Ganga
    Geeta, Jalada
    George, Sudhish N.
    APPLIED SOFT COMPUTING AND COMMUNICATION NETWORKS, 2021, 187 : 41 - 56
  • [5] Emotion Recognition in Immersive Virtual Reality: From Statistics to Affective Computing
    Marin-Morales, Javier
    Llinares, Carmen
    Guixeres, Jaime
    Alcaniz, Mariano
    SENSORS, 2020, 20 (18) : 1 - 26
  • [6] Unsupervised Learning in Reservoir Computing for EEG-Based Emotion Recognition
    Fourati, Rahma
    Ammar, Boudour
    Sanchez-Medina, Javier
    Alimi, Adel M.
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (02) : 972 - 984
  • [7] EEG-Based Emotion Recognition Datasets for Virtual Environments: A Survey
    Hamzah, Hussein Ali
    Abdalla, Kasim K.
    APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING, 2024, 2024
  • [8] Modeling the Affective Space of 360 Virtual Reality Videos Based on Arousal and Valence for Wearable EEG-Based VR Emotion Classification
    Suhaimi, Nazmi Sofian
    Yuan, Chrystalle Tan Bih
    Teo, Jason
    Mountstephens, James
    2018 IEEE 14TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2018), 2018, : 167 - 172
  • [9] EEG-based Spatial Navigation Estimation in a Virtual Reality Driving Environment
    Lin, Chin-Teng
    Yang, Fu-Shu
    Chiou, Te-Chung
    Ko, Li-Wei
    Duann, Jeng-Ren
    Gramann, Klaus
    2009 9TH IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING, 2009, : 435 - +
  • [10] Exploration of an EEG-Based Cognitively Adaptive Training System in Virtual Reality
    Dey, Arindam
    Chatburn, Alex
    Billinghurst, Mark
    2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 220 - 226