EEG-based affective computing in virtual reality with a balancing of the computational efficiency and recognition accuracy

被引:6
|
作者
Pei, Guanxiong [1 ]
Shang, Qian [2 ]
Hua, Shizhen [1 ]
Li, Taihao [1 ]
Jin, Jia [3 ,4 ]
机构
[1] Zhejiang Lab, Res Inst Artificial Intelligence, Res Ctr Multimodal Intelligence, 1818 Wenyixi Rd, Hangzhou 311132, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Management, Hangzhou, Peoples R China
[3] Shanghai Int Studies Univ, Sch Business & Management, Key Lab Brain Machine Intelligence Informat Behav, Minist Educ & Shanghai, 550 Dalian West Rd, Shanghai 200083, Peoples R China
[4] Guangdong Inst Intelligence Sci & Technol, Joint Lab Finance & Business Intelligence, Zhuhai, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; Affective computing; Emotional valence recognition; Machine learning; Virtual reality; EMOTION RECOGNITION; NEURAL-NETWORK; RANDOM FOREST; SELECTION; CLASSIFIER; AROUSAL; MUSIC; 2D; 3D;
D O I
10.1016/j.chb.2023.108085
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The field of VR-EEG affective computing is rapidly progressing. However, it faces challenges such as lacking a solid psychological theory foundation, limited classification accuracy, and high computational costs. This study established a standardized VR video library to elicit emotions. Participants viewed positive, negative, and neutral VR videos while EEG data was collected. Grounded in the Affective Style Theory, this research proposes an emotion valence recognition strategy in VR that balances computational efficiency and classification accuracy through multidimensional complementary feature extraction from EEG signals, feature selection or dimension-ality reduction coupled with classifiers, and optimal frequency band selection. The research findings indicate that multidimensional complementary feature extraction in frequency and spatial domains can enhance recognition performance. Notably, the theta frequency band features are pivotal in emotion valence recognition within VR environments. Strategies like PCA-RF and RBFNN outperform existing methods, achieving an average classifi-cation accuracy of up to 95.6% while maintaining computational efficiency. In terms of theoretical contributions, the study enhances our understanding of emotional perception consistency and variability under the Affective Style Theory, offering insights into individual emotional state recognition. In practical terms, it emphasizes efficiency-accuracy balance, making integrating VR-EEG affective computation technology into a broader range of applications feasible.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Deep learning for EEG-based biometric recognition
    Maiorana, Emanuele
    NEUROCOMPUTING, 2020, 410 : 374 - 386
  • [42] Familiarity effects in EEG-based emotion recognition
    Thammasan N.
    Moriyama K.
    Fukui K.-I.
    Numao M.
    Brain Informatics, 2017, 4 (1) : 39 - 50
  • [43] Efficient approach for EEG-based emotion recognition
    Senguer, D.
    Siuly, S.
    ELECTRONICS LETTERS, 2020, 56 (25) : 1361 - 1364
  • [44] Subject Adaptive EEG-Based Visual Recognition
    Lee, Pilhyeon
    Hwang, Sunhee
    Jeon, Seogkyu
    Byun, Hyeran
    PATTERN RECOGNITION, ACPR 2021, PT II, 2022, 13189 : 322 - 334
  • [45] Longitudinal Evaluation of EEG-Based Biometric Recognition
    Maiorana, Emanuele
    Campisi, Patrizio
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (05) : 1123 - 1138
  • [46] EEG-based Emotion Recognition in the Investment Activities
    Razi, Nurul Izzati Mat
    Othman, Marini
    Yaacob, Hamwira
    2016 6TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY FOR THE MUSLIM WORLD (ICT4M), 2016, : 325 - 329
  • [47] Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors
    Javier Marín-Morales
    Juan Luis Higuera-Trujillo
    Alberto Greco
    Jaime Guixeres
    Carmen Llinares
    Enzo Pasquale Scilingo
    Mariano Alcañiz
    Gaetano Valenza
    Scientific Reports, 8
  • [48] Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors
    Marin-Morales, Javier
    Luis Higuera-Trujillo, Juan
    Greco, Alberto
    Guixeres, Jaime
    Llinares, Carmen
    Scilingo, Enzo Pasquale
    Alcaniz, Mariano
    Valenza, Gaetano
    SCIENTIFIC REPORTS, 2018, 8
  • [49] EEG-based affective state recognition from human brain signals by using Hjorth-activity
    Mehmood, Raja Majid
    Bilal, Muhammad
    Vimal, S.
    Lee, Seong-Whan
    MEASUREMENT, 2022, 202
  • [50] Eye tracking for affective computing in virtual reality healthcare applications
    Harris, David
    Arthur, Tom
    Wilson, Mark
    Vine, Sam
    2023 11TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS, ACIIW, 2023,