EmoWear: Wearable Physiological and Motion Dataset for Emotion Recognition and Context Awareness

被引:0
|
作者
Rahmani, Mohammad Hasan [1 ]
Symons, Michelle [2 ]
Sobhani, Omid [1 ]
Berkvens, Rafael [1 ]
Weyn, Maarten [1 ]
机构
[1] Univ Antwerp, IMEC, IDLab, Fac Appl Engn, Sint Pietersvliet 7, B-2000 Antwerp, Belgium
[2] Univ Antwerp, Fac Social Sci, Dept Commun Studies, Antwerp, Belgium
关键词
DATABASE;
D O I
10.1038/s41597-024-03429-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The EmoWear dataset provides a bridge to explore Emotion Recognition (ER) via Seismocardiography (SCG), the measurement of small cardio-respiratory induced vibrations on the chest wall through Inertial Measurement Units (IMUs). We recorded Accelerometer (ACC), Gyroscope (GYRO), Electrocardiography (ECG), Blood Volume Pulse (BVP), Respiration (RSP), Electrodermal Activity (EDA), and Skin Temperature (SKT) data from 49 participants who watched validated emotionally stimulating video clips. They self-assessed their emotional valence, arousal, and dominance, as well as extra questions about the video clips. Also, we asked the participants to walk, talk, and drink, so that researchers can detect gait, voice, and swallowing using the same IMU. We demonstrate the effectiveness of emotion stimulation with statistical methods and verify the quality of the collected signals through signal-to-noise ratio and correlation analysis. EmoWear can be used for ER via SCG, ER during gait, multi-modal ER, and the study of IMUs for context-awareness. Targeted contextual information include emotions, gait, voice activity, and drinking, all having the potential to be sensed via a single IMU.
引用
收藏
页数:18
相关论文
共 50 条
  • [11] Emotion Ontology for Context Awareness
    Berthelon, Franck
    Sander, Peter
    2013 IEEE 4TH INTERNATIONAL CONFERENCE ON COGNITIVE INFOCOMMUNICATIONS (COGINFOCOM), 2013, : 59 - 64
  • [12] VREED: Virtual Reality Emotion Recognition Dataset Using Eye Tracking & Physiological Measures
    Tabbaa, Luma
    Searle, Ryan
    Bafti, Saber Mirzaee
    Hossain, Md Moinul
    Intarasisrisawat, Jittrapol
    Glancy, Maxine
    Ang, Chee Siang
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (04):
  • [13] Emotion Recognition in Context
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1960 - 1968
  • [14] Emotion Recognition on the Go: Utilizing Wearable IMUs for Personalized Emotion Recognition
    Leng, Zikang
    Jung, Myeongul
    Hwang, Sungjin
    Oh, Seungwoo
    Zhang, Lizhe
    Plotz, Thomas
    Kim, Kwanguk
    COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024, 2024, : 537 - 544
  • [15] A Multimodal Dataset for Mixed Emotion Recognition
    Yang, Pei
    Liu, Niqi
    Liu, Xinge
    Shu, Yezhi
    Ji, Wenqi
    Ren, Ziqi
    Sheng, Jenny
    Yu, Minjing
    Yi, Ran
    Zhang, Dan
    Liu, Yong-Jin
    SCIENTIFIC DATA, 2024, 11 (01)
  • [16] The PMEmo Dataset for Music Emotion Recognition
    Zhang, Kejun
    Zhang, Hui
    Li, Simeng
    Yang, Changyuan
    Sun, Lingyun
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 135 - 142
  • [17] The Indonesian Mixed Emotion Dataset (IMED): A Facial Expression Dataset for Mixed Emotion Recognition
    Liliana, Dewi Yanti
    Basaruddin, T.
    Oriza, Imelda Ika Dian
    AIVR 2018: 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY, 2018, : 52 - 56
  • [18] CorrNet: Fine-Grained Emotion Recognition for Video Watching Using Wearable Physiological Sensors
    Zhang, Tianyi
    El Ali, Abdallah
    Wang, Chen
    Hanjalic, Alan
    Cesar, Pablo
    SENSORS, 2021, 21 (01) : 1 - 25
  • [19] Emotion Recognition through Intentional Context - Towards Advancing In-game Affect Awareness -
    Ihasz, Peter L.
    Kovacs, Mate
    Kryssanov, Victor V.
    INTERNATIONAL JOURNAL OF AFFECTIVE ENGINEERING, 2019, 18 (01): : 17 - 25
  • [20] HANDY: A Benchmark Dataset for Context-Awareness via Wrist-Worn Motion Sensors
    Acici, Koray
    Erdas, Cagatay Berke
    Asuroglu, Tunc
    Ogul, Hasan
    DATA, 2018, 3 (03)