EmoWear: Wearable Physiological and Motion Dataset for Emotion Recognition and Context Awareness

被引:0
|
作者
Rahmani, Mohammad Hasan [1 ]
Symons, Michelle [2 ]
Sobhani, Omid [1 ]
Berkvens, Rafael [1 ]
Weyn, Maarten [1 ]
机构
[1] Univ Antwerp, IMEC, IDLab, Fac Appl Engn, Sint Pietersvliet 7, B-2000 Antwerp, Belgium
[2] Univ Antwerp, Fac Social Sci, Dept Commun Studies, Antwerp, Belgium
关键词
DATABASE;
D O I
10.1038/s41597-024-03429-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The EmoWear dataset provides a bridge to explore Emotion Recognition (ER) via Seismocardiography (SCG), the measurement of small cardio-respiratory induced vibrations on the chest wall through Inertial Measurement Units (IMUs). We recorded Accelerometer (ACC), Gyroscope (GYRO), Electrocardiography (ECG), Blood Volume Pulse (BVP), Respiration (RSP), Electrodermal Activity (EDA), and Skin Temperature (SKT) data from 49 participants who watched validated emotionally stimulating video clips. They self-assessed their emotional valence, arousal, and dominance, as well as extra questions about the video clips. Also, we asked the participants to walk, talk, and drink, so that researchers can detect gait, voice, and swallowing using the same IMU. We demonstrate the effectiveness of emotion stimulation with statistical methods and verify the quality of the collected signals through signal-to-noise ratio and correlation analysis. EmoWear can be used for ER via SCG, ER during gait, multi-modal ER, and the study of IMUs for context-awareness. Targeted contextual information include emotions, gait, voice activity, and drinking, all having the potential to be sensed via a single IMU.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] PhyMER: Physiological Dataset for Multimodal Emotion Recognition With Personality as a Context
    Pant, Sudarshan
    Yang, Hyung-Jeong
    Lim, Eunchae
    Kim, Soo-Hyung
    Yoo, Seok-Bong
    IEEE ACCESS, 2023, 11 : 107638 - 107656
  • [2] Emotion Recognition for Multiple Context Awareness
    Yang, Dingkang
    Huang, Shuai
    Wang, Shunli
    Liu, Yang
    Zhai, Peng
    Su, Liuzhen
    Li, Mingcheng
    Zhang, Lihua
    COMPUTER VISION, ECCV 2022, PT XXXVII, 2022, 13697 : 144 - 162
  • [3] Context Based Emotion Recognition Using EMOTIC Dataset
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (11) : 2755 - 2766
  • [4] Visualization of Physiological Response in the Context of Emotion Recognition
    Fodor, Kristian
    Balogh, Zoltan
    Francisti, Jan
    PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2022, 2022, 13566 : 387 - 398
  • [5] An Emotion Recognition System Based on Physiological Signals Obtained by Wearable Sensors
    He, Cheng
    Yao, Yun-jin
    Ye, Xue-song
    WEARABLE SENSORS AND ROBOTS, 2017, 399 : 15 - 25
  • [6] An Action Recognition Approach with Context and Multiscale Motion Awareness
    Cardoso, Danilo Barros
    Campos, Luiza C. B.
    Nascimento, Erickson R.
    2022 35TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2022), 2022, : 73 - 78
  • [7] Emotion Recognition Using Physiological Signals: Laboratory vs. Wearable Sensors
    Ragot, Martin
    Martin, Nicolas
    Em, Sonia
    Pallamin, Nico
    Diverrez, Jean-Marc
    ADVANCES IN HUMAN FACTORS IN WEARABLE TECHNOLOGIES AND GAME DESIGN (AHFE 2017), 2018, 608 : 15 - 22
  • [8] Intelligent Wearable System With Motion and Emotion Recognition Based on Digital Twin Technology
    Yu, Feng
    Yu, Chenyu
    Tian, Zhangyuan
    Liu, Xiaoxiao
    Cao, Jiacheng
    Liu, Li
    Du, Chenghu
    Jiang, Minghua
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (15): : 26314 - 26328
  • [9] Physiological-Based Emotion Detection and Recognition in a Video Game Context
    Yang, Wenlu
    Rifqi, Maria
    Marsala, Christophe
    Pinna, Andrea
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 194 - 201
  • [10] Using Context and Physiological Cues to Improve Emotion Recognition in Virtual Reality
    Gupta, Kunal
    2021 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT PROCEEDINGS (ISMAR-ADJUNCT 2021), 2021, : 453 - 456