Study of emotion recognition based on fusion multi-modal bio-signal with SAE and LSTM recurrent neural network

被引：0
|
作者：
Li Y.-J. [1 ,2 ,3 ]
Huang J.-J. [1 ,2 ,3 ]
Wang H.-Y. [1 ,2 ,3 ]
Zhong N. [1 ,2 ,3 ,4 ]
机构：
[1] Institute of International WIC, Beijing University of Technology, Beijing
[2] Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing
[3] Beijing International Collaboration Base on Brain Informatics Wisdom and Services, Beijing
[4] Beijing Advanced Innovation Center for Future Internet Technology, Beijing
来源：
Tongxin Xuebao/Journal on Communications | 2017年 / 38卷 / 12期
基金：
中国国家自然科学基金; 对外科技合作项目（国际科技项目）;
关键词：
LSTM recurrent neural network; Multi-modal bio-signal emotion recognition; Multi-modal bio-signals fusion; Stacked auto-encoder neural network;
D O I：
10.11959/j.issn.1000-436x.2017294
中图分类号：
学科分类号：
摘要：
In order to achieve more accurate emotion recognition accuracy from multi-modal bio-signal features, a novel method to extract and fuse the signal with the stacked auto-encoder and LSTM recurrent neural networks was proposed. The stacked auto-encoder neural network was used to compress and fuse the features. The deep LSTM recurrent neural network was employed to classify the emotion states. The results present that the fused multi-modal features provide more useful information than single-modal features. The deep LSTM recurrent neural network achieves more accurate emotion classification results than other method. The highest accuracy rate is 0.792 6 © 2017, Editorial Board of Journal on Communications. All right reserved.
引用
收藏
页码：109 / 120
页数：11
相关论文
共 26 条
  • [21] Agrafioti F., Hatzinakos D., Anderson A.K., ECG pattern analysis for emotion detection, IEEE Transactions on Affective Computing, 3, 1, pp. 102-115, (2012)
  • [22] Bailenson J.N., Pontikakis E.D., Mauss I.B., Et al., Real-time classification of evoked emotions using facial feature tracking and physiological responses, International Journal of Human-Computer Studies, 66, 5, pp. 303-317, (2008)
  • [23] Lisetti C.L., Nasoz F., Using noninvasive wearable computers to recognize human emotions from physiological signals, Eurasip Journal on Advances in Signal Processing, 2004, 11, pp. 1672-1687, (2004)
  • [24] Fleureau J., Guillotel P., Quan H.T., Physiological-based affect event detector for entertainment video applications, IEEE Transactions on Affective Computing, 3, 3, pp. 379-385, (2012)
  • [25] Chung S.Y., Yoon H.J., Affective classification using Bayesian classifier and supervised learning, International Conference on Control, Automation and Systems, pp. 1768-1771, (2012)
  • [26] Li X., Song D., Zhang P., Et al., Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network, IEEE International Conference on Bioinformatics and Biomedicine, pp. 352-359, (2017)
123