Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition

被引:1
|
作者
Yang, Yuhan [1 ]
Zhang, Yan [1 ]
Zhong, Zhinan [1 ]
Dai, Wan [1 ]
Chen, Yunfei [1 ]
Chen, Mo [2 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[2] Nanjing Tech Univ, Coll Art & Design, Nanjing, Peoples R China
关键词
Human machine interaction (HMI); automotive travel; feature selection; speech emotion recognition; machine learning; emotion regulation; FEATURES;
D O I
10.1109/ICCCR61138.2024.10585371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With driving emerging as a common mode of transportation, the automotive industry has increasingly prioritized driving safety and experience. A substantial body of research focused on driving safety and the overall travel experience has underscored the pivotal role of emotions. In this article, we introduce an innovative in-car emotion recognition and interaction system, carefully crafted to intelligently respond to the emotional states of drivers. This system captures real-time emotional data through its user input layer and seamlessly integrates it into the technological architecture layer, residing within the vehicle's CPU. Leveraging cutting-edge deep learning models for emotion recognition, the system's outcomes trigger tailored emotion regulation strategies within the interaction feedback layer. Notably, our study introduces a groundbreaking speech fusion feature, MFCCs+, meticulously crafted for driving contexts. Furthermore, we have optimized the driving speech emotion recognition model using 1D-CNN, resulting in a remarkable 10% improvement in recognition accuracy. Subsequent validation experiments affirm the system's effectiveness in enhancing driving safety. In conclusion, the integration of emotion-based interaction solutions holds immense potential for elevating both driving safety and the overall travel experience within intelligent driving scenarios. This innovation promises to shape the future landscape of automotive travel, offering a safer and more enjoyable journey for all.
引用
收藏
页码:142 / 150
页数:9
相关论文
共 50 条
  • [31] Speech emotion recognition based on an improved brain emotion learning model
    Liu, Zhen-Tao
    Xie, Qiao
    Wu, Min
    Cao, Wei-Hua
    Mei, Ying
    Mao, Jun-Wei
    NEUROCOMPUTING, 2018, 309 : 145 - 156
  • [32] Autoencoder with emotion embedding for speech emotion recognition
    Zhang, Chenghao
    Xue, Lei
    IEEE Access, 2021, 9 : 51231 - 51241
  • [33] Improving speech emotion recognition based on acoustic words emotion dictionary
    Wei, Wang
    Cao, Xinyi
    Li, He
    Shen, Lingjie
    Feng, Yaqin
    Watters, Paul A.
    NATURAL LANGUAGE ENGINEERING, 2021, 27 (06) : 747 - 761
  • [34] EmoEars: An emotion recognition system for mandarin speech
    Xie, B
    Chen, L
    Chen, GC
    Chen, C
    COMPUTATIONAL INTELLIGENCE AND SECURITY, PT 1, PROCEEDINGS, 2005, 3801 : 941 - 948
  • [35] Speech emotion recognition approaches in human computer interaction
    S. Ramakrishnan
    Ibrahiem M. M. El Emary
    Telecommunication Systems, 2013, 52 : 1467 - 1478
  • [36] Interaction and Transition Model for Speech Emotion Recognition in Dialogue
    Zhang, Ruo
    Atsushi, Ando
    Kobashikawa, Satoshi
    Aono, Yushi
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 1094 - 1097
  • [37] Subjective Evaluation of a Speech Emotion Recognition Interaction Framework
    Vryzas, Nikolaos
    Matsiola, Maria
    Kotsakis, Rigas
    Dimoulas, Charalampos
    Kalliris, George
    2018 CONFERENCE ON INTERACTION WITH SOUND (AUDIO MOSTLY): SOUND IN IMMERSION AND EMOTION (AM'18), 2018,
  • [38] Speech emotion recognition approaches in human computer interaction
    Ramakrishnan, S.
    El Emary, Ibrahiem M. M.
    TELECOMMUNICATION SYSTEMS, 2013, 52 (03) : 1467 - 1478
  • [39] Speaker Recognition and Speech Emotion Recognition Based on GMM
    Xu, Shupeng
    Liu, Yan
    Liu, Xiping
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON ELECTRIC AND ELECTRONICS, 2013, : 434 - 436
  • [40] Emotion-Aware In-Car Feedback: A Comparative Study
    Mwaita, Kevin Fred
    Bhaumik, Rahul
    Ahmed, Aftab
    Sharma, Adwait
    De Angeli, Antonella
    Haller, Michael
    MULTIMODAL TECHNOLOGIES AND INTERACTION, 2024, 8 (07)