Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition

被引:1
|
作者
Yang, Yuhan [1 ]
Zhang, Yan [1 ]
Zhong, Zhinan [1 ]
Dai, Wan [1 ]
Chen, Yunfei [1 ]
Chen, Mo [2 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[2] Nanjing Tech Univ, Coll Art & Design, Nanjing, Peoples R China
关键词
Human machine interaction (HMI); automotive travel; feature selection; speech emotion recognition; machine learning; emotion regulation; FEATURES;
D O I
10.1109/ICCCR61138.2024.10585371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With driving emerging as a common mode of transportation, the automotive industry has increasingly prioritized driving safety and experience. A substantial body of research focused on driving safety and the overall travel experience has underscored the pivotal role of emotions. In this article, we introduce an innovative in-car emotion recognition and interaction system, carefully crafted to intelligently respond to the emotional states of drivers. This system captures real-time emotional data through its user input layer and seamlessly integrates it into the technological architecture layer, residing within the vehicle's CPU. Leveraging cutting-edge deep learning models for emotion recognition, the system's outcomes trigger tailored emotion regulation strategies within the interaction feedback layer. Notably, our study introduces a groundbreaking speech fusion feature, MFCCs+, meticulously crafted for driving contexts. Furthermore, we have optimized the driving speech emotion recognition model using 1D-CNN, resulting in a remarkable 10% improvement in recognition accuracy. Subsequent validation experiments affirm the system's effectiveness in enhancing driving safety. In conclusion, the integration of emotion-based interaction solutions holds immense potential for elevating both driving safety and the overall travel experience within intelligent driving scenarios. This innovation promises to shape the future landscape of automotive travel, offering a safer and more enjoyable journey for all.
引用
收藏
页码:142 / 150
页数:9
相关论文
共 50 条
  • [21] English speech emotion recognition method based on speech recognition
    Liu, Man
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2022, 25 (2) : 391 - 398
  • [22] English speech emotion recognition method based on speech recognition
    Man Liu
    International Journal of Speech Technology, 2022, 25 : 391 - 398
  • [23] Speech Interactive Emotion Recognition System Based on Random Forest
    Yan, Susu
    Ye, Liang
    Han, Shuai
    Han, Tian
    Li, Yue
    Alasaarela, Esko
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 1458 - 1462
  • [24] An enhanced speech emotion recognition system based on discourse information
    Chen, Chun
    You, Mingyu
    Song, Mingli
    Bu, Jiajun
    Liu, Jia
    COMPUTATIONAL SCIENCE - ICCS 2006, PT 1, PROCEEDINGS, 2006, 3991 : 449 - 456
  • [25] DriveSense: A Multi-modal Emotion Recognition and Regulation System for a Car Driver
    Zhu, Lei
    Zhong, Zhinan
    Dai, Wan
    Chen, Yunfei
    Zhang, Yan
    Chen, Mo
    HCI IN MOBILITY, TRANSPORT, AND AUTOMOTIVE SYSTEMS, MOBITAS 2024, PT I, 2024, 14732 : 82 - 97
  • [26] End-to-end Triplet Loss based Emotion Embedding System for Speech Emotion Recognition
    Kumar, Puneet
    Jain, Sidharth
    Raman, Balasubramanian
    Roy, Partha Pratim
    Iwamura, Masakazu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8766 - 8773
  • [27] Speech Emotion Recognition
    Lalitha, S.
    Madhavan, Abhishek
    Bhushan, Bharath
    Saketh, Srinivas
    2014 INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRONICS, COMPUTERS AND COMMUNICATIONS (ICAECC), 2014,
  • [28] Informative Speech Features based on Emotion Classes and Gender in Explainable Speech Emotion Recognition
    Yildirim, Huseyin Ediz
    Iren, Deniz
    2023 11TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS, ACIIW, 2023,
  • [29] Empirical Interpretation of Speech Emotion Perception with Attention Based Model for Speech Emotion Recognition
    Jalal, Md Asif
    Milner, Rosanna
    Hain, Thomas
    INTERSPEECH 2020, 2020, : 4113 - 4117
  • [30] Autoencoder With Emotion Embedding for Speech Emotion Recognition
    Zhang, Chenghao
    Xue, Lei
    IEEE ACCESS, 2021, 9 : 51231 - 51241