Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition

被引:1
|
作者
Yang, Yuhan [1 ]
Zhang, Yan [1 ]
Zhong, Zhinan [1 ]
Dai, Wan [1 ]
Chen, Yunfei [1 ]
Chen, Mo [2 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[2] Nanjing Tech Univ, Coll Art & Design, Nanjing, Peoples R China
关键词
Human machine interaction (HMI); automotive travel; feature selection; speech emotion recognition; machine learning; emotion regulation; FEATURES;
D O I
10.1109/ICCCR61138.2024.10585371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With driving emerging as a common mode of transportation, the automotive industry has increasingly prioritized driving safety and experience. A substantial body of research focused on driving safety and the overall travel experience has underscored the pivotal role of emotions. In this article, we introduce an innovative in-car emotion recognition and interaction system, carefully crafted to intelligently respond to the emotional states of drivers. This system captures real-time emotional data through its user input layer and seamlessly integrates it into the technological architecture layer, residing within the vehicle's CPU. Leveraging cutting-edge deep learning models for emotion recognition, the system's outcomes trigger tailored emotion regulation strategies within the interaction feedback layer. Notably, our study introduces a groundbreaking speech fusion feature, MFCCs+, meticulously crafted for driving contexts. Furthermore, we have optimized the driving speech emotion recognition model using 1D-CNN, resulting in a remarkable 10% improvement in recognition accuracy. Subsequent validation experiments affirm the system's effectiveness in enhancing driving safety. In conclusion, the integration of emotion-based interaction solutions holds immense potential for elevating both driving safety and the overall travel experience within intelligent driving scenarios. This innovation promises to shape the future landscape of automotive travel, offering a safer and more enjoyable journey for all.
引用
收藏
页码:142 / 150
页数:9
相关论文
共 50 条
  • [1] Intelligent Customer Service System Based on Speech Emotion Recognition
    Zheng, Zhiguo
    Chen, Jie
    Li, Shuaijie
    Sun, Jiapeng
    Xie, Yihan
    Liang, Lijuan
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 334 - 338
  • [2] Speech emotion recognition based on emotion perception
    Liu, Gang
    Cai, Shifang
    Wang, Ce
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2023, 2023 (01)
  • [3] Speech emotion recognition based on emotion perception
    Gang Liu
    Shifang Cai
    Ce Wang
    EURASIP Journal on Audio, Speech, and Music Processing, 2023
  • [4] Performance analysis of acoustic emotion recognition for in-car conversational interfaces
    Jones, Christian Martyn
    Jonsson, Ing-Marie
    Universal Access in Human-Computer Interaction: Ambient Interaction, Pt 2, Proceedings, 2007, 4555 : 411 - 420
  • [5] Speech Emotion Recognition for Performance Interaction
    Vryzas, Nikolaos
    Kotsakis, Rigas
    Liatsou, Aikaterini
    Dimoulas, Charalampos
    Kalliris, George
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2018, 66 (06): : 457 - 467
  • [6] An In-Car Speech Recognition System for Disabled Drivers
    Ivanecky, Jozef
    Mehlhase, Stephan
    TEXT, SPEECH AND DIALOGUE, TSD 2012, 2012, 7499 : 505 - 512
  • [7] Knowledge-based framework for intelligent emotion recognition in spontaneous speech
    Chakraborty, Rupayan
    Pandharipande, Meghna
    Kopparapu, Sunil Kumar
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS: PROCEEDINGS OF THE 20TH INTERNATIONAL CONFERENCE KES-2016, 2016, 96 : 587 - 596
  • [8] An intelligent system for facial emotion recognition
    Cowie, R
    Douglas-Cowie, E
    Taylor, JG
    Ioannou, S
    Wallace, M
    Kollias, S
    2005 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), VOLS 1 AND 2, 2005, : 905 - 908
  • [9] Emotion recognition and synthesis system on speech
    Moriyama, T
    Ozawa, S
    IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS, PROCEEDINGS VOL 1, 1999, : 840 - 844
  • [10] Emotion recognition and synthesis system on speech
    Moriyama, Tsuyoshi
    Ozawa, Shinji
    International Conference on Multimedia Computing and Systems -Proceedings, 1999, 1 : 840 - 844