Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition

被引:1
|
作者
Yang, Yuhan [1 ]
Zhang, Yan [1 ]
Zhong, Zhinan [1 ]
Dai, Wan [1 ]
Chen, Yunfei [1 ]
Chen, Mo [2 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[2] Nanjing Tech Univ, Coll Art & Design, Nanjing, Peoples R China
关键词
Human machine interaction (HMI); automotive travel; feature selection; speech emotion recognition; machine learning; emotion regulation; FEATURES;
D O I
10.1109/ICCCR61138.2024.10585371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With driving emerging as a common mode of transportation, the automotive industry has increasingly prioritized driving safety and experience. A substantial body of research focused on driving safety and the overall travel experience has underscored the pivotal role of emotions. In this article, we introduce an innovative in-car emotion recognition and interaction system, carefully crafted to intelligently respond to the emotional states of drivers. This system captures real-time emotional data through its user input layer and seamlessly integrates it into the technological architecture layer, residing within the vehicle's CPU. Leveraging cutting-edge deep learning models for emotion recognition, the system's outcomes trigger tailored emotion regulation strategies within the interaction feedback layer. Notably, our study introduces a groundbreaking speech fusion feature, MFCCs+, meticulously crafted for driving contexts. Furthermore, we have optimized the driving speech emotion recognition model using 1D-CNN, resulting in a remarkable 10% improvement in recognition accuracy. Subsequent validation experiments affirm the system's effectiveness in enhancing driving safety. In conclusion, the integration of emotion-based interaction solutions holds immense potential for elevating both driving safety and the overall travel experience within intelligent driving scenarios. This innovation promises to shape the future landscape of automotive travel, offering a safer and more enjoyable journey for all.
引用
收藏
页码:142 / 150
页数:9
相关论文
共 50 条
  • [41] Improving in-car emotion classification by NIR database augmentation
    Malaescu, Alexandru
    Dutu, Liviu Cristian
    Sultana, Alina
    Filip, Dan
    Ciuc, Mihai
    2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 689 - 693
  • [42] An Intelligent Music Player based on Emotion Recognition
    Ramanathan, Ramya
    Kumaran, Radha
    Rohan, Ram R.
    Gupta, Rajat
    Prabhu, Vishalakshi
    2017 2ND INTERNATIONAL CONFERENCE ON COMPUTATIONAL SYSTEMS AND INFORMATION TECHNOLOGY FOR SUSTAINABLE SOLUTION (CSITSS-2017), 2017, : 299 - 303
  • [43] Robust In-Car Speech Recognition Based on Nonlinear Multiple Regressions
    Weifeng Li
    Kazuya Takeda
    Fumitada Itakura
    EURASIP Journal on Advances in Signal Processing, 2007
  • [44] Speech emotion recognition in web based education
    Gong, Mingmin
    Luo, Qi
    PROCEEDINGS OF 2007 IEEE INTERNATIONAL CONFERENCE ON GREY SYSTEMS AND INTELLIGENT SERVICES, VOLS 1 AND 2, 2007, : 1082 - 1086
  • [45] Speech Emotion Recognition Based on Dynamic Models
    Lv, Guoyun
    Hu, Shuixian
    Lu, Xipan
    2014 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), VOLS 1-2, 2014, : 480 - 484
  • [46] Speech Emotion Recognition Based on Improved MFCC
    Wang, Yan
    Hu, Weiping
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,
  • [47] Speech Emotion Recognition Based on Sparse Representation
    Yan, Jingjie
    Wang, Xiaolan
    Gu, Weiyi
    Ma, Lili
    ARCHIVES OF ACOUSTICS, 2013, 38 (04) : 465 - 470
  • [48] Speech emotion recognition in web based service
    Huang, Huiqin
    Luo, Qi
    Zhu, Aiqin
    2007 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS PROCEEDINGS, VOLS 1 AND 2: VOL 1: COMMUNICATION THEORY AND SYSTEMS; VOL 2: SIGNAL PROCESSING, COMPUTATIONAL INTELLIGENCE, CIRCUITS AND SYSTEMS, 2007, : 804 - +
  • [49] Speech Emotion Recognition Based on Learning Automata in
    Motamed, Sara
    Setayeshi, Saeed
    Farhoudi, Zeinab
    Ahmadi, Ali
    JOURNAL OF MATHEMATICS AND COMPUTER SCIENCE-JMCS, 2014, 12 (03): : 173 - 185
  • [50] Speech Emotion Recognition Based on PCA and CHMM
    Ke, Xianxin
    Cao, Bin
    Bai, Jiaojiao
    Yu, Qichao
    Yang, Dezhi
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 667 - 671