EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation

被引:0
|
作者
Yingjian LIU [1 ,2 ,3 ]
Jiang LI [1 ,4 ,2 ,3 ]
Xiaoping WANG [1 ,2 ,3 ]
Zhigang ZENG [1 ,2 ,3 ]
机构
[1] School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
[2] Hubei Key Laboratory of Brain-inspired Intelligent Systems, Huazhong University of Science and Technology
[3] Key Laboratory of Image Processing and Intelligent Control (Huazhong University of Science and Technology),Ministry of Education
[4] Institute of Artificial Intelligence, Huazhong University of Science and
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论]; TP391.1 [文字信息处理];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in conversation(ERC) has attracted growing attention in recent years as a result of the advancement and implementation of human-computer interface technologies. In this paper,we propose an emotional inertia and contagion-driven dependency modeling approach(EmotionIC) for ERC tasks. Our EmotionIC consists of three main components, i.e., identity masked multi-head attention(IMMHA), dialogue-based gated recurrent unit(DiaGRU), and skip-chain conditional random field(SkipCRF).Compared to previous ERC models, EmotionIC can model a conversation more thoroughly at both the feature-extraction and classification levels. The proposed model attempts to integrate the advantages of attention-and recurrence-based methods at the feature-extraction level. Specifically, IMMHA is applied to capture identity-based global contextual dependencies, while Dia GRU is utilized to extract speaker-and temporal-aware local contextual information. At the classification level, SkipCRF can explicitly mine complex emotional flows from higher-order neighboring utterances in the conversation. Experimental results show that our method can significantly outperform the state-of-the-art models on four benchmark datasets.The ablation studies confirm that our modules can effectively model emotional inertia and contagion.
引用
收藏
页码:130 / 146
页数:17
相关论文
共 11 条
  • [1] EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation
    Liu, Yingjian
    Li, Jiang
    Wang, Xiaoping
    Zeng, Zhigang
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (08)
  • [2] Modeling Sentiment-Speaker-Dependency for Emotion Recognition in Conversation
    Ge, Lin
    Huang, Faliang
    Li, Qi
    Ye, Yihua
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [3] Prototype equilibrium network with group emotional contagion for few-shot emotion recognition in conversation
    Jiang, Min
    Wang, Mengdi
    Kong, Jun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (06) : 2229 - 2246
  • [4] Multi-Party Conversation Modeling for Emotion Recognition
    Quan, Xiaojun
    Wu, Siyue
    Chen, Junqing
    Shen, Weizhou
    Yu, Jianxing
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (03) : 751 - 768
  • [5] Modeling Hierarchical Uncertainty for Multimodal Emotion Recognition in Conversation
    Chen, Feiyu
    Shao, Jie
    Zhu, Anjie
    Ouyang, Deqiang
    Liu, Xueliang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 187 - 198
  • [6] Transformer-Based Potential Emotional Relation Mining Network for Emotion Recognition in Conversation
    Shi, Yunwei
    Sun, Xiao
    MAN-MACHINE SPEECH COMMUNICATION, NCMMSC 2022, 2023, 1765 : 238 - 251
  • [7] ADVANCED LSTM: A STUDY ABOUT BETTER TIME DEPENDENCY MODELING IN EMOTION RECOGNITION
    Tao, Fei
    Liu, Gang
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2906 - 2910
  • [8] Hierarchical Modeling of Temporal Course in Emotional Expression for Speech Emotion Recognition
    Wu, Chung-Hsien
    Liang, Wei-Bin
    Cheng, Kuan-Chun
    Lin, Jen-Chun
    2015 INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2015, : 810 - 814
  • [9] Static and Dynamic Speaker Modeling based on Graph Neural Network for Emotion Recognition in Conversation
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE STUDENT RESEARCH WORKSHOP, 2022, : 247 - 253
  • [10] CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation
    Lee, Joosung
    Lee, Wooin
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 5669 - 5679