Modeling Sentiment-Speaker-Dependency for Emotion Recognition in Conversation

被引:0
|
作者
Ge, Lin [1 ]
Huang, Faliang [1 ]
Li, Qi [1 ]
Ye, Yihua [1 ]
机构
[1] Nanning Normal Univ, Sch Comp & Informat Engn, Nanning, Peoples R China
关键词
Emotion recognition in conversation; Speaker dependency; Sentiment dependency;
D O I
10.1109/IJCNN60899.2024.10650672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion Recognition in Conversations (ERC) plays a crucial role in the development of human-machine interaction. Conversations are a multi-party, multi-emotion, and multi-turn process of information propagation. However, existing works, which focus on designing models and algorithms for better learning representations of dialogue context and speakers, but rarely care about the key element of the strong correlation and inseparable interdependence of emotional states on the sentiment polarity in the process. To address this issue, we propose a novel model, named S2D-ERC (Sentiment-Speaker-Dependency for Emotion Recognition in Conversation), for ERC task. The proposed model constructs a conversation as a directed acyclic graph and represents both speaker- and sentiment-dependencies between utterances with heterogeneous edges. Additionally, to capture the information interaction dynamics in conversation context, we employ a cross-attention mechanism where latent representations of speaker and sentiment are learned with two different directions of information flow. The experimental results on two benchmarks, compared with state-of-the-art models, demonstrate the superiority and effectiveness of our model.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Static and Dynamic Speaker Modeling based on Graph Neural Network for Emotion Recognition in Conversation
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE STUDENT RESEARCH WORKSHOP, 2022, : 247 - 253
  • [2] EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation
    Yingjian LIU
    Jiang LI
    Xiaoping WANG
    Zhigang ZENG
    ScienceChina(InformationSciences), 2024, 67 (08) : 130 - 146
  • [3] EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation
    Liu, Yingjian
    Li, Jiang
    Wang, Xiaoping
    Zeng, Zhigang
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (08)
  • [4] CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation
    Lee, Joosung
    Lee, Wooin
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 5669 - 5679
  • [5] SAPBERT: Speaker-Aware Pretrained BERT for Emotion Recognition in Conversation
    Lim, Seunguook
    Kim, Jihie
    ALGORITHMS, 2023, 16 (01)
  • [6] Context-and Sentiment-Aware Networks for Emotion Recognition in Conversation
    Tu G.
    Wen J.
    Liu C.
    Jiang D.
    Cambria E.
    IEEE Transactions on Artificial Intelligence, 2022, 3 (05): : 699 - 708
  • [7] Multi-Party Conversation Modeling for Emotion Recognition
    Quan, Xiaojun
    Wu, Siyue
    Chen, Junqing
    Shen, Weizhou
    Yu, Jianxing
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (03) : 751 - 768
  • [8] Modeling Hierarchical Uncertainty for Multimodal Emotion Recognition in Conversation
    Chen, Feiyu
    Shao, Jie
    Zhu, Anjie
    Ouyang, Deqiang
    Liu, Xueliang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 187 - 198
  • [9] Speaker-Aware Interactive Graph Attention Network for Emotion Recognition in Conversation
    Jia, Zhaohong
    Shi, Yunwei
    Liu, Weifeng
    Huang, Zhenhua
    Sun, Xiao
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (12)
  • [10] Improving Speaker-Dependency/Independency of Wavelet-Based Speech Emotion Recognition
    Chakhtouna, Adil
    Sekkate, Sara
    Adib, Abdellah
    EMERGING TRENDS IN INTELLIGENT SYSTEMS & NETWORK SECURITY, 2023, 147 : 281 - 291