Modeling Sentiment-Speaker-Dependency for Emotion Recognition in Conversation

被引:0
|
作者
Ge, Lin [1 ]
Huang, Faliang [1 ]
Li, Qi [1 ]
Ye, Yihua [1 ]
机构
[1] Nanning Normal Univ, Sch Comp & Informat Engn, Nanning, Peoples R China
关键词
Emotion recognition in conversation; Speaker dependency; Sentiment dependency;
D O I
10.1109/IJCNN60899.2024.10650672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion Recognition in Conversations (ERC) plays a crucial role in the development of human-machine interaction. Conversations are a multi-party, multi-emotion, and multi-turn process of information propagation. However, existing works, which focus on designing models and algorithms for better learning representations of dialogue context and speakers, but rarely care about the key element of the strong correlation and inseparable interdependence of emotional states on the sentiment polarity in the process. To address this issue, we propose a novel model, named S2D-ERC (Sentiment-Speaker-Dependency for Emotion Recognition in Conversation), for ERC task. The proposed model constructs a conversation as a directed acyclic graph and represents both speaker- and sentiment-dependencies between utterances with heterogeneous edges. Additionally, to capture the information interaction dynamics in conversation context, we employ a cross-attention mechanism where latent representations of speaker and sentiment are learned with two different directions of information flow. The experimental results on two benchmarks, compared with state-of-the-art models, demonstrate the superiority and effectiveness of our model.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Speaker-Characterized Emotion Recognition using Online and Iterative Speaker Adaptation
    Jae-Bok Kim
    Jeong-Sik Park
    Yung-Hwan Oh
    Cognitive Computation, 2012, 4 : 398 - 408
  • [42] Speaker-Characterized Emotion Recognition using Online and Iterative Speaker Adaptation
    Kim, Jae-Bok
    Park, Jeong-Sik
    Oh, Yung-Hwan
    COGNITIVE COMPUTATION, 2012, 4 (04) : 398 - 408
  • [43] Improving Speech Emotion Recognition System for a Social Robot with Speaker Recognition
    Juszkiewicz, Lukasz
    2014 19TH INTERNATIONAL CONFERENCE ON METHODS AND MODELS IN AUTOMATION AND ROBOTICS (MMAR), 2014, : 921 - 925
  • [44] Emotion Attribute Projection for Speaker Recognition on Emotional Speech
    Bao, Huanjun
    Xu, Mingxing
    Zheng, Thomas Fang
    INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 601 - 604
  • [45] SPEAKER VARIABILITY IN EMOTION RECOGNITION - AN ADAPTATION BASED APPROACH
    Ding, Ni
    Sethu, Vidhyasaharan
    Epps, Julien
    Ambikairajah, Eliathamby
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 5101 - 5104
  • [46] SVM Based Speaker Emotion Recognition in Continuous Scale
    Hric, Martin
    Chmulik, Michal
    Guoth, Igor
    Jarina, Roman
    2015 25TH INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2015, : 339 - 342
  • [47] Exploring the Intersection Between Speaker Verification and Emotion Recognition
    Bancroft, Michelle
    Lotfian, Reza
    Hansen, John
    Busso, Carlos
    2019 8TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS (ACIIW), 2019, : 337 - 342
  • [48] Discriminative Adversarial Learning for Speaker Independent Emotion Recognition
    Kasun, Chamara
    Ahn, Chung Soo
    Rajapakse, Jagath C.
    Lin, Zhiping
    Huang, Guang-Bin
    INTERSPEECH 2022, 2022, : 4975 - 4979
  • [49] Cascaded Adversarial Learning for Speaker Independent Emotion Recognition
    Lekamalage, Chamara Kasun Liyanaarachchi
    Lin, Zhiping
    Huang, Guang-Bin
    Rajapakse, Jagath Chandana
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [50] Speaker Dependent Emotion Recognition Using Prosodic Supervectors
    Lopez-Moreno, Ignacio
    Ortego-Resa, Carlos
    Gonzalez-Rodriguez, Joaquin
    Ramos, Daniel
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 1939 - 1942