Speaker-Aware Interactive Graph Attention Network for Emotion Recognition in Conversation

被引:0
|
作者
Jia, Zhaohong [1 ]
Shi, Yunwei [2 ]
Liu, Weifeng [1 ]
Huang, Zhenhua [1 ]
Sun, Xiao [3 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei 230601, Anhui, Peoples R China
[2] Anhui Univ, Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Sch Comp Sci & Technol, Hefei 230601, Anhui, Peoples R China
[3] Hefei Univ Technol, Inst Artificial Intelligence, Sch Comp Sci & Informat Engn, Hefei Comprehens Natl Sci Ctr, Hefei 230601, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Emotion recognition in conversation; text classification; natural language processing; CONVOLUTIONAL NETWORK;
D O I
10.1145/3627806
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, Emotion Recognition in Conversation (ERC) has attracted much attention and has become a hot topic in the field of natural language processing. Conversation is conducted in chronological order; current utterance is more likely influenced by nearby utterances. At the same time, speaker dependency also plays a core role in the conversation dynamic. The combined effect of the sequence-aware information and the speaker-aware information makes the emotion's dynamic change. However, past works used simple information fusion methods to model the two kinds of information but ignored their interactive influence. Thus, we propose a novel method entitled SIGAT (Speaker-aware Interactive Graph Attention Network) to solve the problem. The core module is a mutual interactive module in which a dual-connection (self-connection and interact-connection) graph attention network is constructed. The advantage of SIGAT is modeling the speaker-aware and sequence-aware information in a unified graph and updating them simultaneously. In this way, we model the interactive influence of them and obtain the final representations, which have richer contextual clues. Experimental results on the four public datasets demonstrate that SIGAT outperforms the state-of-the-art models.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] HAAN-ERC: hierarchical adaptive attention network for multimodal emotion recognition in conversation
    Zhang, Tao
    Tan, Zhenhua
    Wu, Xiaoer
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (24): : 17619 - 17632
  • [42] Multimodal EEG Emotion Recognition Based on the Attention Recurrent Graph Convolutional Network
    Chen, Jingxia
    Liu, Yang
    Xue, Wen
    Hu, Kailei
    Lin, Wentao
    INFORMATION, 2022, 13 (11)
  • [43] Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations
    Ishiwatari, Taichi
    Yasuda, Yuki
    Miyazaki, Taro
    Goto, Jun
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 7360 - 7370
  • [44] Using Speaker-Aligned Graph Memory Block in Multimodally Attentive Emotion Recognition Network
    Li, Jeng-Lin
    Lee, Chi-Chun
    INTERSPEECH 2020, 2020, : 389 - 393
  • [45] Multimodal Knowledge-enhanced Interactive Network with Mixed Contrastive Learning for Emotion Recognition in Conversation
    Shen, Xudong
    Huang, Xianying
    Zou, Shihao
    Gan, Xinyi
    NEUROCOMPUTING, 2024, 582
  • [46] Multimodal Knowledge-enhanced Interactive Network with Mixed Contrastive Learning for Emotion Recognition in Conversation
    Shen, Xudong
    Huang, Xianying
    Zou, Shihao
    Gan, Xinyi
    Neurocomputing, 2024, 582
  • [47] Graph Learning Based Speaker Independent Speech Emotion Recognition
    Xu, Xinzhou
    Huang, Chengwei
    Wu, Chen
    Wang, Qingyun
    Zhao, Li
    ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2014, 14 (02) : 17 - 22
  • [48] Context- and Knowledge-Aware Graph Convolutional Network for Multimodal Emotion Recognition
    Fu, Yahui
    Okada, Shogo
    Wang, Longbiao
    Guo, Lili
    Song, Yaodong
    Liu, Jiaxing
    Dang, Jianwu
    IEEE MULTIMEDIA, 2022, 29 (03) : 91 - 99
  • [49] Speaker-Aware Long Short-Term Memory Multi-Task Learning for Speech Recognition
    Pironkov, Gueorgui
    Dupont, Stephane
    Dutoit, Thierry
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 1911 - 1915
  • [50] Residual-Based Graph Convolutional Network for Emotion Recognition in Conversation for Smart Internet of Things
    Choi, Young-Ju
    Lee, Young-Woon
    Kim, Byung-Gyu
    BIG DATA, 2021, 9 (04) : 279 - 288