Context-and Sentiment-Aware Networks for Emotion Recognition in Conversation

被引:45
|
作者
Tu G. [1 ]
Wen J. [1 ]
Liu C. [1 ]
Jiang D. [1 ]
Cambria E. [2 ]
机构
[1] Shantou University, Department of Computer Science, Shantou
[2] Nanyang Technological University, School of Computer Science and Engineering, Singapore
来源
基金
中国国家自然科学基金;
关键词
Common-sense knowledge graph; dialogue transformer (DT); emotion recognition; graph attention network;
D O I
10.1109/TAI.2022.3149234
中图分类号
学科分类号
摘要
Emotion recognition in conversation (ERC) has promising potential in many fields, such as recommendation systems, man-machine interaction, and medical care. In contrast to other emotion identification tasks, conversation is essentially a process of dynamic interaction in which people often convey emotional messages relying on context and common-sense knowledge. In this article, we propose a context-and sentiment-aware framework, termed Sentic GAT, to solve this challenge. In Sentic GAT, common-sense knowledge is dynamically represented by the context-and sentiment-aware graph attention mechanism based on sentimental consistency, and context information is captured by the dialogue transformer (DT) with hierarchical multihead attention (HMAT), where HMAT is used to obtain the dependency of historical utterances on themselves and other utterances for better context representation. Additionally, we explore a contrastive loss to discriminate context-free and context-sensitive utterances in emotion identification to enhance context representation in straightforward conversations that directly express ideas. The experimental results show that context and sentimental information can promote the representation of common-sense knowledge, and the intra-and inter-dependency of contextual utterances effectively improve the performance of Sentic GAT. Moreover, our Sentic GAT using emotional intensity outperforms the most advanced model on the tested datasets. © 2020 IEEE.
引用
收藏
页码:699 / 708
页数:9
相关论文
共 50 条
  • [31] Sentiment-Aware Multi-modal Recommendation on Tourist Attractions
    Wang, Junyi
    Bao, Bing-Kun
    Xu, Changsheng
    MULTIMEDIA MODELING (MMM 2019), PT I, 2019, 11295 : 3 - 16
  • [32] Detecting bursts in sentiment-aware topics from social media
    Xu, Kang
    Qi, Guilin
    Huang, Junheng
    Wu, Tianxing
    Fu, Xuefeng
    KNOWLEDGE-BASED SYSTEMS, 2018, 141 : 44 - 54
  • [33] Sarcasm driven by sentiment: A sentiment-aware hierarchical fusion network for multimodal sarcasm detection
    Liu, Hao
    Wei, Runguo
    Tu, Geng
    Lin, Jiali
    Liu, Cheng
    Jiang, Dazhi
    INFORMATION FUSION, 2024, 108
  • [34] A Joint Model for Sentiment-Aware Topic Detection on Social Media
    Xu, Kang
    Qi, Guilin
    Huang, Junheng
    Wu, Tianxing
    ECAI 2016: 22ND EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, 285 : 338 - 346
  • [35] Sentiment-Aware Stock Market Prediction: A Deep Learning Method
    Li, Jiahong
    Bu, Hui
    Wu, Junjie
    2017 14TH INTERNATIONAL CONFERENCE ON SERVICES SYSTEMS AND SERVICES MANAGEMENT (ICSSSM), 2017,
  • [36] SAPBERT: Speaker-Aware Pretrained BERT for Emotion Recognition in Conversation
    Lim, Seunguook
    Kim, Jihie
    ALGORITHMS, 2023, 16 (01)
  • [37] Sentiment-aware personalized tweet recommendation through multimodal FFM
    Ryosuke Harakawa
    Daichi Takehara
    Takahiro Ogawa
    Miki Haseyama
    Multimedia Tools and Applications, 2018, 77 : 18741 - 18759
  • [38] Adaptive sentiment-aware one-class collaborative filtering
    Pappas, Nikolaos
    Popescu-Belis, Andrei
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 43 : 23 - 41
  • [39] SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge
    Ke, Pei
    Ji, Haozhe
    Liu, Siyang
    Zhu, Xiaoyan
    Huang, Minlie
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 6975 - 6988
  • [40] Intelligent Trading Systems: A Sentiment-Aware Reinforcement Learning Approach
    Lima Paiva, Francisco Caio
    Felizardo, Leonardo Kanashiro
    da Costa Bianchi, Reinaldo Augusto
    Reali Costa, Anna Helena
    ICAIF 2021: THE SECOND ACM INTERNATIONAL CONFERENCE ON AI IN FINANCE, 2021,