Context-and Sentiment-Aware Networks for Emotion Recognition in Conversation

被引:45
|
作者
Tu G. [1 ]
Wen J. [1 ]
Liu C. [1 ]
Jiang D. [1 ]
Cambria E. [2 ]
机构
[1] Shantou University, Department of Computer Science, Shantou
[2] Nanyang Technological University, School of Computer Science and Engineering, Singapore
来源
基金
中国国家自然科学基金;
关键词
Common-sense knowledge graph; dialogue transformer (DT); emotion recognition; graph attention network;
D O I
10.1109/TAI.2022.3149234
中图分类号
学科分类号
摘要
Emotion recognition in conversation (ERC) has promising potential in many fields, such as recommendation systems, man-machine interaction, and medical care. In contrast to other emotion identification tasks, conversation is essentially a process of dynamic interaction in which people often convey emotional messages relying on context and common-sense knowledge. In this article, we propose a context-and sentiment-aware framework, termed Sentic GAT, to solve this challenge. In Sentic GAT, common-sense knowledge is dynamically represented by the context-and sentiment-aware graph attention mechanism based on sentimental consistency, and context information is captured by the dialogue transformer (DT) with hierarchical multihead attention (HMAT), where HMAT is used to obtain the dependency of historical utterances on themselves and other utterances for better context representation. Additionally, we explore a contrastive loss to discriminate context-free and context-sensitive utterances in emotion identification to enhance context representation in straightforward conversations that directly express ideas. The experimental results show that context and sentimental information can promote the representation of common-sense knowledge, and the intra-and inter-dependency of contextual utterances effectively improve the performance of Sentic GAT. Moreover, our Sentic GAT using emotional intensity outperforms the most advanced model on the tested datasets. © 2020 IEEE.
引用
收藏
页码:699 / 708
页数:9
相关论文
共 50 条
  • [11] Sentiment-Aware and Personalized Tour Recommendation
    Padia, Prarthana
    Lim, Kwan Hui
    Chan, Jeffrey
    Harwood, Aaron
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 900 - 909
  • [12] SAAN: A Sentiment-Aware Attention Network for Sentiment Analysis
    Lei, Zeyang
    Yang, Yujiu
    Yang, Min
    ACM/SIGIR PROCEEDINGS 2018, 2018, : 1197 - 1200
  • [13] Attenuated sentiment-aware sequential recommendation
    Donglin Zhou
    Zhihong Zhang
    Yangxin Zheng
    Zhenting Zou
    Lin Zheng
    International Journal of Data Science and Analytics, 2023, 16 : 271 - 283
  • [14] A Flexible and Sentiment-Aware Framework for Entity Search
    Min, Kerui
    Dong, Chenghao
    Cai, Shiyuan
    Chen, Jianhao
    NATURAL LANGUAGE UNDERSTANDING AND INTELLIGENT APPLICATIONS (NLPCC 2016), 2016, 10102 : 701 - 710
  • [15] Sentiment-Aware Transformer Using Joint Training
    Huang, Hui
    Jin, Yueyuan
    Rao, Ruonan
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 1154 - 1160
  • [16] Modeling Sentiment-Speaker-Dependency for Emotion Recognition in Conversation
    Ge, Lin
    Huang, Faliang
    Li, Qi
    Ye, Yihua
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [17] Ontology- and Sentiment-aware Review Summarization
    Le, Nhat X. T.
    Hristidis, Vagelis
    Young, Neal
    2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 171 - 174
  • [18] Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation
    Shenoy, Aman
    Sardana, Ashish
    PROCEEDINGS OF THE SECOND GRAND CHALLENGE AND WORKSHOP ON MULTIMODAL LANGUAGE (CHALLENGE-HML), VOL 1, 2020, : 19 - 28
  • [19] Regional Attention Networks with Context-aware Fusion for Group Emotion Recognition
    Khan, Ahmed Shehab
    Li, Zhiyuan
    Cai, Jie
    Tong, Yan
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1149 - 1158
  • [20] Efficient Sentiment-Aware Web Crawling Methods for Constructing Sentiment Dictionary
    On, Byung-Won
    Jo, Jun-Young
    Shin, Hyunkwang
    Gim, Jangwon
    Choi, Gyu Sang
    Jung, Soo-Mok
    IEEE ACCESS, 2021, 9 : 161208 - 161223