Integrating personalized and contextual information in fine-grained emotion recognition in text: A multi-source fusion approach with explainability

被引:0
|
作者
Ngo, Anh [1 ]
Kocon, Jan [1 ]
机构
[1] Wroclaw Univ Sci & Technol, Dept Artificial Intelligence, Wyb Wyspianskiego 27, PL-50370 Wroclaw, Poland
关键词
Emotion recognition; Sentence sequence classification; Personalization; Data cartography; Natural Language Processing (NLP); Explainable artificial; Intelligence (XAI); BASIC EMOTIONS; CLASSIFICATION; SIMILARITY; MODEL;
D O I
10.1016/j.inffus.2025.102966
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in textual data is a rapidly evolving field with diverse applications. While the stateof-the-art (SOTA) models based on pre-trained large language models (LLMs) have demonstrated significant achievements, the existing approaches often overlook fine-grained emotional nuances within individual sentences and the influence of contextual information. Additionally, despite the growing interest in personalized Natural Language Processing, recent studies have highlighted limitations in the literature, particularly the lack of explainability methods to interpret the improvements observed in these models. This study explores the CLARIN-Emo dataset to demonstrate the effectiveness of integrating personalized and contextual information for accurate emotion detection. By framing textual emotion recognition as a sequence sentence classification (SSC) task and leveraging transformer-based architectures, the proposed multi- source fusion approach significantly outperformed the baseline model, which considers each sentence in isolation. Furthermore, a personalized method, referred to as UserID, captures user-specific characteristics by assigning each annotator a unique identifier, significantly enhancing emotion prediction accuracy. This work also introduces an extension of Data Maps by differentiating dynamic training metrics to analyze the models' training behaviors. The results validate the capability of this approach in visually interpreting and facilitating performance comparisons between models.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Multi-source Information Fusion for Personalized Restaurant Recommendation
    Sun, Jing
    Xiong, Yun
    Zhu, Yangyong
    Liu, Junming
    Guan, Chu
    Xiong, Hui
    SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2015, : 983 - 986
  • [2] Fine-grained image recognition via trusted multi-granularity information fusion
    Yu, Ying
    Tang, Hong
    Qian, Jin
    Zhu, Zhiliang
    Cai, Zhen
    Lv, Jingqin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (04) : 1105 - 1117
  • [3] Fine-grained image recognition via trusted multi-granularity information fusion
    Ying Yu
    Hong Tang
    Jin Qian
    Zhiliang Zhu
    Zhen Cai
    Jingqin Lv
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1105 - 1117
  • [4] Fine-grained emotion recognition: fusion of physiological signals and facial expressions on spontaneous emotion corpus
    Setiawan, Feri
    Prabono, Aria Ghora
    Khowaja, Sunder Ali
    Kim, Wangsoo
    Park, Kyoungsoo
    Yahya, Bernardo Nugroho
    Lee, Seok-Lyong
    Hong, Jin Pyo
    INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2020, 35 (03) : 162 - 178
  • [5] Multi-level information fusion Transformer with background filter for fine-grained image recognition
    Yu, Ying
    Wang, Jinghui
    Pedrycz, Witold
    Miao, Duoqian
    Qian, Jin
    APPLIED INTELLIGENCE, 2024, 54 (17-18) : 8108 - 8119
  • [6] Graph-based fine-grained model selection for multi-source domain
    Hu, Zhigang
    Huang, Yuhang
    Zheng, Hao
    Zheng, Meiguang
    Liu, JianJun
    PATTERN ANALYSIS AND APPLICATIONS, 2023, 26 (03) : 1481 - 1492
  • [7] Tourism demand forecasting based on multi-source fine-grained sentiment mining
    Li X.
    Wang Y.
    Yan X.
    Xie G.
    Wang S.
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2024, 44 (07): : 2293 - 2308
  • [8] Graph-based fine-grained model selection for multi-source domain
    Zhigang Hu
    Yuhang Huang
    Hao Zheng
    Meiguang Zheng
    JianJun Liu
    Pattern Analysis and Applications, 2023, 26 (3) : 1481 - 1492
  • [9] A fine-grained human facial key feature extraction and fusion method for emotion recognition
    Shiwei Li
    Jisen Wang
    Linbo Tian
    Jianqiang Wang
    Yan Huang
    Scientific Reports, 15 (1)
  • [10] A fine-grained multi-source measurement platform correlating routing transitions with packet losses
    Merindol, Pascal
    David, Pierre
    Pansiot, Jean-Jacques
    Clad, Francois
    Vissicchio, Stefano
    COMPUTER COMMUNICATIONS, 2018, 129 : 166 - 183