Integrating personalized and contextual information in fine-grained emotion recognition in text: A multi-source fusion approach with explainability

被引:0
|
作者
Ngo, Anh [1 ]
Kocon, Jan [1 ]
机构
[1] Wroclaw Univ Sci & Technol, Dept Artificial Intelligence, Wyb Wyspianskiego 27, PL-50370 Wroclaw, Poland
关键词
Emotion recognition; Sentence sequence classification; Personalization; Data cartography; Natural Language Processing (NLP); Explainable artificial; Intelligence (XAI); BASIC EMOTIONS; CLASSIFICATION; SIMILARITY; MODEL;
D O I
10.1016/j.inffus.2025.102966
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in textual data is a rapidly evolving field with diverse applications. While the stateof-the-art (SOTA) models based on pre-trained large language models (LLMs) have demonstrated significant achievements, the existing approaches often overlook fine-grained emotional nuances within individual sentences and the influence of contextual information. Additionally, despite the growing interest in personalized Natural Language Processing, recent studies have highlighted limitations in the literature, particularly the lack of explainability methods to interpret the improvements observed in these models. This study explores the CLARIN-Emo dataset to demonstrate the effectiveness of integrating personalized and contextual information for accurate emotion detection. By framing textual emotion recognition as a sequence sentence classification (SSC) task and leveraging transformer-based architectures, the proposed multi- source fusion approach significantly outperformed the baseline model, which considers each sentence in isolation. Furthermore, a personalized method, referred to as UserID, captures user-specific characteristics by assigning each annotator a unique identifier, significantly enhancing emotion prediction accuracy. This work also introduces an extension of Data Maps by differentiating dynamic training metrics to analyze the models' training behaviors. The results validate the capability of this approach in visually interpreting and facilitating performance comparisons between models.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] Fine-grained Recognition in the Wild: A Multi-Task Domain Adaptation Approach
    Gebru, Timnit
    Hoffman, Judy
    Li Fei-Fei
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1358 - 1367
  • [22] Fine-Grained Emotion Analysis of Arabic Tweets: A Multi-Target Multi-Label Approach
    Badarneh, Omar
    Al-Ayyoub, Mahmoud
    Alhindawi, Nouh
    Tawalbeh, Lo'ai A.
    Jararweh, Yaser
    2018 IEEE 12TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2018, : 340 - 345
  • [23] Multi-Scale Feature Fusion of Covariance Pooling Networks for Fine-Grained Visual Recognition
    Qian, Lulu
    Yu, Tan
    Yang, Jianyu
    SENSORS, 2023, 23 (08)
  • [24] Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research
    Zhang, Shouyang
    Zhang, Yong
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [25] Correlation Matters: Multi-scale Fine-Grained Contextual Information Extraction for Hepatic Tumor Segmentation
    Pang, Shuchao
    Du, Anan
    Yu, Zhenmei
    Orgun, Mehmet A.
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 462 - 474
  • [26] Fine-Grained Emotion Detection in Suicide Notes: A Thresholding Approach to Multi-Label Classification
    Luyckx, Kim
    Vaassen, Frederik
    Peersman, Claudia
    Daelemans, Walter
    BIOMEDICAL INFORMATICS INSIGHTS, 2012, 5 : 61 - 69
  • [27] A Two-Stage Approach for Fine-Grained Visual Recognition via Confidence Ranking and Fusion
    Sun, Kangbo
    Zhu, Jie
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (12) : 2693 - 2700
  • [28] Towards a multi-source fusion approach for eye movement-driven recognition
    Rigas, Ioannis
    Abdulin, Evgeniy
    Komogortsev, Oleg
    INFORMATION FUSION, 2016, 32 : 13 - 25
  • [29] Multi-source genesis of continental carbonate-rich fine-grained sedimentary rocks and hydrocarbon sweet spots
    Jiang Zaixing
    Kong Xiangxin
    Yang Yepeng
    Zhang Jianguo
    Zhang Yuanfu
    Wang Li
    Yuan Xiaodong
    PETROLEUM EXPLORATION AND DEVELOPMENT, 2021, 48 (01) : 30 - 42
  • [30] Multi-source genesis of continental carbonate-rich fine-grained sedimentary rocks and hydrocarbon sweet spots
    Jiang Z.
    Kong X.
    Yang Y.
    Zhang J.
    Zhang Y.
    Wang L.
    Yuan X.
    Shiyou Kantan Yu Kaifa/Petroleum Exploration and Development, 2021, 48 (01): : 26 - 37