QAIE: LLM-based Quantity Augmentation and Information Enhancement for few-shot Aspect-Based Sentiment Analysis

被引:4
|
作者
Lu, Heng-yang [1 ,2 ]
Liu, Tian-ci [1 ]
Cong, Rui [1 ]
Yang, Jun [3 ]
Gan, Qiang [4 ]
Fang, Wei [1 ]
Wu, Xiao-jun [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Peoples R China
[2] Engn Res Ctr Intelligent Technol Healthcare, PRC Minist Educ, Wuxi, Peoples R China
[3] Marcpoint Co Ltd, Shanghai, Peoples R China
[4] Microsoft, Redmond, WA USA
基金
中国博士后科学基金;
关键词
Natural language understanding; Information extraction; Aspect-Based Sentiment Analysis; Few-shot learning; Large language models; OPINION;
D O I
10.1016/j.ipm.2024.103917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aspect-based Sentiment Analysis (ABSA) aims to extract fine-grained sentiment information from online reviews. Few-shot ABSA faces challenges with limited labeled data and recent generative models have outperformed traditional classification models. Existing methods use Question Answering (QA) templates with Text-to-Text Transfer Transformer (T5) to extract sentiment elements, introducing a generative sentiment analysis paradigm. However, these models often fail to fully grasp ABSA rules, generating non-standard or incorrect outputs. This issue also arises with large language models (LLMs) due to insufficient labeled data for tuning and learning. Additionally, ABSA datasets often include many short, uninformative reviews, complicating sentiment element extraction in few-shot scenarios. This paper addresses two major challenges in few-shot ABSA: (1) How to let the generative model well understand the ABSA rules under few-shot scenarios. (2) How to enhance the review text with richer information. We propose a Q uantity A ugmentation and I nformation E nhancement ( QAIE ) approach, leveraging LLMs to generate fluent texts and infer implicit information. First, we propose a quantity augmentation module, which leverages the large language model (LLM) to obtain sufficient labeled data for the generative model to learn the ABSA rules better. Then, we introduce an information enhancement module, which brings more informative input to the generative model by enhancing the information in the review. Comprehensive experiments on five ABSA tasks using three widely-used datasets demonstrate that our QAIE model achieves approximately 10% improvement over state-of-the-art models. Specifically, for the most challenging ASQP task, our LLM-based model is compared with the existing state-of-the-art models on datasets Rest15 and Rest16, achieving F1 gains of 9.42% and 6.45% respectively in the k = 5 few-shot setting.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Few-Shot Learning for Aspect-Based Sentiment Analysis
    Ruan, Heng
    Li, Xiaoge
    Li, Xianliang
    Jiang, Huikai
    Li, Yingchao
    ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 1146 - 1157
  • [2] A Simple yet Effective Framework for Few-Shot Aspect-Based Sentiment Analysis
    Wang, Zengzhi
    Xie, Qiming
    Xia, Rui
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1765 - 1770
  • [3] Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt
    Huang, Jie
    Cui, Yunpeng
    Liu, Juan
    Liu, Ming
    ELECTRONICS, 2024, 13 (10)
  • [4] FMCF: Few-shot Multimodal aspect-based sentiment analysis framework based on Contrastive Finetuning
    Du, Yongping
    Xie, Runfeng
    Zhang, Bochao
    Yin, Zihao
    APPLIED INTELLIGENCE, 2024, : 12629 - 12643
  • [5] Aspect Term Information Enhancement Network for Aspect-Based Sentiment Analysis
    Shen, Yafei
    Chen, Zhuo
    Di, Jiaqi
    Meng, Ying
    2024 9th International Conference on Intelligent Computing and Signal Processing, ICSP 2024, 2024, : 1198 - 1204
  • [6] A Weak Supervision Approach for Few-Shot Aspect Based Sentiment Analysis
    Vacareanu, Robert
    Varia, Siddharth
    Halder, Kishaloy
    Wang, Shuai
    Paolini, Giovanni
    John, Neha Anna
    Ballesteros, Miguel
    Muresan, Smaranda
    PROCEEDINGS OF THE 18TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 2734 - 2752
  • [7] Data augmentation for aspect-based sentiment analysis
    Guangmin Li
    Hui Wang
    Yi Ding
    Kangan Zhou
    Xiaowei Yan
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 125 - 133
  • [8] Data augmentation for aspect-based sentiment analysis
    Li, Guangmin
    Wang, Hui
    Ding, Yi
    Zhou, Kangan
    Yan, Xiaowei
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (01) : 125 - 133
  • [9] LLM Enhanced Cross Domain Aspect-based Sentiment Analysis
    Li, Shi-Chen
    Wang, Zhong-Qing
    Zhou, Guo-Dong
    Ruan Jian Xue Bao/Journal of Software, 2025, 36 (02): : 644 - 659
  • [10] Improving In-Context Learning via Sequentially Retrieval and Preference Alignment for Few-Shot Aspect-Based Sentiment Analysis
    Wang, Qianlong
    Ding, Keyang
    Luo, Xuan
    Xu, Ruifeng
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 2462 - 2466