QAIE: LLM-based Quantity Augmentation and Information Enhancement for few-shot Aspect-Based Sentiment Analysis

被引:4
|
作者
Lu, Heng-yang [1 ,2 ]
Liu, Tian-ci [1 ]
Cong, Rui [1 ]
Yang, Jun [3 ]
Gan, Qiang [4 ]
Fang, Wei [1 ]
Wu, Xiao-jun [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Peoples R China
[2] Engn Res Ctr Intelligent Technol Healthcare, PRC Minist Educ, Wuxi, Peoples R China
[3] Marcpoint Co Ltd, Shanghai, Peoples R China
[4] Microsoft, Redmond, WA USA
基金
中国博士后科学基金;
关键词
Natural language understanding; Information extraction; Aspect-Based Sentiment Analysis; Few-shot learning; Large language models; OPINION;
D O I
10.1016/j.ipm.2024.103917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aspect-based Sentiment Analysis (ABSA) aims to extract fine-grained sentiment information from online reviews. Few-shot ABSA faces challenges with limited labeled data and recent generative models have outperformed traditional classification models. Existing methods use Question Answering (QA) templates with Text-to-Text Transfer Transformer (T5) to extract sentiment elements, introducing a generative sentiment analysis paradigm. However, these models often fail to fully grasp ABSA rules, generating non-standard or incorrect outputs. This issue also arises with large language models (LLMs) due to insufficient labeled data for tuning and learning. Additionally, ABSA datasets often include many short, uninformative reviews, complicating sentiment element extraction in few-shot scenarios. This paper addresses two major challenges in few-shot ABSA: (1) How to let the generative model well understand the ABSA rules under few-shot scenarios. (2) How to enhance the review text with richer information. We propose a Q uantity A ugmentation and I nformation E nhancement ( QAIE ) approach, leveraging LLMs to generate fluent texts and infer implicit information. First, we propose a quantity augmentation module, which leverages the large language model (LLM) to obtain sufficient labeled data for the generative model to learn the ABSA rules better. Then, we introduce an information enhancement module, which brings more informative input to the generative model by enhancing the information in the review. Comprehensive experiments on five ABSA tasks using three widely-used datasets demonstrate that our QAIE model achieves approximately 10% improvement over state-of-the-art models. Specifically, for the most challenging ASQP task, our LLM-based model is compared with the existing state-of-the-art models on datasets Rest15 and Rest16, achieving F1 gains of 9.42% and 6.45% respectively in the k = 5 few-shot setting.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Feature augmentation based on information fusion rectification for few-shot image classification
    Hang Wang
    Shengzhao Tian
    Yan Fu
    Junlin Zhou
    Jingfa Liu
    Duanbing Chen
    Scientific Reports, 13
  • [32] Survey on aspect detection for aspect-based sentiment analysis
    Trusca, Maria Mihaela
    Frasincar, Flavius
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (05) : 3797 - 3846
  • [33] Feature augmentation based on information fusion rectification for few-shot image classification
    Wang, Hang
    Tian, Shengzhao
    Fu, Yan
    Zhou, Junlin
    Liu, Jingfa
    Chen, Duanbing
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [34] Survey on aspect detection for aspect-based sentiment analysis
    Maria Mihaela Truşcǎ
    Flavius Frasincar
    Artificial Intelligence Review, 2023, 56 : 3797 - 3846
  • [35] Aspect-Based Sentiment Analysis Using Aspect Map
    Noh, Yunseok
    Park, Seyoung
    Park, Seong-Bae
    APPLIED SCIENCES-BASEL, 2019, 9 (16):
  • [36] Few-shot imbalanced classification based on data augmentation
    Chao, Xuewei
    Zhang, Lixin
    MULTIMEDIA SYSTEMS, 2023, 29 (05) : 2843 - 2851
  • [37] Enhancing aspect-based sentiment analysis using data augmentation based on back-translation
    Taheri, Alireza
    Zamanifar, Azadeh
    Farhadi, Amirfarhad
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024, : 491 - 516
  • [38] Attention-based Sentiment Reasoner for aspect-based sentiment analysis
    Liu, Ning
    Shen, Bo
    Zhang, Zhenjiang
    Zhang, Zhiyuan
    Mi, Kun
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2019, 9 (01)
  • [39] Few-shot Aspect Category Sentiment Analysis via Meta-learning
    Liang, Bin
    Li, Xiang
    Gui, Lin
    Fu, Yonghao
    He, Yulan
    Yang, Min
    Xu, Ruifeng
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (01)
  • [40] Aspect-based Sentiment Analysis with External Knowledge Embedding and Syntactic Information
    Zhang, Fan
    Zheng, Wenbin
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 439 - 444