QAIE: LLM-based Quantity Augmentation and Information Enhancement for few-shot Aspect-Based Sentiment Analysis

被引:4
|
作者
Lu, Heng-yang [1 ,2 ]
Liu, Tian-ci [1 ]
Cong, Rui [1 ]
Yang, Jun [3 ]
Gan, Qiang [4 ]
Fang, Wei [1 ]
Wu, Xiao-jun [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Peoples R China
[2] Engn Res Ctr Intelligent Technol Healthcare, PRC Minist Educ, Wuxi, Peoples R China
[3] Marcpoint Co Ltd, Shanghai, Peoples R China
[4] Microsoft, Redmond, WA USA
基金
中国博士后科学基金;
关键词
Natural language understanding; Information extraction; Aspect-Based Sentiment Analysis; Few-shot learning; Large language models; OPINION;
D O I
10.1016/j.ipm.2024.103917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aspect-based Sentiment Analysis (ABSA) aims to extract fine-grained sentiment information from online reviews. Few-shot ABSA faces challenges with limited labeled data and recent generative models have outperformed traditional classification models. Existing methods use Question Answering (QA) templates with Text-to-Text Transfer Transformer (T5) to extract sentiment elements, introducing a generative sentiment analysis paradigm. However, these models often fail to fully grasp ABSA rules, generating non-standard or incorrect outputs. This issue also arises with large language models (LLMs) due to insufficient labeled data for tuning and learning. Additionally, ABSA datasets often include many short, uninformative reviews, complicating sentiment element extraction in few-shot scenarios. This paper addresses two major challenges in few-shot ABSA: (1) How to let the generative model well understand the ABSA rules under few-shot scenarios. (2) How to enhance the review text with richer information. We propose a Q uantity A ugmentation and I nformation E nhancement ( QAIE ) approach, leveraging LLMs to generate fluent texts and infer implicit information. First, we propose a quantity augmentation module, which leverages the large language model (LLM) to obtain sufficient labeled data for the generative model to learn the ABSA rules better. Then, we introduce an information enhancement module, which brings more informative input to the generative model by enhancing the information in the review. Comprehensive experiments on five ABSA tasks using three widely-used datasets demonstrate that our QAIE model achieves approximately 10% improvement over state-of-the-art models. Specifically, for the most challenging ASQP task, our LLM-based model is compared with the existing state-of-the-art models on datasets Rest15 and Rest16, achieving F1 gains of 9.42% and 6.45% respectively in the k = 5 few-shot setting.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Few-shot imbalanced classification based on data augmentation
    Xuewei Chao
    Lixin Zhang
    Multimedia Systems, 2023, 29 : 2843 - 2851
  • [42] Counterfactual-Enhanced Information Bottleneck for Aspect-Based Sentiment Analysis
    Chang, Mingshan
    Yang, Min
    Jiang, Qingshan
    Xu, Ruifeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 17736 - 17744
  • [43] BioReX: Biomarker Information Extraction Inspired by Aspect-Based Sentiment Analysis
    Gao, Welting
    Gao, Xiangyu
    Chen, Wenjin
    Foran, David J.
    Chen, Yi
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT IV, PAKDD 2024, 2024, 14648 : 129 - 141
  • [44] Prompted and integrated textual information enhancing aspect-based sentiment analysis
    Xuefeng Shi
    Min Hu
    Fuji Ren
    Piao Shi
    Jiawen Deng
    Yiming Tang
    Journal of Intelligent Information Systems, 2024, 62 : 91 - 115
  • [45] DualGCN: Exploring Syntactic and Semantic Information for Aspect-Based Sentiment Analysis
    Li, Ruifan
    Chen, Hao
    Feng, Fangxiang
    Ma, Zhanyu
    Wang, Xiaojie
    Hovy, Eduard
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7642 - 7656
  • [46] Prompted and integrated textual information enhancing aspect-based sentiment analysis
    Shi, Xuefeng
    Hu, Min
    Ren, Fuji
    Shi, Piao
    Deng, Jiawen
    Tang, Yiming
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2024, 62 (01) : 91 - 115
  • [47] Aspect-based sentiment analysis with multi-granularity information mining and sentiment hint
    Gu, Tiquan
    He, Zhenzhen
    Zhao, Hui
    Li, Min
    Ying, Di
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [48] Information-assisted and sentiment relation-driven for aspect-based sentiment analysis
    Gu, Tiquan
    He, Zhenzhen
    Li, Zhe
    Wan, Yaling
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 278
  • [49] Aspect-Based Sentiment Analysis for User Reviews
    Yin Zhang
    Jinyang Du
    Xiao Ma
    Haoyu Wen
    Giancarlo Fortino
    Cognitive Computation, 2021, 13 : 1114 - 1127
  • [50] Datasets for Aspect-Based Sentiment Analysis in French
    Apidianaki, Marianna
    Tannier, Xavier
    Richart, Cecile
    LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 1122 - 1126