Twin Towers End to End model for aspect-based sentiment analysis

被引:2
|
作者
Li, Ziliang [1 ]
Song, Yuqian [1 ]
Lu, Xiaoling [2 ]
Liu, Miao [1 ]
机构
[1] Cent Univ Finance & Econ, Sch Stat & Math, Shahe Campus, Beijing 102206, Peoples R China
[2] Renmin Univ China, Ctr Appl Stat, Sch Stat, Zhongguancun St, Beijing 100872, Peoples R China
基金
中国国家自然科学基金;
关键词
Aspect-based sentiment analysis; BERT; Twin towers; End to end; Implicit target;
D O I
10.1016/j.eswa.2024.123713
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect-based sentiment analysis (ABSA) aims to conduct fine-grained sentiment analysis, necessitating the extraction of three key components: target entity, aspect category and sentiment polarity. These three components collectively form an integrated ABSA task known as TASD (Target-Aspect-Sentiment jointly Detection). Most of existing approaches on ABSA usually employ Recurrent neural networks(RNNs), Convolutional neural networks(CNNs) or pre-training models such as Bidirectional Encoder Representations from Transformers(BERT). However, they have some common weaknesses. First, most of the existing methods focus on one or two sub-tasks instead of triplet detection, thus they do not establish an end -to -end (training a complex learning system represented by a single model) ABSA model and cannot utilize the relevance of multiple ABSA sub-tasks during training. Second, they cannot achieve accuracy and efficiency simultaneously due to the coupling of context and given aspects. Third, they are poor in recognizing implicit targets. To tackle these limitations, this paper proposes a novel method named the Twin Towers End to End model (TTEE) to solve TASD task. It transforms complex TASD task into a simple end -to -end multi -task framework, simultaneously conducting target and aspect-sentiment detection. It builds twin towers system based on BERT or its updated versions to decouple context and given aspects, which can reduce redundant calculation to improve computational efficiency significantly. It offers great advantage to identify implicit target entity and its associated aspect-sentiment in the context without introducing extra model architecture. Experiments on three public datasets in different domains demonstrate that our approach not only achieves better performance on various evaluation metrics, but also has high efficiency in both training and inference phases, over a wide range of sample size and number of aspect categories.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Towards Generative Aspect-Based Sentiment Analysis
    Zhang, Wenxuan
    Li, Xin
    Deng, Yang
    Bing, Lidong
    Lam, Wai
    ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 2, 2021, : 504 - 510
  • [42] DRGCN Multitasking for Aspect-Based Sentiment Analysis
    Du, Mengyang
    Wang, Hongbin
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2025, 29 (02) : 268 - 276
  • [43] Aspect-Based Sentiment Analysis for User Reviews
    Du, Jinyang
    Zhang, Yin
    Ma, Xiao
    Wen, Haoyu
    Fortino, Giancarlo
    COGNITIVE COMPUTATION, 2021, 13 (05) : 1114 - 1127
  • [44] Investigating the Saliency of Sentiment Expressions in Aspect-Based Sentiment Analysis
    Wagner, Joachim
    Foster, Jennifer
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 12751 - 12769
  • [45] Data augmentation for aspect-based sentiment analysis
    Li, Guangmin
    Wang, Hui
    Ding, Yi
    Zhou, Kangan
    Yan, Xiaowei
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (01) : 125 - 133
  • [46] Sentence Compression for Aspect-Based Sentiment Analysis
    Che, Wanxiang
    Zhao, Yanyan
    Guo, Honglei
    Su, Zhong
    Liu, Ting
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (12) : 2111 - 2124
  • [47] A comprehensive survey on aspect-based sentiment analysis
    Yadav, Kaustubh
    Kumar, Neeraj
    Maddikunta, Praveen Kumar Reddy
    Gadekallu, Thippa Reddy
    INTERNATIONAL JOURNAL OF ENGINEERING SYSTEMS MODELLING AND SIMULATION, 2021, 12 (04) : 279 - 290
  • [48] Aspect-Based Sentiment Analysis for Service Industry
    Maroof, Afsheen
    Wasi, Shaukat
    Jami, Syed Imran
    Siddiqui, Muhammad Shoaib
    IEEE ACCESS, 2024, 12 : 109702 - 109713
  • [49] Aspect-based sentiment analysis with metaphorical information
    Tian H.
    Yu L.
    Tian S.
    Long J.
    Zhou T.
    Wang B.
    Li Y.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 8065 - 8074
  • [50] Attention-based Sentiment Reasoner for aspect-based sentiment analysis
    Liu, Ning
    Shen, Bo
    Zhang, Zhenjiang
    Zhang, Zhiyuan
    Mi, Kun
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2019, 9 (01)