Twin Towers End to End model for aspect-based sentiment analysis

被引:2
|
作者
Li, Ziliang [1 ]
Song, Yuqian [1 ]
Lu, Xiaoling [2 ]
Liu, Miao [1 ]
机构
[1] Cent Univ Finance & Econ, Sch Stat & Math, Shahe Campus, Beijing 102206, Peoples R China
[2] Renmin Univ China, Ctr Appl Stat, Sch Stat, Zhongguancun St, Beijing 100872, Peoples R China
基金
中国国家自然科学基金;
关键词
Aspect-based sentiment analysis; BERT; Twin towers; End to end; Implicit target;
D O I
10.1016/j.eswa.2024.123713
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect-based sentiment analysis (ABSA) aims to conduct fine-grained sentiment analysis, necessitating the extraction of three key components: target entity, aspect category and sentiment polarity. These three components collectively form an integrated ABSA task known as TASD (Target-Aspect-Sentiment jointly Detection). Most of existing approaches on ABSA usually employ Recurrent neural networks(RNNs), Convolutional neural networks(CNNs) or pre-training models such as Bidirectional Encoder Representations from Transformers(BERT). However, they have some common weaknesses. First, most of the existing methods focus on one or two sub-tasks instead of triplet detection, thus they do not establish an end -to -end (training a complex learning system represented by a single model) ABSA model and cannot utilize the relevance of multiple ABSA sub-tasks during training. Second, they cannot achieve accuracy and efficiency simultaneously due to the coupling of context and given aspects. Third, they are poor in recognizing implicit targets. To tackle these limitations, this paper proposes a novel method named the Twin Towers End to End model (TTEE) to solve TASD task. It transforms complex TASD task into a simple end -to -end multi -task framework, simultaneously conducting target and aspect-sentiment detection. It builds twin towers system based on BERT or its updated versions to decouple context and given aspects, which can reduce redundant calculation to improve computational efficiency significantly. It offers great advantage to identify implicit target entity and its associated aspect-sentiment in the context without introducing extra model architecture. Experiments on three public datasets in different domains demonstrate that our approach not only achieves better performance on various evaluation metrics, but also has high efficiency in both training and inference phases, over a wide range of sample size and number of aspect categories.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Enhancing Arabic Aspect-Based Sentiment Analysis Using End-to-End Model
    Shafiq, Ghada M.
    Hamza, Taher
    Alrahmawy, Mohammed F.
    El-Deeb, Reem
    IEEE ACCESS, 2023, 11 : 142062 - 142076
  • [2] A Novel Cascade Model for End-to-End Aspect-Based Social Comment Sentiment Analysis
    Ding, Hengbing
    Huang, Shan
    Jin, Weiqiang
    Shan, Yuan
    Yu, Hang
    ELECTRONICS, 2022, 11 (12)
  • [3] A hierarchical and parallel framework for End-to-End Aspect-based Sentiment Analysis
    Xiao, Ding
    Ren, Feiyang
    Pang, Xiaoxuan
    Cai, Ming
    Wang, Qianyu
    He, Ming
    Peng, Jiawei
    Fu, Hao
    NEUROCOMPUTING, 2021, 465 : 549 - 560
  • [4] End-to-end Aspect-based Sentiment Analysis with Combinatory Categorial Grammar
    Tian, Yuanhe
    Chen, Weidong
    Hu, Bo
    Song, Yan
    Xia, Fei
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 13597 - 13609
  • [5] Block-level dependency syntax based model for end-to-end aspect-based sentiment analysis
    Xiang, Yan
    Zhang, Jiqun
    Guo, Junjun
    NEURAL NETWORKS, 2023, 166 : 225 - 235
  • [6] An Interactive Learning Network That Maintains Sentiment Consistency in End-to-End Aspect-Based Sentiment Analysis
    Chen, Musheng
    Hua, Qingrong
    Mao, Yaojun
    Wu, Junhua
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [7] Joint Aspect and Polarity Classification for Aspect-based Sentiment Analysis with End-to-End Neural Networks
    Schmitt, Martin
    Steinheber, Simon
    Schreiber, Konrad
    Roth, Benjamin
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 1109 - 1114
  • [8] A Multitask Multiview Neural Network for End-to-End Aspect-Based Sentiment Analysis
    Bie, Yong
    Yang, Yan
    BIG DATA MINING AND ANALYTICS, 2021, 4 (03) : 195 - 207
  • [9] A Multitask Multiview Neural Network for End-to-End Aspect-Based Sentiment Analysis
    Yong Bie
    Yan Yang
    Big Data Mining and Analytics, 2021, 4 (03) : 195 - 207
  • [10] Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning
    Li, Zheng
    Li, Xin
    Wei, Ying
    Bing, Lidong
    Zhang, Yu
    Yang, Qiang
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 4590 - 4600