An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

被引:37
|
作者
Liu, Qian [1 ]
Huang, Yanping [1 ]
Yang, Qian [1 ]
Peng, Hong [1 ]
Wang, Jun [2 ]
机构
[1] Xihua Univ, Sch Comp & Software Engn, Chengdu, Peoples R China
[2] Xihua Univ, Sch Elect Engn & Elect Informat, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Sentiment analysis; membrane computing; nonlinear spiking neural P systems; attention mechanism; LSTM-SNP model; P-SYSTEMS;
D O I
10.1142/S0129065723500375
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
LSTM-SNP model is a recently developed long short-term memory (LSTM) network, which is inspired from the mechanisms of spiking neural P (SNP) systems. In this paper, LSTM-SNP is utilized to propose a novel model for aspect-level sentiment analysis, termed as ALS model. The LSTM-SNP model has three gates: reset gate, consumption gate and generation gate. Moreover, attention mechanism is integrated with LSTM-SNP model. The ALS model can better capture the sentiment features in the text to compute the correlation between context and aspect words. To validate the effectiveness of the ALS model for aspect-level sentiment analysis, comparison experiments with 17 baseline models are conducted on three real-life data sets. The experimental results demonstrate that the ALS model has a simpler structure and can achieve better performance compared to these baseline models.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Comparison Performance of Long Short-Term Memory and Convolution Neural Network Variants on Online Learning Tweet Sentiment Analysis
    Ali, Muhammad Syamil
    Yusoff, Marina
    SOFT COMPUTING IN DATA SCIENCE, SCDS 2021, 2021, 1489 : 3 - 17
  • [42] A neural theory of visual attention and short-term memory (NTVA)
    Bundesen, Claus
    Habekost, Thomas
    Kyllingsbaek, Soren
    NEUROPSYCHOLOGIA, 2011, 49 (06) : 1446 - 1457
  • [43] Spike-Weighted Spiking Neural Network with Spiking Long Short-Term Memory: A Biomimetic Approach to Decoding Brain Signals
    Mcmillan, Kyle
    So, Rosa Qiyue
    Libedinsky, Camilo
    Ang, Kai Keng
    Premchand, Brian
    ALGORITHMS, 2024, 17 (04)
  • [44] Construction and improvement of English vocabulary learning model integrating spiking neural network and convolutional long short-term memory algorithm
    Wang, Yunxia
    PLOS ONE, 2024, 19 (03):
  • [45] Short-Term Traffic Prediction Using Long Short-Term Memory Neural Networks
    Abbas, Zainab
    Al-Shishtawy, Ahmad
    Girdzijauskas, Sarunas
    Vlassov, Vladimir
    2018 IEEE INTERNATIONAL CONGRESS ON BIG DATA (IEEE BIGDATA CONGRESS), 2018, : 57 - 65
  • [46] A review on the long short-term memory model
    Van Houdt, Greg
    Mosquera, Carlos
    Napoles, Gonzalo
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (08) : 5929 - 5955
  • [47] A review on the long short-term memory model
    Greg Van Houdt
    Carlos Mosquera
    Gonzalo Nápoles
    Artificial Intelligence Review, 2020, 53 : 5929 - 5955
  • [48] AN ATTENTION-AWARE BIDIRECTIONAL MULTI-RESIDUAL RECURRENT NEURAL NETWORK (ABMRNN): A STUDY ABOUT BETTER SHORT-TERM TEXT CLASSIFICATION
    Wang, Ye
    Wang, Han
    Zhang, Xinxiang
    Chaspari, Theodora
    Choe, Yoonsuck
    Lu, Mi
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3582 - 3586
  • [49] INDEPENDENCE OF SHORT-TERM AND LONG-TERM MEMORY - NEURAL SYSTEM-ANALYSIS
    KESNER, RP
    CONNER, HS
    SCIENCE, 1972, 176 (4033) : 432 - &
  • [50] Self-organized Short-Term Memory Mechanism in Spiking Neural Network
    Kiselev, Mikhail
    ADAPTIVE AND NATURAL COMPUTING ALGORITHMS, PT I, 2011, 6593 : 120 - 129