Text Sentiment Analysis Based on Multi-Layer Bi-Directional LSTM with a Trapezoidal Structure

被引:5
|
作者
He, Zhengfang [1 ,2 ]
Dumdumaya, Cristina E. [2 ]
Machica, Ivy Kim D. [2 ]
机构
[1] Yunnan Technol & Business Univ, Sch Intelligent Sci & Engn, Kunming 650000, Peoples R China
[2] Univ Southeastern Philippines, Coll Informat & Comp, Davao, Davao Del Sur, Philippines
来源
关键词
Text sentiment; Bi-directional LSTM; Trapezoidal structure;
D O I
10.32604/iasc.2023.035352
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis, commonly called opinion mining or emotion artificial intelligence (AI), employs biometrics, computational linguistics, nat-ural language processing, and text analysis to systematically identify, extract, measure, and investigate affective states and subjective data. Sentiment analy-sis algorithms include emotion lexicon, traditional machine learning, and deep learning. In the text sentiment analysis algorithm based on a neural network, multi-layer Bi-directional long short-term memory (LSTM) is widely used, but the parameter amount of this model is too huge. Hence, this paper proposes a Bi-directional LSTM with a trapezoidal structure model. The design of the trapezoidal structure is derived from classic neural networks, such as LeNet-5 and AlexNet. These classic models have trapezoidal-like structures, and these structures have achieved success in the field of deep learning. There are two benefits to using the Bi-directional LSTM with a trapezoidal structure. One is that compared with the single-layer configuration, using the of the multi-layer structure can better extract the high-dimensional features of the text. Another is that using the trapezoidal structure can reduce the model's parameters. This paper introduces the Bi-directional LSTM with a trapezoidal structure model in detail and uses Stanford sentiment treebank 2 (STS-2) for experiments. It can be seen from the experimental results that the trapezoidal structure model and the normal structure model have similar performances. However, the trapezoidal structure model parameters are 35.75% less than the normal structure model.
引用
收藏
页码:639 / 654
页数:16
相关论文
共 50 条
  • [31] Signal Restoration based on Bi-directional LSTM with Spectral Filtering for Robot Audition
    Taniguchi, Ryosuke
    Hoshiba, Kotaro
    Itoyama, Katsutoshi
    Nishida, Kenji
    Nakadai, Kazuhiro
    2018 27TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2018), 2018, : 955 - 960
  • [32] An Optimized Multi-Layer Ensemble Framework for Sentiment Analysis
    Hung, Po Lai
    Rayner, Alfred
    2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA SCIENCES (AIDAS2019), 2019, : 158 - 163
  • [33] Sensitive Information Detection based on Convolution Neural Network and Bi-directional LSTM
    Lin, Yan
    Xu, Guosheng
    Xu, Guoai
    Chen, Yudong
    Sun, Dawei
    2020 IEEE 19TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2020), 2020, : 1614 - 1621
  • [34] Chinese Relation Extraction with Bi-directional Context-Based Lattice LSTM
    Ding, Chengyi
    Wu, Lianwei
    Liu, Pusheng
    Wang, Linyong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023, 2023, 14119 : 54 - 65
  • [35] Intelligent irrigation scheduling scheme based on deep bi-directional LSTM technique
    R. Jenitha
    K. Rajesh
    International Journal of Environmental Science and Technology, 2024, 21 : 1905 - 1922
  • [36] Remaining Useful Life Prediction Based on a Bi-directional LSTM Neural Network
    Pan, Zhen
    Xu, Zhao
    Wang, Hongye
    Chi, Chengzhi
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 985 - 990
  • [37] Intelligent irrigation scheduling scheme based on deep bi-directional LSTM technique
    Jenitha, R.
    Rajesh, K.
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL SCIENCE AND TECHNOLOGY, 2024, 21 (02) : 1905 - 1922
  • [38] A Novel Sentence Vector Generation Method Based on Autoencoder and Bi-directional LSTM
    Fukuda, Kiyohito
    Mori, Naoki
    Matsumoto, Keinosuke
    DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE, 2019, 800 : 128 - 135
  • [39] Exploiting bi-directional deep neural networks for multi-domain sentiment analysis using capsule network
    Ghorbanali, Alireza
    Sohrabi, Mohammad Karim
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (15) : 22943 - 22960
  • [40] Exploiting bi-directional deep neural networks for multi-domain sentiment analysis using capsule network
    Alireza Ghorbanali
    Mohammad Karim Sohrabi
    Multimedia Tools and Applications, 2023, 82 : 22943 - 22960