Text Sentiment Analysis Based on Multi-Layer Bi-Directional LSTM with a Trapezoidal Structure

被引:5
|
作者
He, Zhengfang [1 ,2 ]
Dumdumaya, Cristina E. [2 ]
Machica, Ivy Kim D. [2 ]
机构
[1] Yunnan Technol & Business Univ, Sch Intelligent Sci & Engn, Kunming 650000, Peoples R China
[2] Univ Southeastern Philippines, Coll Informat & Comp, Davao, Davao Del Sur, Philippines
来源
关键词
Text sentiment; Bi-directional LSTM; Trapezoidal structure;
D O I
10.32604/iasc.2023.035352
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis, commonly called opinion mining or emotion artificial intelligence (AI), employs biometrics, computational linguistics, nat-ural language processing, and text analysis to systematically identify, extract, measure, and investigate affective states and subjective data. Sentiment analy-sis algorithms include emotion lexicon, traditional machine learning, and deep learning. In the text sentiment analysis algorithm based on a neural network, multi-layer Bi-directional long short-term memory (LSTM) is widely used, but the parameter amount of this model is too huge. Hence, this paper proposes a Bi-directional LSTM with a trapezoidal structure model. The design of the trapezoidal structure is derived from classic neural networks, such as LeNet-5 and AlexNet. These classic models have trapezoidal-like structures, and these structures have achieved success in the field of deep learning. There are two benefits to using the Bi-directional LSTM with a trapezoidal structure. One is that compared with the single-layer configuration, using the of the multi-layer structure can better extract the high-dimensional features of the text. Another is that using the trapezoidal structure can reduce the model's parameters. This paper introduces the Bi-directional LSTM with a trapezoidal structure model in detail and uses Stanford sentiment treebank 2 (STS-2) for experiments. It can be seen from the experimental results that the trapezoidal structure model and the normal structure model have similar performances. However, the trapezoidal structure model parameters are 35.75% less than the normal structure model.
引用
收藏
页码:639 / 654
页数:16
相关论文
共 50 条
  • [1] Sentiment Analysis of Text Based on CNN and Bi-directional LSTM Model
    Zhou, Kai
    Long, Fei
    2018 24TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC' 18), 2018, : 613 - 617
  • [2] Sentiment Analysis Based on Attention Mechanisms and Bi-directional LSTM Fusion Model
    Zhu, Yangyang
    Wang, Mei
    Liu, Shulin
    Song, Chunfeng
    Wang, Zheng
    Wang, Pai
    Qin, Xuebin
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 865 - 868
  • [3] Text multi-label sentiment analysis based on Bi-LSTM
    Hu, Junlin
    Kang, Xin
    Nishide, Shun
    Ren, Fuji
    PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 16 - 20
  • [4] Thermal prediction for energy management of clouds using a hybrid model based on CNN and stacking multi-layer bi-directional LSTM
    Tabrizchi, Hamed
    Razmara, Jafar
    Mosavi, Amir
    ENERGY REPORTS, 2023, 9 : 2253 - 2268
  • [5] StyleBERT: Text-audio sentiment analysis with Bi-directional Style Enhancement
    Lin, Fei
    Liu, Shengqiang
    Zhang, Cong
    Fan, Jin
    Wu, Zizhao
    INFORMATION SYSTEMS, 2023, 114
  • [6] Bi-directional LSTM–CNN Combined method for Sentiment Analysis in Part of Speech Tagging (PoS)
    N. K. Senthil Kumar
    N. Malarvizhi
    International Journal of Speech Technology, 2020, 23 : 373 - 380
  • [7] Short-Term Prediction of Residential Power Energy Consumption via CNN and Multi-Layer Bi-Directional LSTM Networks
    Ullah, Fath U. Min
    Ullah, Amin
    Ul Haq, Ijaz
    Rho, Seungmin
    Baik, Sung Wook
    IEEE ACCESS, 2020, 8 : 123369 - 123380
  • [8] Authorship Attribution on Kannada Text using Bi-Directional LSTM Technique
    Chandrika, C. P.
    Kallimani, Jagadish S.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (09) : 963 - 971
  • [9] Valence and Arousal-Infused Bi-Directional LSTM for Sentiment Analysis of Government Social Media Management
    Cheng, Yu-Ya
    Chen, Yan-Ming
    Yeh, Wen-Chao
    Chang, Yung-Chun
    APPLIED SCIENCES-BASEL, 2021, 11 (02): : 1 - 14
  • [10] Bi-directional LSTM-CNN Combined method for Sentiment Analysis in Part of Speech Tagging (PoS)
    Kumar, N. K. Senthil
    Malarvizhi, N.
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2020, 23 (02) : 373 - 380