Method for Automatically Generating Online Comments

被引:0
|
作者
Liu X. [1 ,2 ]
Xu Y. [1 ,2 ]
Li J. [3 ]
机构
[1] Beijing Key Laboratory of Network Culture and Digital Communication, Beijing University of Information Science and Technology, Beijing
[2] School of Computer Science, Beijing University of Information Science and Technology, Beijing
[3] School of Humanities and Education, Beijing Open University, Beijing
基金
中国国家自然科学基金;
关键词
Seq2Seq; SeqGAN; Social Network Comment Posts; TCN;
D O I
10.11925/infotech.2096-3467.2022.0379
中图分类号
学科分类号
摘要
[Objective] This paper proposes a Temporal Sequence Generative Adversarial Network (T-SeqGAN) automatically generating online comments, aiming to counteract malicious information on social networks and guide the correct direction of public opinion. [Methods] First, we modified the Sequence Generative Adversarial Network (SeqGAN) generator to a Seq2Seq structure. Then, we used the bidirectional gated recurrent unit (BiGRU) and the sequential convolutional neural network (TCN) as the skeleton network of the encoder and decoder, respectively. Next, we improved the similarity of the syntactic structure and semantic features between the generated posts and the real online comments. Finally, we modified the discriminator of SeqGAN to a model combing TCN and attention mechanism layers to improve the fluency of generated posts. [Results] Compared with the baseline model, the comments generated by the proposed model have significantly higher BLEU-2 (0.799 35), BLEU-3(0.603 96), BLEU-4(0.476 42), and KenLM (-27.670 29)metrics, as well as lower PPL (0.752 47) metrics. [Limitations] The vocabulary and language style of the generated posts are limited by actual posts, and the applicability of our method is limited. [Conclusions] The comments generated by the proposed model have higher syntactic and grammatical correctness and higher similarity to the real-world ones, which can guide the correct direction of public opinion on social networks. © 2023 Data Analysis and Knowledge Discovery. All rights reserved.
引用
收藏
页码:101 / 113
页数:12
相关论文
共 32 条
  • [21] Gao Wei, Ma Hui, Li Dazhou, Et al., Research and Implementation of Chinese Text Abstract Technology Based on Double Encoder, Computer Engineering and Design, 42, 9, pp. 2687-2695, (2021)
  • [22] Cao D, Huang Y J, Fu Y B., Text Sentiment Analysis Based on Parallel TCN Model and Attention Model, Proceedings of the 2nd Symposium on Signal Processing Systems, pp. 86-90, (2020)
  • [23] Zou Zhi, Wu Tiezhou, Zhang Xiaoxing, Et al., Short-Term Load Forecast Based on Bayesian Optimized CNN-BiGRU Hybrid Neural Networks, High Voltage Engineering, 48, 10, pp. 3935-3945, (2022)
  • [24] Duan Mingjun, Research on Chinese Text Generation Based on Generative Adversarial Networks, (2021)
  • [25] Papineni K, Roukos S, Ward T, Et al., BLEU: A Method for Automatic Evaluation of Machine Translation, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 311-318, (2002)
  • [26] He Tianwen, Wang Hong, Evaluating Perplexity of Chinese Sentences Based on Grammar & Semantics Analysis, Application Research of Computers, 34, 12, pp. 3538-3542, (2017)
  • [27] Heafield K., KenLM: Faster and Smaller Language Model Queries [C], Proceedings of the 6th Workshop on Statistical Machine Translation, pp. 187-197, (2011)
  • [28] Sutskever I, Vinyals O, Le Q V., Sequence to Sequence Learning with Neural Networks[OL]
  • [29] Gehring J, Auli M, Grangier D, Et al., Convolutional Sequence to Sequence Learning, Proceedings of the 34th International Conference on Machine Learning, pp. 1243-1252, (2017)
  • [30] Lai S W, Xu L H, Liu K, Et al., Recurrent Convolutional Neural Networks for Text Classification[C], Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2267-2273, (2015)