Temporospatial graph attention networks with applications for industrial dynamic soft sensor modeling

被引:0
|
作者
Zhang C. [1 ,2 ]
Chen Z. [1 ,2 ]
Jiang X. [1 ,2 ]
Ge Z. [1 ,2 ]
机构
[1] Department of Control Science and Engineering, Zhejiang University, Hangzhou
[2] State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou
关键词
dynamic process; graph attention networks; LSTM; soft sensor; temporospatial graph model;
D O I
10.1360/SST-2022-0480
中图分类号
学科分类号
摘要
Deep learning has found considerable application in soft sensor modeling due to its capacity for feature extraction and nonlinear fitting. However, deep learning models are black-box models, and explaining their predictive behavior and incorporating prior knowledge into the model pose considerable challenges. Such limitations hinder the applicability of deep learning models in actual industrial processes. In addition, industrial process data contain substantial process information and are highly nonlinear. They involve dynamic time series and reflect the trends of random variables over time. Therefore, the incorporation of dynamic process information into soft sensors is paramount. In this article, we propose temporospatial graph attention networks (TSGAT) for industrial dynamic soft sensor modeling. This model utilizes the graph attention network to introduce prior knowledge into the model and construct the observable nonlinear relationship among variables. The graph attention network can aggregate information to extract spatial features at each time step. The long short-term memory network is used to extract temporal features. The proposed method is verified through the high–low transformer process within a real-life ammonia synthesis process. The results demonstrate that the TSGAT can achieve high predictive accuracy and a capacity to incorporate prior knowledge into the model. © 2023 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:1163 / 1174
页数:11
相关论文
共 23 条
  • [1] Jiang Y, Yin S, Dong J, Et al., A review on soft sensors for monitoring, control, and optimization of industrial processes, IEEE Sens J, 21, pp. 12868-12881, (2020)
  • [2] Gokalp M O, Kayabay K, Akyol M A, Et al., Big data for industry 4.0: A conceptual framework, Proceedings of 2016 International Conference on Computational Science and Computational Intelligence (CSCI), pp. 431-434, (2016)
  • [3] Sun Q, Ge Z., A survey on deep learning for data-driven soft sensors, IEEE Trans Ind Inf, 17, pp. 5853-5866, (2021)
  • [4] Curreri F, Patane L, Xibilia M G., RNN- and LSTM-based soft sensors transferability for an industrial process, Sensors, 21, (2021)
  • [5] Feng L, Zhao C, Sun Y., Dual attention-based encoder–decoder: A customized sequence-to-sequence learning for soft sensor development, IEEE Trans Neural Netw Learn Syst, 32, pp. 3306-3317, (2020)
  • [6] Sun Q, Ge Z., Probabilistic sequential network for deep learning of complex process data and soft sensor application, IEEE Trans Ind Inf, 15, pp. 2700-2709, (2018)
  • [7] Zhang X, Ge Z., Automatic deep extraction of robust dynamic features for industrial big data modeling and soft sensor application, IEEE Trans Ind Inf, 16, pp. 4456-4467, (2019)
  • [8] Zhou J, Cui G, Hu S, Et al., Graph neural networks: A review of methods and applications, AI Open, 1, pp. 57-81, (2020)
  • [9] Huang Y, Zhang C, Yella J, Et al., Grassnet: Graph soft sensing neural networks, Proceedings of 2021 IEEE International Conference on Big Data, pp. 746-756, (2021)
  • [10] Wang P, Yin Y, Deng X, Et al., Semi-supervised echo state network with temporal–spatial graph regularization for dynamic soft sensor modeling of industrial processes, ISA Trans, 130, pp. 306-315, (2022)