Offline reinforcement learning based feeding strategy of ethylene cracking furnace

被引:0
|
作者
Zhong, Haojun [1 ]
Wang, Zhenlei [1 ]
Hao, Yuzhe [1 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
Offline reinforcement learning; Twin delayed deep deterministic behavioral cloning; Operation optimization; Ethylene cracking furnace; OPTIMIZATION; SYSTEM;
D O I
10.1016/j.compchemeng.2024.108864
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The feeding process of the ethylene cracking furnace necessitates the synchronized adjustment of multiple controlled factors. The process mainly relies on operators to do it manually, which is burdensome and may lead to significant variations in coil out temperature (COT) due to the differing expertise of operators. This paper proposes a method for learning the feeding strategy of the ethylene cracking furnace using offline reinforcement learning. The agent learns and optimizes the operating strategy directly from datasets, eliminating the need for sophisticated process simulator modeling. In addition, the advantage function is incorporated into the Twin Delayed Deep Deterministic Behavioral Cloning (TD3BC) algorithm, which enables the agent to acquire more effective operational experience. The proposed method is initially evaluated using benchmark datasets. Further, the proposed method is validated through comparative experiments on a feeding process validation model, demonstrating superior rewards and outperforming manual operating experience as well as other offline reinforcement learning methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Supply responsive scheduling for ethylene cracking furnace systems based on deep reinforcement learning
    Li, Haoran
    Qiu, Tong
    AICHE JOURNAL, 2024, 70 (12)
  • [2] Operation optimization of ethylene cracking furnace based on improved deep reinforcement learning algorithm
    Zhu C.
    Wang Z.
    Huagong Xuebao/CIESC Journal, 2023, 74 (08): : 3429 - 3437
  • [3] Sample strategy based on TD-error for offline reinforcement learning
    Zhang L.
    Feng Y.
    Liang X.
    Liu S.
    Cheng G.
    Huang J.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2023, 45 (12): : 2118 - 2128
  • [4] A Review of Offline Reinforcement Learning Based on Representation Learning
    Wang X.-S.
    Wang R.-R.
    Cheng Y.-H.
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (06): : 1104 - 1128
  • [5] Charging scheduling strategy for electric vehicles in residential areas based on offline reinforcement learning
    Jia, Runda
    Pan, Hengxin
    Zhang, Shulei
    Hu, Yao
    JOURNAL OF ENERGY STORAGE, 2024, 103
  • [6] The research of recognition of peep door open state of ethylene cracking furnace based on deep learning
    Li, Qirui
    Zhang, Baikun
    Cui, Delong
    Peng, Zhiping
    He, Jieguang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (04) : 3472 - 3486
  • [7] Cyclic scheduling for an ethylene cracking furnace system using diversity learning teaching-learning-based optimization
    Yu, Kunjie
    While, Lyndon
    Reynolds, Mark
    Wang, Xin
    Wang, Zhenlei
    COMPUTERS & CHEMICAL ENGINEERING, 2017, 99 : 314 - 324
  • [8] Operation Optimization of Ethylene Cracking Furnace based on NNIA Algorithm
    Geng, Zhiqiang
    Wang, Qiuyi
    Han, Yongming
    Yu, Jie
    Xie, Feng
    Chen, Kai
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 500 - 504
  • [9] Analysis of ethylene cracking furnace tubes
    Khodamorad, S. H.
    Fatmehsari, D. Haghshenas
    Rezaie, H.
    Sadeghipour, A.
    ENGINEERING FAILURE ANALYSIS, 2012, 21 : 1 - 8
  • [10] ALLOYS FOR ETHYLENE CRACKING FURNACE TUBES
    MACNAB, AJ
    HYDROCARBON PROCESSING, 1987, 66 (12): : 43 - 45