Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework

被引:6
|
作者
Huang, Xuejin [1 ]
Zhang, Jingyi [2 ]
Ou, Kai [3 ]
Huang, Yin [1 ]
Kang, Zehao [1 ]
Mao, Xuping [1 ]
Zhou, Yujie [1 ]
Xuan, Dongji [1 ]
机构
[1] Wenzhou Univ, Coll Mech & Elect Engn, Wenzhou, Peoples R China
[2] Chongqing Jinkang Powertrain New Energy Co Ltd, Chongqing 400000, Peoples R China
[3] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
关键词
Fuel cell hybrid electric vehicle; Energy management strategy; Energy source aging; Model predictive control framework; Bi-directional long short-term memory network; Model-based deep reinforcement learning; STRATEGY; LIFETIME; BUS;
D O I
10.1016/j.energy.2024.131769
中图分类号
O414.1 [热力学];
学科分类号
摘要
The main contribution of this study is to introduce deep reinforcement learning (DRL) within the model prediction control (MPC) framework, and consider comprehensive economic objectives including fuel cell degradation costs, lithium battery aging costs, hydrogen consumption costs, etc. This approach successfully mitigated the inherent shortcomings of deep reinforcement learning, namely poor generalization and lack of adaptability, thereby significantly enhancing the robustness of economic driving decision in unknown scenarios. In this study, an MPC framework was developed for the energy management problem of fuel cell vehicles, and Bi-directional Long Short-Term Memory (Bi-LSTM) neural network was used to construct a vehicle speed predictor The accuracy of its prediction was verified through comparative analysis, and then it was regarded as a DRL model. Different from the overall strategy of the entire driving cycle, the model based DRL agent can learn the optimal action for each vehicle state. The simulation evaluated the impact of different predictors and prediction ranges on hydrogen economy, and verified the adaptability of the proposed strategy in different driving environments, the stability of battery state maintenance, and the advantages of delaying energy system degradation through comprehensive comparative analysis.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [22] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [23] Efficient training for energy management in fuel cell hybrid electric vehicles: An imitation learning-embedded deep reinforcement learning framework
    Peng, Jiankun
    Ren, Tinghui
    Chen, Zhijun
    Chen, Weiqi
    Wu, Changcheng
    Ma, Chunye
    JOURNAL OF CLEANER PRODUCTION, 2024, 447
  • [24] Customized Energy Management for Fuel Cell Electric Vehicle Based on Deep Reinforcement Learning-Model Predictive Control Self-Regulation Framework
    Quan, Shengwei
    He, Hongwen
    Wei, Zhongbao
    Chen, Jinzhou
    Zhang, Zhendong
    Wang, Ya-Xiong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (12) : 13776 - 13785
  • [25] Health-conscious energy management strategy for battery/fuel cell electric vehicles considering power sources dynamics
    Oubelaid, Adel
    Khosravi, Nima
    Belkhier, Youcef
    Taib, Nabil
    Rekioua, Toufik
    JOURNAL OF ENERGY STORAGE, 2023, 68
  • [26] Learning-Based Model Predictive Control for the Energy Management of Hybrid Electric Vehicles Including Driving Mode Decisions
    Machacek, David Theodor
    van Dooren, Stijn
    Huber, Thomas
    Onder, Christopher Harald
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5113 - 5127
  • [27] A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles
    Xu, Jingyi
    Li, Zirui
    Gao, Li
    Ma, Junyi
    Liu, Qi
    Zhao, Yanan
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 470 - 477
  • [28] Visual Detection and Deep Reinforcement Learning-Based Car Following and Energy Management for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Yang, Kai
    Toyoda, Mitsuru
    Liu, Teng
    Hu, Xiaosong
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (02) : 2501 - 2515
  • [29] Battery longevity-conscious energy management predictive control strategy optimized by using deep reinforcement learning algorithm for a fuel cell hybrid electric vehicle
    Ren, Xiaoxia
    Ye, Jinze
    Xie, Liping
    Lin, Xinyou
    ENERGY, 2024, 286
  • [30] Fast Learning-based Control for Energy Management of Hybrid Electric Vehicles
    Liu, Teng
    Du, Guodong
    Zou, Yuan
    Cao, Dongpu
    IFAC PAPERSONLINE, 2018, 51 (31): : 595 - 600