Energy Management Strategy for Optimal Charge Depletion of Plug-In FCHEV Based on Multiconstrained Deep Reinforcement Learning

被引:0
|
作者
Wang, Haocong [1 ]
Wang, Xiaomin [1 ,2 ]
Fu, Zhumu [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Sichuan, Peoples R China
[2] Sichuan Prov Engn Res Ctr Train Operat Control Tec, Chengdu 611756, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471000, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Degradation; Batteries; Fuel cells; Supercapacitors; Hydrogen; Hybrid electric vehicles; Data-driven; energy management strategy (EMS); optimal charge depletion; plug-in fuel cell hybrid electric vehicle (P-FCHEV); twin delayed deep deterministic policy gradient (TD3); HYBRID ELECTRIC VEHICLES; TRACKED VEHICLE; FUEL-ECONOMY; OPTIMIZATION; MINIMIZATION; STATE;
D O I
10.1109/TTE.2024.3400020
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The energy management strategy (EMS) of plug-in fuel cell hybrid electric vehicles (P-FCHEVs) is studied in this article. Deep reinforcement learning (DRL) is a data-driven method that plays a crucial role in improving battery state of charge (SoC) maintenance and fuel economy and extending fuel cell (FC) lifespan. However, existing methods struggle to balance optimal charge depletion and energy savings. This article proposes a multiconstrained DRL-based EMS. Specifically, an energy management hierarchical framework is built by merging twin delayed deep deterministic policy gradient (TD3) with adaptive fuzzy control filtering. Then, a high-performance exploration technique is designed to accelerate the search for the optimal action, and a multiobjective adaptive penalty function based on the equivalent consumption minimization is constructed to balance fuel economy, battery power maintenance, and energy degradation. Finally, the charge depletion method is developed based on the SoC change prediction. Simulation results show that compared with the baseline TD3, the proposed EMS can reduce the FC degradation rate by 10.49%, improve the SoC maintenance, and above 95% global optimum of the DP method. Furthermore, the average deviation from the terminal SoC is 1.92% under various scenarios, confirming that the proposed EMS can precisely achieve the optimal charge depletion.
引用
收藏
页码:1077 / 1090
页数:14
相关论文
共 50 条
  • [1] Adaptive energy management strategy for FCHEV based on improved proximal policy optimization in deep reinforcement learning algorithm
    Lu, Xueqin
    Qian, Shenchen
    Zhai, Xinrui
    Wang, Peiyinquan
    Wu, Tao
    ENERGY CONVERSION AND MANAGEMENT, 2024, 321
  • [2] Intelligent Energy Management Strategy Based on an Improved Reinforcement Learning Algorithm With Exploration Factor for a Plug-in PHEV
    Lin, Xinyou
    Zhou, Kuncheng
    Mo, Liping
    Li, Hailin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8725 - 8735
  • [3] Energy management control strategy for plug-in fuel cell electric vehicle based on reinforcement learning algorithm
    Lin X.-Y.
    Xia Y.-T.
    Wei S.-S.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2019, 41 (10): : 1332 - 1341
  • [4] Optimal Control Strategy for Plug-in Electric Vehicles Based on Reinforcement Learning in Distribution Networks
    Ye, X. Z.
    Ji, T. Y.
    Li, M. S.
    Wu, Q. H.
    2018 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2018, : 1706 - 1711
  • [5] Energy management strategy of intelligent plug-in split hybrid electric vehicle based on deep reinforcement learning with optimized path planning algorithm
    Xiong, Shengguang
    Zhang, Yishi
    Wu, Chaozhong
    Chen, Zhijun
    Peng, Jiankun
    Zhang, Mingyang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2021, 235 (14) : 3287 - 3298
  • [6] Near-optimal energy management for plug-in hybrid fuel cell and battery propulsion using deep reinforcement learning
    Wu, Peng
    Partridge, Julius
    Anderlini, Enrico
    Liu, Yuanchang
    Bucknall, Richard
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2021, 46 (80) : 40022 - 40040
  • [7] A Deep Concurrent Learning-based Robust and Optimal Energy Management Strategy for Hybrid Energy Storage Systems in Plug-in Hybrid Electric Vehicles
    Mukherjee, Nilanjan
    Sarkar, Sudeshna
    2023 IEEE VEHICLE POWER AND PROPULSION CONFERENCE, VPPC, 2023,
  • [8] A Deep Reinforcement Learning-Based Energy Management Framework With Lagrangian Relaxation for Plug-In Hybrid Electric Vehicle
    Zhang, Hailong
    Peng, Jiankun
    Tan, Huachun
    Dong, Hanxuan
    Ding, Fan
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) : 1146 - 1160
  • [9] Energy management optimal strategy of FCHEV based on the Radau Pseudospectral method
    Liu Y.
    Chen Y.
    Li Z.
    Zhao K.
    International Journal of Vehicle Performance, 2021, 7 (3-4) : 303 - 323
  • [10] Extended-deep Q-network: A functional reinforcement learning-based energy management strategy for plug-in hybrid electric vehicles
    Mousa, Amr
    ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2023, 43