Energy Management Strategy for Optimal Charge Depletion of Plug-In FCHEV Based on Multiconstrained Deep Reinforcement Learning

被引:0
|
作者
Wang, Haocong [1 ]
Wang, Xiaomin [1 ,2 ]
Fu, Zhumu [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Sichuan, Peoples R China
[2] Sichuan Prov Engn Res Ctr Train Operat Control Tec, Chengdu 611756, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471000, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Degradation; Batteries; Fuel cells; Supercapacitors; Hydrogen; Hybrid electric vehicles; Data-driven; energy management strategy (EMS); optimal charge depletion; plug-in fuel cell hybrid electric vehicle (P-FCHEV); twin delayed deep deterministic policy gradient (TD3); HYBRID ELECTRIC VEHICLES; TRACKED VEHICLE; FUEL-ECONOMY; OPTIMIZATION; MINIMIZATION; STATE;
D O I
10.1109/TTE.2024.3400020
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The energy management strategy (EMS) of plug-in fuel cell hybrid electric vehicles (P-FCHEVs) is studied in this article. Deep reinforcement learning (DRL) is a data-driven method that plays a crucial role in improving battery state of charge (SoC) maintenance and fuel economy and extending fuel cell (FC) lifespan. However, existing methods struggle to balance optimal charge depletion and energy savings. This article proposes a multiconstrained DRL-based EMS. Specifically, an energy management hierarchical framework is built by merging twin delayed deep deterministic policy gradient (TD3) with adaptive fuzzy control filtering. Then, a high-performance exploration technique is designed to accelerate the search for the optimal action, and a multiobjective adaptive penalty function based on the equivalent consumption minimization is constructed to balance fuel economy, battery power maintenance, and energy degradation. Finally, the charge depletion method is developed based on the SoC change prediction. Simulation results show that compared with the baseline TD3, the proposed EMS can reduce the FC degradation rate by 10.49%, improve the SoC maintenance, and above 95% global optimum of the DP method. Furthermore, the average deviation from the terminal SoC is 1.92% under various scenarios, confirming that the proposed EMS can precisely achieve the optimal charge depletion.
引用
收藏
页码:1077 / 1090
页数:14
相关论文
共 50 条
  • [31] Sub-optimal Energy Management Strategy for Plug-in Hybrid Electric Vehicles
    Wu J.
    Yan B.
    Fang J.
    Wang X.
    Xie Z.
    Shi Y.
    Li L.
    Zhongguo Jixie Gongcheng/China Mechanical Engineering, 2019, 30 (11): : 1336 - 1342
  • [32] Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management
    Liu, Yuankun
    Zhang, Dongxia
    Gooi, Hoay Beng
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (03): : 572 - 582
  • [33] Real-time Autonomous Optimal Energy Management Strategy for Residents Based on Deep Reinforcement Learning
    Ye, Yujian
    Wang, Huiyu
    Tang, Yi
    Strbac, Goran
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (01): : 110 - 119
  • [34] Multiconstrained Gliding Guidance Based on Optimal and Reinforcement Learning Method
    Zhe, Luo
    Xinsan, Li
    Lixin, Wang
    Qiang, Shen
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [35] Learning Based Energy Management Strategy Offline Trainers Comparison for Plug-in Hybrid Electric Buses
    Ander Lopez-Ibarra, Jon
    Gaztanaga, Haizea
    Todorov, Yancho
    Pihlatie, Mikko
    2020 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2020,
  • [36] Optimization Feedback Control Strategy Based ECMS for Plug-in FCHEV Considering Fuel Cell Decay
    Lin X.-Y.
    Li X.-F.
    Lin H.-B.
    Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2019, 32 (05): : 153 - 161
  • [37] Optimal Energy Management Strategy of a Plug-in Hybrid Electric Vehicle Based on a Particle Swarm Optimization Algorithm
    Chen, Zeyu
    Xiong, Rui
    Wang, Kunyu
    Jiao, Bin
    ENERGIES, 2015, 8 (05): : 3661 - 3678
  • [38] A real time energy management strategy for plug-in hybrid electric vehicles based on optimal control theory
    Tribioli, Laura
    Barbieri, Michele
    Capata, Roberto
    Sciubba, Enrico
    Jannelli, Elio
    Bella, Gino
    ATI 2013 - 68TH CONFERENCE OF THE ITALIAN THERMAL MACHINES ENGINEERING ASSOCIATION, 2014, 45 : 949 - 958
  • [39] Quadruple Deep Q-Network-Based Energy Management Strategy for Plug-In Hybrid Electric Vehicles
    Guo, Dingyi
    Lei, Guangyin
    Zhao, Huichao
    Yang, Fang
    Zhang, Qiang
    ENERGIES, 2024, 17 (24)
  • [40] Plug-in hybrid electric vehicle energy management strategy
    Zhang, Bo
    Zheng, Heyue
    Wang, Cheng
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2011, 47 (06): : 113 - 120