Longevity-aware energy management for fuel cell hybrid electric bus based on a novel proximal policy optimization deep reinforcement learning framework

被引:41
|
作者
Huang, Ruchen [1 ,2 ,3 ]
He, Hongwen [1 ,2 ,3 ]
Zhao, Xuyang [1 ,3 ]
Gao, Miaojue [1 ,3 ]
机构
[1] Beijing Inst Technol, Natl Engn Res Ctr Elect Vehicles, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Collaborat Innovat Ctr Elect Vehicles Beijing, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuel cell hybrid electric bus; Energy management strategy; Deep reinforcement learning; Proximal policy optimization (PPO); Multi-thread distributed computation; GRADIENT METHODS; PREDICTION; LIFETIME; GO;
D O I
10.1016/j.jpowsour.2023.232717
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
With the prosperity of artificial intelligence and new energy vehicles, energy-saving technologies for zero -emission fuel cell hybrid electric vehicles through high-efficient deep reinforcement learning algorithms have become a research focus. This article proposes an energy management strategy based on a novel deep rein-forcement learning framework to reduce the hydrogen consumption of a fuel cell hybrid electric bus while suppressing the degradation of the fuel cell. To begin, a novel proximal policy optimization framework is designed by taking advantage of multi-thread distributed computation, and then a promising energy manage-ment strategy based on this novel framework is proposed. Furthermore, the fuel cell degradation model is established and fuel cell longevity is incorporated into the optimization objective. Finally, the adaptability and computational efficiency of the proposed strategy are verified under the test cycle. Simulation results indicate that the proposed strategy improves the training efficiency effectively, and achieves efficient optimization of hydrogen conservation and fuel cell degradation suppression compared with the strategy based on the proximal policy optimization algorithm. This article contributes to energy conservation and lifespan extension for fuel cell vehicles through deep reinforcement learning methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Energy management with adaptive moving average filter and deep deterministic policy gradient reinforcement learning for fuel cell hybrid electric vehicles
    Zhao, Yinghua
    Huang, Siqi
    Wang, Xiaoyu
    Shi, Jingwu
    Yao, Shouwen
    ENERGY, 2024, 312
  • [22] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [23] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [24] Research on Energy Management of Hydrogen Fuel Cell Bus Based on Deep Reinforcement Learning Considering Velocity Control
    Shen, Yang
    Zhou, Jiaming
    Zhang, Jinming
    Yi, Fengyan
    Wang, Guofeng
    Pan, Chaofeng
    Guo, Wei
    Shu, Xing
    SUSTAINABILITY, 2023, 15 (16)
  • [25] An improved energy management strategy of fuel cell hybrid vehicles based on proximal policy optimization algorithm
    Li, Baomin
    Cui, Yunduan
    Xiao, Yao
    Fu, Shengxiang
    Choi, Jongwoo
    Zheng, Chunhua
    ENERGY, 2025, 317
  • [26] Longevity-conscious dimensioning and power management of the hybrid energy storage system in a fuel cell hybrid electric bus
    Hu, Xiaosong
    Johannesson, Lars
    Murgovski, Nikolce
    Egardt, Bo
    APPLIED ENERGY, 2015, 137 : 913 - 924
  • [27] Adaptive energy management strategy for FCHEV based on improved proximal policy optimization in deep reinforcement learning algorithm
    Lu, Xueqin
    Qian, Shenchen
    Zhai, Xinrui
    Wang, Peiyinquan
    Wu, Tao
    ENERGY CONVERSION AND MANAGEMENT, 2024, 321
  • [28] Optimizing fuel economy and durability of hybrid fuel cell electric vehicles using deep reinforcement learning-based energy management systems
    Hu, Haowen
    Yuan, Wei-Wei
    Su, Minghang
    Ou, Kai
    ENERGY CONVERSION AND MANAGEMENT, 2023, 291
  • [29] Optimal online energy management strategy of a fuel cell hybrid bus via reinforcement learning
    Deng, Pengyi
    Wu, Xiaohua
    Yang, Jialuo
    Yang, Gang
    Jiang, Ping
    Yang, Jibin
    Bian, Xiaolei
    ENERGY CONVERSION AND MANAGEMENT, 2024, 300
  • [30] Optimal online energy management strategy of a fuel cell hybrid bus via reinforcement learning
    Vehicle Measurement Control and Safety Key Laboratory of Sichuan Province, School of Automobile and Transportation, Xihua University, Chengdu
    610039, China
    不详
    610039, China
    不详
    611730, China
    不详
    41296, Sweden
    Energy Convers. Manage., 2024,