Longevity-aware energy management for fuel cell hybrid electric bus based on a novel proximal policy optimization deep reinforcement learning framework

被引:41
|
作者
Huang, Ruchen [1 ,2 ,3 ]
He, Hongwen [1 ,2 ,3 ]
Zhao, Xuyang [1 ,3 ]
Gao, Miaojue [1 ,3 ]
机构
[1] Beijing Inst Technol, Natl Engn Res Ctr Elect Vehicles, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Collaborat Innovat Ctr Elect Vehicles Beijing, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuel cell hybrid electric bus; Energy management strategy; Deep reinforcement learning; Proximal policy optimization (PPO); Multi-thread distributed computation; GRADIENT METHODS; PREDICTION; LIFETIME; GO;
D O I
10.1016/j.jpowsour.2023.232717
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
With the prosperity of artificial intelligence and new energy vehicles, energy-saving technologies for zero -emission fuel cell hybrid electric vehicles through high-efficient deep reinforcement learning algorithms have become a research focus. This article proposes an energy management strategy based on a novel deep rein-forcement learning framework to reduce the hydrogen consumption of a fuel cell hybrid electric bus while suppressing the degradation of the fuel cell. To begin, a novel proximal policy optimization framework is designed by taking advantage of multi-thread distributed computation, and then a promising energy manage-ment strategy based on this novel framework is proposed. Furthermore, the fuel cell degradation model is established and fuel cell longevity is incorporated into the optimization objective. Finally, the adaptability and computational efficiency of the proposed strategy are verified under the test cycle. Simulation results indicate that the proposed strategy improves the training efficiency effectively, and achieves efficient optimization of hydrogen conservation and fuel cell degradation suppression compared with the strategy based on the proximal policy optimization algorithm. This article contributes to energy conservation and lifespan extension for fuel cell vehicles through deep reinforcement learning methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Energy management strategy for fuel cell electric vehicles based on scalable reinforcement learning in novel environment
    Wang, Da
    Mei, Lei
    Xiao, Feng
    Song, Chuanxue
    Qi, Chunyang
    Song, Shixin
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 59 : 668 - 678
  • [42] Heuristic Energy Management Strategy of Hybrid Electric Vehicle Based on Deep Reinforcement Learning With Accelerated Gradient Optimization
    Du, Guodong
    Zou, Yuan
    Zhang, Xudong
    Guo, Lingxiong
    Guo, Ningyuan
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (04) : 2194 - 2208
  • [43] Deep reinforcement learning based energy management strategy for fuel cell/battery/supercapacitor powered electric vehicle
    Wang, Jie
    Zhou, Jianhao
    Zhao, Wanzhong
    GREEN ENERGY AND INTELLIGENT TRANSPORTATION, 2022, 1 (02):
  • [44] A Reinforcement Learning Based Dynamic Power Management for Fuel Cell Hybrid Electric Vehicle
    Hsu, Roy Chaoming
    Chen, Shi-Mao
    Chen, Wen-Yen
    Liu, Cheng-Ting
    2016 JOINT 8TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 17TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2016, : 460 - 464
  • [45] A Reinforcement Learning Based Dynamic Power Management for Fuel Cell Hybrid Electric Vehicle
    1600, Institute of Electrical and Electronics Engineers Inc., United States
  • [46] A proximal policy optimization based deep reinforcement learning framework for tracking control of a flexible robotic manipulator
    Kumar, V. Joshi
    Elumalai, Vinodh Kumar
    RESULTS IN ENGINEERING, 2025, 25
  • [47] Energy management for a power-split hybrid electric bus via deep reinforcement learning with terrain information
    Li, Yuecheng
    He, Hongwen
    Khajepour, Amir
    Wang, Hong
    Peng, Jiankun
    APPLIED ENERGY, 2019, 255
  • [48] Energy Management Strategy for Hybrid Electric Vehicle Based on the Deep Reinforcement Learning Method
    Chen Z.
    Fang Z.
    Yang R.
    Yu Q.
    Kang M.
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (23): : 6157 - 6168
  • [49] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [50] Benchmarking Deep Reinforcement Learning Based Energy Management Systems for Hybrid Electric Vehicles
    Wu Yuankai
    Lian Renzong
    Wang Yong
    Lin Yi
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT II, 2022, 13605 : 613 - 625