Driving-Behavior-Aware Optimal Energy Management Strategy for Multi-Source Fuel Cell Hybrid Electric Vehicles Based on Adaptive Soft Deep-Reinforcement Learning

被引:31
|
作者
Sun, Haochen [1 ]
Tao, Fazhan [2 ,3 ]
Fu, Zhumu [3 ,4 ]
Gao, Aiyun [5 ]
Jiao, Longyin [3 ,4 ]
机构
[1] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[2] Henan Univ Sci & Technol, Longmen Lab, Luoyang 471023, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[4] Henan Univ Sci & Technol, Henan Key Lab Robot & Intelligent Syst, Luoyang 471023, Peoples R China
[5] Henan Univ Sci & Technol, Coll Vehicle & Traff Engn, Luoyang 471023, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Behavioral sciences; Real-time systems; Support vector machines; Q-learning; Hybrid electric vehicles; Optimization; Deep reinforcement learning; energy management strategy; FCHEV; driving behavior recognition; adaptive soft learning; TIME POWER MANAGEMENT; CRUISE CONTROL; OPTIMIZATION; NETWORK; SYSTEM; MODEL;
D O I
10.1109/TITS.2022.3233564
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The majority of existing energy management strategies (EMSs), merely considering external driving conditions, often allocate demand power in an irrational way, resulting in a waste of energy and a short service life of power sources. Therefore, it is necessary to integrate driving behavior in EMS to reduce the fuel consumption and improve the lifespan of power sources. In this paper, a driving-behavior-aware adaptive deep-reinforcement-learning (DRL) based EMS is proposed for a three-power-source fuel cell hybrid electric vehicle (FCHEV). To fully utilize each power source, a hierarchical power splitting method is adopted by an adaptive fuzzy filter. Then, a high-performance driving behavior recognizer is employed, and Pontryagin's minimum principle (PMP) method is used to compute the optimal equivalent factor (EF) of each driving behavior. To realize a trade-off between global learning and real-time implementation, an improved multi-learning-space DRL-based algorithm, applying driving-behavior-aware adaptive equivalent consumption minimization strategy (A-ECMS) and soft learning mechanism, is proposed and verified by a series of simulations. Simulation results show that, compared with the benchmark method ECMS, the proposed P-DQL method can reduce the hydrogen consumption by 49.9% on average, and the total cost to use by 31.4% , showing a promising ability to increase fuel economy and reduce hydrogen consumption and the total cost to use of FCHEV.
引用
收藏
页码:4127 / 4146
页数:20
相关论文
共 50 条
  • [1] Deep stochastic reinforcement learning-based energy management strategy for fuel cell hybrid electric vehicles
    Jouda, Basel
    Al-Mahasneh, Ahmad Jobran
    Abu Mallouh, Mohammed
    ENERGY CONVERSION AND MANAGEMENT, 2024, 301
  • [2] A reinforcement learning energy management strategy for fuel cell hybrid electric vehicles considering driving condition classification
    Kang, Xu
    Wang, Yujie
    Chen, Zonghai
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2024, 38
  • [3] A collaborative energy management strategy based on multi-agent reinforcement learning for fuel cell hybrid electric vehicles
    Xiao, Yao
    Fu, Shengxiang
    Choi, Jongwoo
    Zheng, Chunhua
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [4] Reinforcement Learning based Energy Management for Fuel Cell Hybrid Electric Vehicles
    Guo, Liang
    Li, Zhongliang
    Outbib, Rachid
    IECON 2021 - 47TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2021,
  • [5] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [6] Adaptive deep reinforcement learning energy management for hybrid electric vehicles considering driving condition recognition
    Zhang, Dehai
    Li, Junhui
    Guo, Ningyuan
    Liu, Yonggang
    Shen, Shiquan
    Wei, Fuxing
    Chen, Zheng
    Zheng, Jia
    Energy, 2024, 313
  • [7] Deep reinforcement learning based energy management strategy of fuel cell hybrid railway vehicles considering fuel cell aging
    Deng, Kai
    Liu, Yingxu
    Hai, Di
    Peng, Hujun
    Löwenstein, Lars
    Pischinger, Stefan
    Hameyer, Kay
    Energy Conversion and Management, 2022, 251
  • [8] Deep reinforcement learning based energy management strategy of fuel cell hybrid railway vehicles considering fuel cell aging
    Deng, Kai
    Liu, Yingxu
    Hai, Di
    Peng, Hujun
    Lowenstein, Lars
    Pischinger, Stefan
    Hameyer, Kay
    ENERGY CONVERSION AND MANAGEMENT, 2022, 251
  • [9] Deep reinforcement learning based energy management strategy for range extend fuel cell hybrid electric vehicle
    Huang, Yin
    Hu, Haoqin
    Tan, Jiaqi
    Lu, Chenlei
    Xuan, Dongji
    ENERGY CONVERSION AND MANAGEMENT, 2023, 277
  • [10] Energy Management Strategy for Fuel Cell/Battery/Ultracapacitor Hybrid Electric Vehicles Using Deep Reinforcement Learning With Action Trimming
    Fu, Zhumu
    Wang, Haocong
    Tao, Fazhan
    Ji, Baofeng
    Dong, Yongsheng
    Song, Shuzhong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (07) : 7171 - 7185