A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:15
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [41] Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Liu, Teng
    Qin, Yechen
    Cao, Dongpu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 9922 - 9934
  • [42] An Energy Management Strategy for Hybrid Energy Storage System Based on Reinforcement Learning
    Wang, Yujie
    Li, Wenhuan
    Liu, Zeyan
    Li, Ling
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (03):
  • [43] Energy management strategy of a novel parallel electric-hydraulic hybrid electric vehicle based on deep reinforcement learning and entropy evaluation
    Zhang, Zhen
    Zhang, Tiezhu
    Hong, Jichao
    Zhang, Hongxin
    Yang, Jian
    JOURNAL OF CLEANER PRODUCTION, 2023, 403
  • [44] Deep Reinforcement Learning Based PHEV Energy Management With Co-Recognition for Traffic Condition and Driving Style
    Cui, Naxin
    Cui, Wei
    Shi, Yuemei
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (04): : 3026 - 3039
  • [45] Deep-Reinforcement-Learning-Based Energy Management Strategy for Supercapacitor Energy Storage Systems in Urban Rail Transit
    Yang, Zhongping
    Zhu, Feiqin
    Lin, Fei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (02) : 1150 - 1160
  • [46] Residential Energy Management with Deep Reinforcement Learning
    Wan, Zhiqiang
    Li, Hepeng
    He, Haibo
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [47] An Energy Management Strategy for Traction Substation with ESS Based on Reinforcement Learning
    Luo, Jiaming
    Wei, Xiaoguang
    Gao, Shibin
    Guo, Xiaoran
    Zhong, Tianbao
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION TECHNOLOGIES FOR RAIL TRANSPORTATION, EITRT 2023: ENERGY TRACTION TECHNOLOGY OF RAIL TRANSPORTATION, 2024, 1135 : 11 - 19
  • [48] An Energy Management Strategy for Hybrid Electric Bus Based on Reinforcement Learning
    Fang, Yuedong
    Song, Chunyue
    Xia, Bingwei
    Song, Qiuyin
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 5005 - 5009
  • [49] Online Microgrid Energy Management Based on Safe Deep Reinforcement Learning
    Li, Hepeng
    Wang, Zhenhua
    Li, Lusi
    He, Haibo
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [50] A Novel Adaptive Sampling Strategy for Deep Reinforcement Learning
    Liang, Xingxing
    Chen, Li
    Feng, Yanghe
    Liu, Zhong
    Ma, Yang
    Huang, Kuihua
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2021, 20 (02)