A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:15
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [1] Reinforcement Learning Energy Management Strategy of Tram Based on Condition Identification
    Mo H.
    Yang Z.
    Lin F.
    Wang Y.
    An X.
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2021, 36 (19): : 4170 - 4182
  • [2] Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management
    Liu, Yuankun
    Zhang, Dongxia
    Gooi, Hoay Beng
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (03): : 572 - 582
  • [3] RESEARCH ON HEV ENERGY MANAGEMENT STRATEGY BASED ON IMPROVED DEEP REINFORCEMENT LEARNING
    Wu, Zhongqiang
    Ma, Boyan
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (12) : 8451 - 8468
  • [4] Hierarchical Optimization Strategy for Home Energy Management Based on Deep Reinforcement Learning
    Zhang, Tian
    Zhao, Qi
    Chen, Zhong
    Wang, Ruisheng
    Xing, Qiang
    Tian, Jiang
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2021, 45 (21): : 149 - 158
  • [5] Microgrid Energy Management Strategy Based on Hierarchical Federated Deep Reinforcement Learning
    Liu, Yiran
    Li, Haitao
    Xie, Dongxue
    2024 INTERNATIONAL CONFERENCE ON ELECTRONIC ENGINEERING AND INFORMATION SYSTEMS, EEISS 2024, 2024, : 7 - 12
  • [6] Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
    Hu, Yue
    Li, Weimin
    Xu, Kun
    Zahid, Taimoor
    Qin, Feiyan
    Li, Chenming
    APPLIED SCIENCES-BASEL, 2018, 8 (02):
  • [7] A novel interpretable decision rule extracting method for deep reinforcement learning-based energy management in building complexes
    Chen, Haiwen
    Guo, Wei
    Bao, Weiyu
    Cui, Mingjian
    Wang, Xiaoxue
    Zhao, Qianyu
    ENERGY AND BUILDINGS, 2025, 334
  • [8] Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle
    Lian, Renzong
    Peng, Jiankun
    Wu, Yuankai
    Tan, Huachun
    Zhang, Hailong
    ENERGY, 2020, 197
  • [9] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
    Lee, Seongwoo
    Seon, Joonho
    Sun, Young Ghyu
    Kim, Soo Hyun
    Kyeong, Chanuk
    Kim, Dong In
    Kim, Jin Young
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
  • [10] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45