A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:15
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [31] Integrating Renewable Energy in Agriculture: A Deep Reinforcement Learning-Based Approach
    Wahid, Abdul
    Faiud, Iias
    Mason, Karl
    MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2023, PT III, 2025, 2135 : 324 - 336
  • [32] A novel forecasting based scheduling method for household energy management system based on deep reinforcement learning
    Ren, Mifeng
    Liu, Xiangfei
    Yang, Zhile
    Zhang, Jianhua
    Guo, Yuanjun
    Jia, Yanbing
    SUSTAINABLE CITIES AND SOCIETY, 2022, 76
  • [33] Deep Reinforcement Learning Based Energy Management Strategy for Fuel Cell and Battery Powered Rail Vehicles
    Deng, Kai
    Hai, Di
    Peng, Hujun
    Loewenstein, Lars
    Hameyer, Kay
    2021 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2021,
  • [34] Deep Reinforcement Learning based Energy Management Strategy for Commercial Buildings Considering Comprehensive Comfort Levels
    Liang, Zheming
    Bian, Desong
    Xu, Chunlei
    Zhang, Xiaohu
    Shi, Di
    Wang, Zhiwei
    2020 52ND NORTH AMERICAN POWER SYMPOSIUM (NAPS), 2021,
  • [35] Deep reinforcement learning based energy storage management strategy considering prediction intervals of wind power
    Liu, Fang
    Liu, Qianyi
    Tao, Qing
    Huang, Yucong
    Li, Danyun
    Sidorov, Denis
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 145
  • [36] Deep Reinforcement Learning-Based Energy Management Strategy for Green Ships Considering Photovoltaic Uncertainty
    Zhao, Yunxiang
    Wen, Shuli
    Zhao, Qiang
    Zhang, Bing
    Huang, Yuqing
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2025, 13 (03)
  • [37] Real-time Autonomous Optimal Energy Management Strategy for Residents Based on Deep Reinforcement Learning
    Ye, Yujian
    Wang, Huiyu
    Tang, Yi
    Strbac, Goran
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (01): : 110 - 119
  • [38] Cloud Computing-based Parallel Deep Reinforcement Learning Energy Management Strategy for Connected PHEVs
    Sun, Tong
    Ma, Chao
    Li, Zechun
    Yang, Kun
    ENGINEERING LETTERS, 2024, 32 (06) : 1210 - 1220
  • [39] A Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicles in Connected Traffic Environment
    Li, Jie
    Wu, Xiaodong
    Hu, Sunan
    Fan, Jiawei
    IFAC PAPERSONLINE, 2021, 54 (10): : 150 - 156
  • [40] An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car
    Yang, Chao
    Lu, Zhexi
    Wang, Weida
    Wang, Muyao
    Zhao, Jing
    ENERGY, 2023, 280