Development of improved reinforcement learning smart charging strategy for electric vehicle fleet

被引:24
|
作者
Sultanuddin, S. J. [1 ]
Vibin, R. [2 ]
Kumar, A. Rajesh [3 ]
Behera, Nihar Ranjan [4 ]
Pasha, M. Jahir [5 ]
Baseer, K. K. [6 ]
机构
[1] Measi Inst Informat Technol, Chennai, India
[2] CMS Coll Engn & Technol, Elect & Elect Engn, Coimbatore, Tamil Nadu, India
[3] NSN Coll Engn & Technol, Comp Sci & Engn, Karur, Tamil Nadu, India
[4] Swiss Sch Business & Management Geneva, Ave Morgines 12, CH-1213 Petit Lancy, Switzerland
[5] G Pullaiah Coll Engn & Technol, Dept Comp Sci & Engn, Kurnool, Andhra Pradesh, India
[6] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Sch Comp, Tirupati, Andhra Pradesh, India
关键词
Electric vehicle; Smart charging; Reinforcement learning; Power grid; Optimization;
D O I
10.1016/j.est.2023.106987
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to its environmental and energy sustainability, electric vehicles (EV) have emerged as the preferred option in the current transportation system. Uncontrolled EV charging, however, can raise consumers; charging costs and overwhelm the grid. Smart charging coordination systems are required to prevent the grid overload caused by charging too many electric vehicles at once. In light of the baseload that is present in the power grid, this research suggests an improved reinforcement learning charging management system. An optimization method, however, requires some knowledge in advance, such as the time the vehicle departs and how much energy it will need when it arrives at the charging station. Therefore, under realistic operating conditions, our improved Reinforcement Learning method with Double Deep Q-learning approach provides an adjustable, scalable, and flexible strategy for an electric car fleet. Our proposed approach provides fair value which solves the over-estimation action value problem in deep Q-learning. Then, a number of different charging strategies are compared to the Reinforcement Learning algorithm. The proposed Reinforcement Learning technique minimizes the variance of the overall load by 68 % when compared to an uncontrolled charging strategy.
引用
收藏
页数:9
相关论文
共 50 条
  • [11] Power Dispatching Strategy of Electric Vehicle Charging Station Based on Reinforcement Learning and Heuristic Priority
    An, Dou
    Zhang, Teng
    2023 5TH ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM, AEEES, 2023, : 1241 - 1246
  • [12] Dynamic pricing based electric vehicle charging station location strategy using reinforcement learning
    Li, Yanbin
    Wang, Jiani
    Wang, Weiye
    Liu, Chang
    Li, Yun
    ENERGY, 2023, 281
  • [13] Smart Electric Vehicle Charging
    Leeks H.
    ITNOW, 2019, 61 (04) : 12 - 13
  • [14] Charging an Electric Vehicle-Sharing Fleet
    He, Long
    Ma, Guangrui
    Qi, Wei
    Wang, Xin
    M&SOM-MANUFACTURING & SERVICE OPERATIONS MANAGEMENT, 2021, 23 (02) : 471 - 487
  • [15] Charging Control of an Electric Vehicle Battery Based on Reinforcement Learning
    Chang, Fangyuan
    Chen, Tao
    Su, Wencong
    Alsafasfeh, Qais
    2019 10TH INTERNATIONAL RENEWABLE ENERGY CONGRESS (IREC), 2019,
  • [16] Electric Vehicle Charging Management Based on Deep Reinforcement Learning
    Li, Sichen
    Hu, Weihao
    Cao, Di
    Dragicevic, Tomislav
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2022, 10 (03) : 719 - 730
  • [17] Electric Vehicle Optimal Charging Algorithm using Reinforcement Learning
    Kumar, Alok
    Kelkar, Atul
    2024 10TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, CONTROL AND ROBOTICS, EECR 2024, 2024, : 420 - 424
  • [18] Reinforcement learning for electric vehicle charging scheduling: A systematic review
    Zhao, Zhonghao
    Lee, Carman K. M.
    Yan, Xiaoyuan
    Wang, Haonan
    TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2024, 190
  • [19] Electric Vehicle Charging Management Based on Deep Reinforcement Learning
    Sichen Li
    Weihao Hu
    Di Cao
    Tomislav Dragi?evi?
    Qi Huang
    Zhe Chen
    Frede Blaabjerg
    Journal of Modern Power Systems and Clean Energy, 2022, 10 (03) : 719 - 730
  • [20] Coordination of Electric Vehicle Charging Through Multiagent Reinforcement Learning
    Da Silva, Felipe Leno
    Nishida, Cyntia E. H.
    Roijers, Diederik M.
    Costa, Anna H. Reali
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) : 2347 - 2356