Development of improved reinforcement learning smart charging strategy for electric vehicle fleet

被引:24
|
作者
Sultanuddin, S. J. [1 ]
Vibin, R. [2 ]
Kumar, A. Rajesh [3 ]
Behera, Nihar Ranjan [4 ]
Pasha, M. Jahir [5 ]
Baseer, K. K. [6 ]
机构
[1] Measi Inst Informat Technol, Chennai, India
[2] CMS Coll Engn & Technol, Elect & Elect Engn, Coimbatore, Tamil Nadu, India
[3] NSN Coll Engn & Technol, Comp Sci & Engn, Karur, Tamil Nadu, India
[4] Swiss Sch Business & Management Geneva, Ave Morgines 12, CH-1213 Petit Lancy, Switzerland
[5] G Pullaiah Coll Engn & Technol, Dept Comp Sci & Engn, Kurnool, Andhra Pradesh, India
[6] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Sch Comp, Tirupati, Andhra Pradesh, India
关键词
Electric vehicle; Smart charging; Reinforcement learning; Power grid; Optimization;
D O I
10.1016/j.est.2023.106987
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to its environmental and energy sustainability, electric vehicles (EV) have emerged as the preferred option in the current transportation system. Uncontrolled EV charging, however, can raise consumers; charging costs and overwhelm the grid. Smart charging coordination systems are required to prevent the grid overload caused by charging too many electric vehicles at once. In light of the baseload that is present in the power grid, this research suggests an improved reinforcement learning charging management system. An optimization method, however, requires some knowledge in advance, such as the time the vehicle departs and how much energy it will need when it arrives at the charging station. Therefore, under realistic operating conditions, our improved Reinforcement Learning method with Double Deep Q-learning approach provides an adjustable, scalable, and flexible strategy for an electric car fleet. Our proposed approach provides fair value which solves the over-estimation action value problem in deep Q-learning. Then, a number of different charging strategies are compared to the Reinforcement Learning algorithm. The proposed Reinforcement Learning technique minimizes the variance of the overall load by 68 % when compared to an uncontrolled charging strategy.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement Learning
    Tuchnitz, Felix
    Ebell, Niklas
    Schlund, Jonas
    Pruckner, Marco
    APPLIED ENERGY, 2021, 285
  • [2] A Bilevel Graph Reinforcement Learning Method for Electric Vehicle Fleet Charging Guidance
    Xing, Qiang
    Xu, Yan
    Chen, Zhong
    IEEE TRANSACTIONS ON SMART GRID, 2023, 14 (04) : 3309 - 3312
  • [3] Smart Charging Strategy for Electric Vehicle Charging Stations
    Moghaddam, Zeinab
    Ahmad, Iftekhar
    Habibi, Daryoush
    Quoc Viet Phung
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2018, 4 (01): : 76 - 88
  • [4] Electric vehicle charging navigation strategy in coupled smart grid and transportation network: A hierarchical reinforcement learning approach
    Jiang, Changxu
    Zhou, Longcan
    Zheng, J. H.
    Shao, Zhenguo
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2024, 157
  • [5] Reinforcement Learning for Smart Charging of Electric Buses in Smart Grid
    Chen, Wenzhuo
    Zhuang, Peng
    Liang, Hao
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [6] Achieving Scalable Model-Free Demand Response in Charging an Electric Vehicle Fleet with Reinforcement Learning
    Sadeghianpourhamami, Nasrin
    Deleu, Johannes
    Develder, Chris
    E-ENERGY'18: PROCEEDINGS OF THE 9TH ACM INTERNATIONAL CONFERENCE ON FUTURE ENERGY SYSTEMS, 2018, : 411 - 413
  • [7] Deep Reinforcement Learning Strategy for Electric Vehicle Charging Considering Wind Power Fluctuation
    Yang A.
    Sun H.
    Zhang X.
    Sun, Hongbin (win_shb@163.com), 1600, Eastern Macedonia and Thrace Institute of Technology (14): : 103 - 110
  • [8] Optimal Electric Vehicle Charging Strategy With Markov Decision Process and Reinforcement Learning Technique
    Ding, Tao
    Zeng, Ziyu
    Bai, Jiawen
    Qin, Boyu
    Yang, Yongheng
    Shahidehpour, Mohammad
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2020, 56 (05) : 5811 - 5823
  • [9] Deep reinforcement learning control of electric vehicle charging in the of
    Dorokhova, Marina
    Martinson, Yann
    Ballif, Christophe
    Wyrsch, Nicolas
    APPLIED ENERGY, 2021, 301
  • [10] A Multiagent Federated Reinforcement Learning Approach for Plug-In Electric Vehicle Fleet Charging Coordination in a Residential Community
    Chu, Yunfei
    Wei, Zhinong
    Fang, Xicheng
    Chen, Sheng
    Zhou, Yizhou
    IEEE ACCESS, 2022, 10 : 98535 - 98548