Development of improved reinforcement learning smart charging strategy for electric vehicle fleet

被引:24
|
作者
Sultanuddin, S. J. [1 ]
Vibin, R. [2 ]
Kumar, A. Rajesh [3 ]
Behera, Nihar Ranjan [4 ]
Pasha, M. Jahir [5 ]
Baseer, K. K. [6 ]
机构
[1] Measi Inst Informat Technol, Chennai, India
[2] CMS Coll Engn & Technol, Elect & Elect Engn, Coimbatore, Tamil Nadu, India
[3] NSN Coll Engn & Technol, Comp Sci & Engn, Karur, Tamil Nadu, India
[4] Swiss Sch Business & Management Geneva, Ave Morgines 12, CH-1213 Petit Lancy, Switzerland
[5] G Pullaiah Coll Engn & Technol, Dept Comp Sci & Engn, Kurnool, Andhra Pradesh, India
[6] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Sch Comp, Tirupati, Andhra Pradesh, India
关键词
Electric vehicle; Smart charging; Reinforcement learning; Power grid; Optimization;
D O I
10.1016/j.est.2023.106987
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to its environmental and energy sustainability, electric vehicles (EV) have emerged as the preferred option in the current transportation system. Uncontrolled EV charging, however, can raise consumers; charging costs and overwhelm the grid. Smart charging coordination systems are required to prevent the grid overload caused by charging too many electric vehicles at once. In light of the baseload that is present in the power grid, this research suggests an improved reinforcement learning charging management system. An optimization method, however, requires some knowledge in advance, such as the time the vehicle departs and how much energy it will need when it arrives at the charging station. Therefore, under realistic operating conditions, our improved Reinforcement Learning method with Double Deep Q-learning approach provides an adjustable, scalable, and flexible strategy for an electric car fleet. Our proposed approach provides fair value which solves the over-estimation action value problem in deep Q-learning. Then, a number of different charging strategies are compared to the Reinforcement Learning algorithm. The proposed Reinforcement Learning technique minimizes the variance of the overall load by 68 % when compared to an uncontrolled charging strategy.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Optimizing Electric Vehicle Charging Recommendation in Smart Cities: A Multi-Agent Reinforcement Learning Approach
    Suanpang, Pannee
    Jamjuntr, Pitchaya
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (02):
  • [22] Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning
    Liang, Yanchang
    Ding, Zhaohao
    Ding, Tao
    Lee, Wei-Jen
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (02) : 1380 - 1393
  • [23] An online reinforcement learning approach to charging and order-dispatching optimization for an e-hailing electric vehicle fleet
    Yan, Pengyu
    Yu, Kaize
    Chao, Xiuli
    Chen, Zhibin
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 310 (03) : 1218 - 1233
  • [24] Reinforcement Learning for EV Fleet Smart Charging with On-Site Renewable Energy Sources
    Li, Handong
    Dai, Xuewu
    Goldrick, Stephen
    Kotter, Richard
    Aslam, Nauman
    Ali, Saleh
    ENERGIES, 2024, 17 (21)
  • [25] Congestion Probability Balanced Electric Vehicle Charging Strategy in Smart Grid
    Tang, Qiang
    Yang, Kun
    Luo, Yuan-sheng
    Liu, Yu-yan
    SMART GRID INSPIRED FUTURE TECHNOLOGIES, 2017, 203 : 192 - 201
  • [26] A Development of Smart Metering Infrastructure for Electric Vehicle Charging Point
    Muharam, Aam
    Pratama, Mulia
    Ismail, Kristian
    Kaleg, Sunarto
    Kurnia, Muhammad Redho
    Hapid, Abdul
    2016 4TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY ENGINEERING AND APPLICATION (ICSEEA), 2016, : 27 - 33
  • [27] Development and Evaluation of a Battery Lifetime Extending Charging Algorithm for an Electric Vehicle Fleet
    Ruecker, Fabian
    Bremer, Ilka
    Linden, Sebastian
    Badeda, Julia
    Sauer, Dirk Uwe
    10TH INTERNATIONAL RENEWABLE ENERGY STORAGE CONFERENCE, IRES 2016, 2016, 99 : 285 - 291
  • [28] A Decision Function Based Smart Charging and Discharging Strategy for Electric Vehicle in Smart Grid
    Qiang Tang
    Mingzhong Xie
    Kun Yang
    Yuansheng Luo
    Dongdai Zhou
    Yun Song
    Mobile Networks and Applications, 2019, 24 : 1722 - 1731
  • [29] A Decision Function Based Smart Charging and Discharging Strategy for Electric Vehicle in Smart Grid
    Tang, Qiang
    Xie, Mingzhong
    Yang, Kun
    Luo, Yuansheng
    Zhou, Dongdai
    Song, Yun
    MOBILE NETWORKS & APPLICATIONS, 2019, 24 (05): : 1722 - 1731
  • [30] Operating Electric Vehicle Fleet for Ride-Hailing Services With Reinforcement Learning
    Shi, Jie
    Gao, Yuanqi
    Wang, Wei
    Yu, Nanpeng
    Ioannou, Petros A.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (11) : 4822 - 4834