Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability

被引:3
|
作者
Suanpang, Pannee [1 ]
Jamjuntr, Pitchaya [2 ]
机构
[1] Suan Dusit Univ, Fac Sci & Technol, Dept Informat Technol, Bangkok 10300, Thailand
[2] King Mongkuts Univ Technol Thonburi, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
optimizing; Q-learning; battery management; electric vehicle; sustainability; enhancing performance; smart city;
D O I
10.3390/su16167180
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper presents a comprehensive study on the optimization of electric vehicle (EV) battery management using Q-learning, a powerful reinforcement learning technique. As the demand for electric vehicles continues to grow, there is an increasing need for efficient battery-management strategies to extend battery life, enhance performance, and minimize operating costs. The primary objective of this research is to develop and assess a Q-learning-based approach to address the intricate challenges associated with EV battery management. This paper starts by elucidating the key challenges inherent in EV battery management and discusses the potential advantages of incorporating Q-learning into the optimization process. Leveraging Q-learning's capacity to make dynamic decisions based on past experiences, we introduce a framework that considers state-of-charge, state-of-health, charging infrastructure, and driving patterns as critical state variables. The methodology is detailed, encompassing the selection of state, action, reward, and policy, with the training process informed by real-world data. Our experimental results underscore the efficacy of the Q-learning approach in optimizing battery management. Through the utilization of Q-learning, we achieve substantial enhancements in battery performance, energy efficiency, and overall EV sustainability. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach, demonstrating compelling results. Our Q-learning-based method achieves a significant 15% improvement in energy efficiency compared to conventional methods, translating into substantial savings in operational costs and reduced environmental impact. Moreover, we observe a remarkable 20% increase in battery lifespan, showcasing the effectiveness of our approach in enhancing long-term sustainability and user satisfaction. This paper significantly enriches the body of knowledge on EV battery management by introducing an innovative, data-driven approach. It provides a comprehensive comparative analysis and applies novel methodologies for practical implementation. The implications of this research extend beyond the academic sphere to practical applications, fostering the broader adoption of electric vehicles and contributing to a reduction in environmental impact while enhancing user satisfaction.
引用
收藏
页数:50
相关论文
共 50 条
  • [11] SIMULATION MODELLING OF ELECTRIC VEHICLE CHARGING RECOMMENDATIONS BASED ON Q-LEARNING
    Tang, M. C.
    Cao, T.
    Gong, D. Q.
    Xue, G.
    Khoa, B.
    INTERNATIONAL JOURNAL OF SIMULATION MODELLING, 2024, 23 (03)
  • [12] Enhanced Q-learning for real-time hybrid electric vehicle energy management with deterministic rule
    Li, Yang
    Tao, Jili
    Xie, Liang
    Zhang, Ridong
    Ma, Longhua
    Qiao, Zhijun
    MEASUREMENT & CONTROL, 2020, 53 (7-8): : 1493 - 1503
  • [13] An Online Learning Control Strategy for Hybrid Electric Vehicle Based on Fuzzy Q-Learning
    Hu, Yue
    Li, Weimin
    Xu, Hui
    Xu, Guoqing
    ENERGIES, 2015, 8 (10): : 11167 - 11186
  • [14] Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique
    Dabbaghjamanesh, Morteza
    Moeini, Amirhossein
    Kavousi-Fard, Abdollah
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (06) : 4229 - 4237
  • [15] A Novel Grid Load Management Technique Using Electric Water Heaters and Q-Learning
    Al-Jabery, Khalid
    Wunsch, Don C.
    Xiong, Jinjun
    Shi, Yiyu
    2014 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2014, : 776 - 781
  • [16] Q-Learning for autonomous vehicle navigation
    Gonzalez-Miranda, Oscar
    Miranda, Luis Antonio Lopez
    Ibarra-Zannatha, Juan Manuel
    2023 XXV ROBOTICS MEXICAN CONGRESS, COMROB, 2023, : 138 - 142
  • [17] Analytical Greedy Control and Q-Learning for Optimal Power Management of Plug-in Hybrid Electric Vehicles
    Liu, Chang
    Murphey, Yi Lu
    2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017,
  • [18] Optimal Policies for the Management of an Electric Vehicle Battery Swap Station
    Widrick, Rebecca S.
    Nurre, Sarah G.
    Robbins, Matthew J.
    TRANSPORTATION SCIENCE, 2018, 52 (01) : 59 - 79
  • [19] Adaptive Dynamic Programming Method for Optimal Battery Management of Battery Electric Vehicle
    Xue, Jiguang
    Yan, Chunsheng
    Wang, Dan
    Wang, Jun
    Wu, Jun
    Liao, Zehua
    PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 65 - 68
  • [20] Approximate Cost-Optimal Energy Management of Hydrogen Electric Multiple Unit Trains Using Double Q-Learning Algorithm
    Li, Qi
    Meng, Xiang
    Gao, Fei
    Zhang, Guorui
    Chen, Weirong
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (09) : 9099 - 9110