Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability

被引:3
|
作者
Suanpang, Pannee [1 ]
Jamjuntr, Pitchaya [2 ]
机构
[1] Suan Dusit Univ, Fac Sci & Technol, Dept Informat Technol, Bangkok 10300, Thailand
[2] King Mongkuts Univ Technol Thonburi, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
optimizing; Q-learning; battery management; electric vehicle; sustainability; enhancing performance; smart city;
D O I
10.3390/su16167180
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper presents a comprehensive study on the optimization of electric vehicle (EV) battery management using Q-learning, a powerful reinforcement learning technique. As the demand for electric vehicles continues to grow, there is an increasing need for efficient battery-management strategies to extend battery life, enhance performance, and minimize operating costs. The primary objective of this research is to develop and assess a Q-learning-based approach to address the intricate challenges associated with EV battery management. This paper starts by elucidating the key challenges inherent in EV battery management and discusses the potential advantages of incorporating Q-learning into the optimization process. Leveraging Q-learning's capacity to make dynamic decisions based on past experiences, we introduce a framework that considers state-of-charge, state-of-health, charging infrastructure, and driving patterns as critical state variables. The methodology is detailed, encompassing the selection of state, action, reward, and policy, with the training process informed by real-world data. Our experimental results underscore the efficacy of the Q-learning approach in optimizing battery management. Through the utilization of Q-learning, we achieve substantial enhancements in battery performance, energy efficiency, and overall EV sustainability. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach, demonstrating compelling results. Our Q-learning-based method achieves a significant 15% improvement in energy efficiency compared to conventional methods, translating into substantial savings in operational costs and reduced environmental impact. Moreover, we observe a remarkable 20% increase in battery lifespan, showcasing the effectiveness of our approach in enhancing long-term sustainability and user satisfaction. This paper significantly enriches the body of knowledge on EV battery management by introducing an innovative, data-driven approach. It provides a comprehensive comparative analysis and applies novel methodologies for practical implementation. The implications of this research extend beyond the academic sphere to practical applications, fostering the broader adoption of electric vehicles and contributing to a reduction in environmental impact while enhancing user satisfaction.
引用
收藏
页数:50
相关论文
共 50 条
  • [31] Digital twin for electric vehicle battery management with incremental learning
    Eaty, Naga Durga Krishna Mohan
    Bagade, Priyanka
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [32] Optimal energy management for a flywheel-assisted battery electric vehicle
    Dhand, Aditya
    Pullen, Keith
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2015, 229 (12) : 1672 - 1682
  • [33] Globally Optimal Energy Management in a Battery-Ultracapacitor Electric Vehicle
    Zahedi, Amin
    Babaeiyazdi, Iman
    Ostadian, Reihaneh
    Rezaei-Zare, Afshin
    2022 IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2022 IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2022,
  • [34] Machine Learning-Based Optimal Cell Balancing Mechanism for Electric Vehicle Battery Management System
    Duraisamy, Thiruvonasundari
    Kaliyaperumal, Deepa
    IEEE ACCESS, 2021, 9 : 132846 - 132861
  • [35] A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle
    Zhang, Yuxiang
    Ma, Rui
    Zhao, Dongdong
    Huangfu, Yigeng
    Liu, Weiguo
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (02) : 1537 - 1547
  • [36] Deep Q-Learning Based Energy Management Strategy for a Series Hybrid Electric Tracked Vehicle and Its Adaptability Validation
    He, Dingbo
    Zou, Yuan
    Wu, Jinlong
    Zhang, Xudong
    Zhang, Zhigang
    Wang, Ruizhi
    2019 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE AND EXPO (ITEC), 2019,
  • [37] Optimal Self-Learning Battery Control in Smart Residential Grids by Iterative Q-Learning Algorithm
    Wei, Qinglai
    Liu, Derong
    Shi, Guang
    Liu, Yu
    Guan, Qiang
    2014 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2014, : 170 - 176
  • [38] Energy management strategy for hybrid electric vehicles based on double Q-learning
    Han, Lijin
    Yang, Ke
    Zhang, Xin
    Yang, Ningkang
    Liu, Hui
    Liu, Jiaxin
    INTERNATIONAL CONFERENCE ON MECHANICAL DESIGN AND SIMULATION (MDS 2022), 2022, 12261
  • [39] Enhancing Nash Q-learning and Team Q-learning mechanisms by using bottlenecks
    Ghazanfari, Behzad
    Mozayani, Nasser
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2014, 26 (06) : 2771 - 2783
  • [40] Optimal Power Management Based on Q-Learning and Neuro-Dynamic Programming for Plug-in Hybrid Electric Vehicles
    Liu, Chang
    Murphey, Yi Lu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) : 1942 - 1954