Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability

被引:3
|
作者
Suanpang, Pannee [1 ]
Jamjuntr, Pitchaya [2 ]
机构
[1] Suan Dusit Univ, Fac Sci & Technol, Dept Informat Technol, Bangkok 10300, Thailand
[2] King Mongkuts Univ Technol Thonburi, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
optimizing; Q-learning; battery management; electric vehicle; sustainability; enhancing performance; smart city;
D O I
10.3390/su16167180
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper presents a comprehensive study on the optimization of electric vehicle (EV) battery management using Q-learning, a powerful reinforcement learning technique. As the demand for electric vehicles continues to grow, there is an increasing need for efficient battery-management strategies to extend battery life, enhance performance, and minimize operating costs. The primary objective of this research is to develop and assess a Q-learning-based approach to address the intricate challenges associated with EV battery management. This paper starts by elucidating the key challenges inherent in EV battery management and discusses the potential advantages of incorporating Q-learning into the optimization process. Leveraging Q-learning's capacity to make dynamic decisions based on past experiences, we introduce a framework that considers state-of-charge, state-of-health, charging infrastructure, and driving patterns as critical state variables. The methodology is detailed, encompassing the selection of state, action, reward, and policy, with the training process informed by real-world data. Our experimental results underscore the efficacy of the Q-learning approach in optimizing battery management. Through the utilization of Q-learning, we achieve substantial enhancements in battery performance, energy efficiency, and overall EV sustainability. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach, demonstrating compelling results. Our Q-learning-based method achieves a significant 15% improvement in energy efficiency compared to conventional methods, translating into substantial savings in operational costs and reduced environmental impact. Moreover, we observe a remarkable 20% increase in battery lifespan, showcasing the effectiveness of our approach in enhancing long-term sustainability and user satisfaction. This paper significantly enriches the body of knowledge on EV battery management by introducing an innovative, data-driven approach. It provides a comprehensive comparative analysis and applies novel methodologies for practical implementation. The implications of this research extend beyond the academic sphere to practical applications, fostering the broader adoption of electric vehicles and contributing to a reduction in environmental impact while enhancing user satisfaction.
引用
收藏
页数:50
相关论文
共 50 条
  • [1] Energy consumption and battery aging minimization using a Q-learning strategy for a battery/ultracapacitor electric vehicle
    Xu, Bin
    Shi, Junzhe
    Li, Sixu
    Li, Huayi
    Wang, Zhe
    ENERGY, 2021, 229
  • [2] Rule and Q-learning based Hybrid Energy Management for Electric Vehicle
    Li, Yang
    Tao, Jili
    Han, Kai
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 51 - 56
  • [3] Development of a deep Q-learning energy management system for a hybrid electric vehicle
    Tresca L.
    Pulvirenti L.
    Rolando L.
    Millo F.
    Transportation Engineering, 2024, 16
  • [4] Hierarchical Q-learning network for online simultaneous optimization of energy efficiency and battery life of the battery/ultracapacitor electric vehicle
    Xu, Bin
    Zhou, Quan
    Shi, Junzhe
    Li, Sixu
    JOURNAL OF ENERGY STORAGE, 2022, 46
  • [5] Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle
    Han, Xuefeng
    He, Hongwen
    Wu, Jingda
    Peng, Jiankun
    Li, Yuecheng
    APPLIED ENERGY, 2019, 254
  • [6] A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments
    Wei, Qinglai
    Liu, Derong
    Shi, Guang
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (04) : 2509 - 2518
  • [7] Online Data-Driven Energy Management of a Hybrid Electric Vehicle Using Model-Based Q-Learning
    Lee, Heeyun
    Kang, Changbeom
    Park, Yeong-Il
    Kim, Namwook
    Cha, Suk Won
    IEEE ACCESS, 2020, 8 : 84444 - 84454
  • [8] An Online Home Energy Management System using Q-Learning and Deep Q-Learning
    Izmitligil, Hasan
    Karamancioglu, Abdurrahman
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2024, 43
  • [9] A Fast Q-learning Energy Management Strategy for Battery/Supercapacitor Electric Vehicles Considering Energy Saving and Battery Aging
    Ye, Yiming
    Zhang, Jiangfeng
    Xu, Bin
    INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1639 - 1644
  • [10] Enhancing electric vehicle sustainability through battery life optimal charging
    Schoch, Jennifer
    Gaerttner, Johannes
    Schuller, Alexander
    Setzer, Thomas
    TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2018, 112 : 1 - 18