Rebalancing the car-sharing system with reinforcement learning

被引:13
|
作者
Ren, Changwei [1 ]
An, Lixingjian [1 ]
Gu, Zhanquan [2 ]
Wang, Yuexuan [1 ,3 ]
Gao, Yunjun [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou, Peoples R China
[2] Guangzhou Univ, CIAT, Guangzhou, Peoples R China
[3] Univ Hong Kong, Dept Comp Sci, Hongkong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Reinforcement learning; Car-sharing system; Scheduling;
D O I
10.1007/s11280-020-00804-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the sharing economy boom, there is a notable increase in the number of car-sharing corporations, which provided a variety of travel options and improved convenience and functionality. Owing to the similarity in the travel patterns of the urban population, car-sharing system often faces the problem of imbalance in the number of shared cars within the spatial distribution, especially during the rush hours. There are many challenges in redressing this imbalance, such as insufficient data and the large state space. In this study, we propose a new reward method called Double P (Picking & Parking) Bonus (DPB). We model the research problem as a Markov Decision Process (MDP) problem and introduce Deep Deterministic Policy Gradient, a state-of-the-art reinforcement learning framework, to find a solution. The results show that the rewarding mechanism embodied in the DPB method can indeed guide the users' behaviors through price leverage, increase user stickiness, and cultivate user habits, thereby boosting the service provider's long-term profit. In addition, taking the battery power of the shared car into consideration, we use the method of hierarchical reinforcement learning for station scheduling. This station scheduling method encourages the user to place the car that needs to be charged on the charging post within a certain site. It can ensure the effective use of charging pile resources, thereby rendering the efficient functioning of shared cars.
引用
收藏
页码:2491 / 2511
页数:21
相关论文
共 50 条
  • [21] Car-sharing services: An annotated review
    Ferrero, Francesco
    Perboli, Guido
    Rosano, Mariangela
    Vesco, Andrea
    SUSTAINABLE CITIES AND SOCIETY, 2018, 37 : 501 - 518
  • [22] Factors Affecting Car-Sharing Services
    Turon, Katarzyna
    SMART CITIES, 2023, 6 (02): : 1185 - 1201
  • [23] The ARTICONF approach to decentralized car-sharing
    Saurabh, Nishant
    Rubia, Carlos
    Palanisamy, Anandakumar
    Koulouzis, Spiros
    Sefidanoski, Mirsat
    Chakravorty, Antorweep
    Zhao, Zhiming
    Karadimce, Aleksandar
    Prodan, Radu
    BLOCKCHAIN-RESEARCH AND APPLICATIONS, 2021, 2 (03):
  • [24] Approximation Algorithms for Car-Sharing Problems
    Luo, Kelin
    Spieksma, Frits C. R.
    COMPUTING AND COMBINATORICS (COCOON 2020), 2020, 12273 : 262 - 273
  • [25] What Car for Car-Sharing? Conventional, Electric, Hybrid or Hydrogen Fleet? Analysis of the Vehicle Selection Criteria for Car-Sharing Systems
    Turon, Katarzyna
    Kubik, Andrzej
    Chen, Feng
    ENERGIES, 2022, 15 (12)
  • [26] CAR-SHARING - WHERE ARE WE NOW
    BONSALL, P
    TRAFFIC ENGINEERING & CONTROL, 1980, 21 (01): : 25 - &
  • [27] Blockchain Based Car-Sharing Platform
    Valastin, Viktor
    Kost'al, Kristian
    Bencel, Rastislav
    Kotuliak, Ivan
    2019 61ST INTERNATIONAL SYMPOSIUM ELMAR, 2019, : 5 - 8
  • [28] Marketing Communications in the Sharing Economy: Is the Brand of the Car Important to Car-Sharing Users?
    Pelech, Pavel
    NEW PERSPECTIVES AND PARADIGMS IN APPLIED ECONOMICS AND BUSINESS, ICAEB 2023, 2024, : 113 - 123
  • [29] Determination of the Vehicle Relocation Triggering Threshold in Electric Car-Sharing System
    Cao, Guangyu
    Wang, Lei
    Jin, Yong
    Yu, Jie
    Ma, Wanjing
    Liu, Qi
    He, Aiping
    Fu, Tao
    PROCEEDINGS OF 2016 CHINESE INTELLIGENT SYSTEMS CONFERENCE, VOL I, 2016, 404 : 11 - 22
  • [30] Deep Reinforcement Learning Framework for Rebalancing Dockless Bike Sharing Systems
    Pan, Ling
    Cai, Qingpeng
    Fang, Zhixuan
    Tang, Pingzhong
    Huang, Longbo
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1393 - 1400