Dynamic Pricing for Vehicle Dispatching in Mobility-as-a-Service Market via Multi-Agent Deep Reinforcement Learning

被引:1
|
作者
Sun, Guolin [1 ,2 ]
Boateng, Gordon Owusu [3 ]
Liu, Kai [1 ,2 ]
Ayepah-Mensah, Daniel [1 ,2 ]
Liu, Guisong [4 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Intelligent Terminal Key Lab Sichuan Prov, Yibin 644005, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] Southwestern Univ Finance & Econ, Sch Comp & Artificial Intelligence, Chengdu 610074, Peoples R China
关键词
Dynamic pricing; MaaS; MADRL; Stackelberg game; vehicle dispatching; STRATEGIES;
D O I
10.1109/TVT.2024.3378968
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle dispatching in the mobility-as-a-service (MaaS) market has gradually become a situation of multi-service provider competition and coexistence. However, most existing research on vehicle dispatching with dynamic pricing for the MaaS market is still limited to single-service provider scenarios. In this paper, we propose an economic model that analyzes the vehicle dispatching service pricing and demand interactions between multiple mobility service providers (MSPs) and passengers, respectively. We formulate the vehicle dispatching service pricing and demand problem as a two-stage Stackelberg game under different pricing schemes, namely, independent pricing scheme (IPS) and competitive pricing scheme (CPS), considering the vehicle supply-demand relationship and market competition among the MSPs. The MSPs, as leaders, set their service pricing strategies first, and then the passengers, as the followers, determine their service demands. Due to the high-dimensional and complicated nature of the dynamic MaaS market environment, we develop a multi-agent deep reinforcement learning (MADRL) algorithm to achieve the Nash equilibrium (NE) of the formulated game, which indicates the optimal pricing and demand strategies for MSPs and passengers. Simulation results and analysis show that the proposed MADRL-based algorithm converges to the optimal solution and outperforms other benchmark schemes under both IPS and CPS in terms of maximizing MSPs' revenue and protecting passengers' benefits. Furthermore, the proposed MADRL-based algorithm under CPS improves MSPs' market attractiveness and long-term benefits, which encourages MSPs to participate in competitive vehicle dispatching in the MaaS market.
引用
收藏
页码:12010 / 12025
页数:16
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning-Based Passenger Spoofing Attack on Mobility-as-a-Service
    Chu, Kai-Fung
    Guo, Weisi
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (06) : 5565 - 5581
  • [2] Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning
    Zhang, Chi
    Odonkor, Philip
    Zheng, Shuai
    Khorasgani, Hamed
    Serita, Susumu
    Gupta, Chetan
    Wang, Haiyan
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 1436 - 1441
  • [3] Adaptive and Dynamic Service Composition via Multi-agent reinforcement learning
    Wang, Hongbing
    Wu, Qin
    Chen, Xin
    Yu, Qi
    Zheng, Zibin
    Bouguettaya, Athman
    2014 IEEE 21ST INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2014), 2014, : 447 - 454
  • [4] Multi-Agent Graph Convolutional Reinforcement Learning for Dynamic Electric Vehicle Charging Pricing
    Zhang, Weijia
    Liu, Hao
    Han, Jindong
    Ge, Yong
    Xiong, Hui
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2471 - 2481
  • [5] Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching
    Zhou, Ming
    Jin, Jiarui
    Zhang, Weinan
    Qin, Zhiwei
    Jiao, Yan
    Wang, Chenxi
    Wu, Guobin
    Yu, Yong
    Ye, Jieping
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2645 - 2653
  • [6] Scalable order dispatching through Federated Multi-Agent Deep Reinforcement Learning
    Jing, Yao
    Guo, Bin
    Li, Nuo
    Ding, Yasan
    Liu, Yan
    Yu, Zhiwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 264
  • [7] Learning to Send Reinforcements: Coordinating Multi-Agent Dynamic Police Patrol Dispatching and Rescheduling via Reinforcement Learning
    Joe, Waldy
    Lau, Hoong Chuin
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 153 - 161
  • [8] Multi-Agent Reinforcement Learning in Helicopter Airport Dispatching
    Liu, Zhifei
    Dong, Qiang
    Lai, Jun
    Chen, Xiliang
    Computer Engineering and Applications, 2023, 59 (16) : 285 - 294
  • [9] A multi-agent reinforcement learning approach to dynamic service composition
    Wang, Hongbing
    Wang, Xiaojun
    Hu, Xingguo
    Zhang, Xingzhi
    Gu, Mingzhu
    INFORMATION SCIENCES, 2016, 363 : 96 - 119
  • [10] Multi-Agent Deep Reinforcement Learning Based Pricing Strategy for Competing Cloud Platforms in the Evolutionary Market
    Shi, Bing
    Shi, Rongjian
    Li, Bingzhen
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2020), 2020, : 159 - 167