Dynamic Pricing for Vehicle Dispatching in Mobility-as-a-Service Market via Multi-Agent Deep Reinforcement Learning

被引:1
|
作者
Sun, Guolin [1 ,2 ]
Boateng, Gordon Owusu [3 ]
Liu, Kai [1 ,2 ]
Ayepah-Mensah, Daniel [1 ,2 ]
Liu, Guisong [4 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Intelligent Terminal Key Lab Sichuan Prov, Yibin 644005, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] Southwestern Univ Finance & Econ, Sch Comp & Artificial Intelligence, Chengdu 610074, Peoples R China
关键词
Dynamic pricing; MaaS; MADRL; Stackelberg game; vehicle dispatching; STRATEGIES;
D O I
10.1109/TVT.2024.3378968
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle dispatching in the mobility-as-a-service (MaaS) market has gradually become a situation of multi-service provider competition and coexistence. However, most existing research on vehicle dispatching with dynamic pricing for the MaaS market is still limited to single-service provider scenarios. In this paper, we propose an economic model that analyzes the vehicle dispatching service pricing and demand interactions between multiple mobility service providers (MSPs) and passengers, respectively. We formulate the vehicle dispatching service pricing and demand problem as a two-stage Stackelberg game under different pricing schemes, namely, independent pricing scheme (IPS) and competitive pricing scheme (CPS), considering the vehicle supply-demand relationship and market competition among the MSPs. The MSPs, as leaders, set their service pricing strategies first, and then the passengers, as the followers, determine their service demands. Due to the high-dimensional and complicated nature of the dynamic MaaS market environment, we develop a multi-agent deep reinforcement learning (MADRL) algorithm to achieve the Nash equilibrium (NE) of the formulated game, which indicates the optimal pricing and demand strategies for MSPs and passengers. Simulation results and analysis show that the proposed MADRL-based algorithm converges to the optimal solution and outperforms other benchmark schemes under both IPS and CPS in terms of maximizing MSPs' revenue and protecting passengers' benefits. Furthermore, the proposed MADRL-based algorithm under CPS improves MSPs' market attractiveness and long-term benefits, which encourages MSPs to participate in competitive vehicle dispatching in the MaaS market.
引用
收藏
页码:12010 / 12025
页数:16
相关论文
共 50 条
  • [31] The Coordinated Charging Pricing Approach for Charging Stations with Multi-agent Deep Reinforcement Learning
    Wang, Fangyu
    Chen, Qian
    Yang, Liping
    2023 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA, I&CPS ASIA, 2023, : 1987 - 1992
  • [32] Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications
    Li, Xiang
    Lu, Lingyun
    Ni, Wei
    Jamalipour, Abbas
    Zhang, Dalin
    Du, Haifeng
    IEEE Transactions on Vehicular Technology, 2022, 71 (08): : 8810 - 8824
  • [33] Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications
    Li, Xiang
    Lu, Lingyun
    Ni, Wei
    Jamalipour, Abbas
    Zhang, Dalin
    Du, Haifeng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (08) : 8810 - 8824
  • [34] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [35] Distributed dynamic pricing of multiple perishable products using multi-agent reinforcement learning
    Qiao, Wenchuan
    Huang, Min
    Gao, Zheming
    Wang, Xingwei
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [36] Multi-Agent Reinforcement Learning Enabling Dynamic Pricing Policy for Charging Station Operators
    Han, Ye
    Zhang, Xuefei
    Zhang, Jian
    Cui, Qimei
    Wang, Shuo
    Han, Zhu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [37] Multi-Objective Dynamic Path Planning with Multi-Agent Deep Reinforcement Learning
    Tao, Mengxue
    Li, Qiang
    Yu, Junxi
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2025, 13 (01)
  • [38] Dynamic power allocation in IIoT based on multi-agent deep reinforcement learning
    Li, Fenglei
    Liu, Zhixin
    Zhang, Xinzhe
    Yang, Yi
    NEUROCOMPUTING, 2022, 505 : 10 - 18
  • [39] Federated Dynamic Spectrum Access through Multi-Agent Deep Reinforcement Learning
    Song, Yifei
    Chang, Hao-Hsuan
    Liu, Lingjia
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3466 - 3471
  • [40] Safe Multi-Agent Deep Reinforcement Learning for Dynamic Virtual Network Allocation
    Suzuki, Akito
    Harada, Shigeaki
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,