Imbalance Cost-Aware Energy Scheduling for Prosumers Towards UAM Charging: A Matching and Multi-Agent DRL Approach

被引:2
|
作者
Zou, Luyao [1 ]
Munir, Md. Shirajum [1 ,2 ]
Hassan, Sheikh Salman [1 ]
Tun, Yan Kyaw [3 ]
Nguyen, Loc X. [1 ]
Hong, Choong Seon [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Yongin 17104, South Korea
[2] Old Dominion Univ, Sch Cyber Secur, Suffolk, VA 23435 USA
[3] Aalborg Univ, Dept Elect Syst, DK-9220 Aalborg, Denmark
基金
新加坡国家研究基金会;
关键词
Clustering-based multi-agent dueling double deep Q network (MA3DQN); destination collision-aware Gale-Shapely matching game (DC-MG); energy supply-demand imbalance cost; electric vertical take-off and landing aircraft (eVTOL)-charging-enabled prosumers; EVTOL; ARRIVAL;
D O I
10.1109/TVT.2023.3328266
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an energy scheduling problem is formulated for the prosumer-based urban area, where prosumers are regarded as the drone charging stations for urban air mobility (UAM). Particularly, since electric vertical take-off and landing aircraft (eVTOL) is regarded as the anticipated technique for future UAM, we consider eVTOL drone taxis for transporting passengers. The objective is to minimize the overall energy supply-demand imbalance cost. This problem covers two aspects: 1) association between passengers and eVTOLs, and 2) energy balance strategy determination through power grid energy scheduling for each prosumer. For the first aspect, a destination collision-aware Gale-Shapely matching game (DC-MG) approach is proposed, where the distance concern of passengers, the remaining energy of eVTOLs, and the destination collision are comprehensively considered. Subsequently, hierarchical agglomerative clustering (HAGC)-based multi-agent dueling double deep Q network (MA3DQN) with a multi-step bootstrapping (MSB) approach (CMA3DQN) is proposed, where the input (i.e., energy demand) depends on the output of the first aspect. Particularly, the HAGC approach is adopted to group all prosumers into several agents to reduce the input feature size of each agent. Then the MA3DQN with MSB approach is applied to achieve the best grid energy balance strategy per prosumer. Finally, the experimental results demonstrate the effectiveness of the proposed method. Particularly, the imbalance cost achieved by the proposed joint method is separately 128.71x , 12.57x , and 11.72x less than the random energy scheduling approach, the independent multi-agent dueling DQN approach, and the approach of employing the double deep Q network per cluster.
引用
收藏
页码:3404 / 3420
页数:17
相关论文
共 34 条
  • [31] Resource scheduling and performance analysis of hybrid renewable energy systems with carbon neutrality consideration: A scenario-based multi-agent approach
    Yu, Xianyu
    Dong, Zhuojia
    Ge, Shengxian
    Zhou, Dequn
    Wang, Qunwei
    Sang, Xiuzhi
    SUSTAINABLE CITIES AND SOCIETY, 2023, 96
  • [32] Attention-Shared Multi-Agent Actor-Critic-Based Deep Reinforcement Learning Approach for Mobile Charging Dynamic Scheduling in Wireless Rechargeable Sensor Networks
    Jiang, Chengpeng
    Wang, Ziyang
    Chen, Shuai
    Li, Jinglin
    Wang, Haoran
    Xiang, Jinwei
    Xiao, Wendong
    ENTROPY, 2022, 24 (07)
  • [33] A blockchain-based LLM-driven energy-efficient scheduling system towards distributed multi-agent manufacturing scenario of new energy vehicles within the circular economy
    Liu, Changchun
    Nie, Qingwei
    COMPUTERS & INDUSTRIAL ENGINEERING, 2025, 201
  • [34] Vehicular Traffic Congestion Detection System and Improved Energy-Aware Cost Effective Task Scheduling Approach for Multi-Objective Optimization on Cloud Fog Network
    Mishra, Praveen Kumar
    Chaturvedi, Amit Kumar
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (09) : 432 - 440