QoS Optimization for Distributed Edge Computing System: A Multi-agent State-based Learning Approach

被引:0
|
作者
Zhang, Fenghui [1 ,2 ]
Wang, Michael Mao [1 ]
Shan, Liqing [1 ]
Wang, Xiangqing [2 ]
Fu, Maosheng [2 ]
Zhou, Xiancun [2 ]
机构
[1] Southeast Univ, Sch Informat Sci & Engn, Nanjing 211189, Peoples R China
[2] West Anhui Univ, Sch Elect & Informat Engn, Luan 237012, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Edge computing; state-based game; distributed learning; QoS;
D O I
10.1109/VTC2021-Spring51267.2021.9449000
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Placement of edge computing servers at the edge of the network can reduce task transmission delay. Connecting them into a system can provide services for a wider range. However, due to the mobility of the crowd and mobile devices, the number of tasks offloaded to each edge server may be quite different, which will seriously affect the QoS of the system. To this end, we investigate the QoS improvement of the distributed edge computing system from the game-theoretic perspective and propose a multi-agent state-based learning algorithm. Firstly, by modeling the cost of an edge computing server as the deviation between its execution time and the system average execution time, we formulate the QoS improvement of the system as a state-based game where each agent competes to maximize its own utility. Then, we propose a multi-agent state-based learning algorithm to obtain the pure Nash equilibrium strategy of each agent. Finally, compared with the existing approaches, the experiments show that the proposed algorithm can improve the QoS of the distributed edge computing system.
引用
收藏
页数:5
相关论文
共 50 条
  • [11] Multi-Agent Reinforcement Learning for Cooperative Task Offloading in Distributed Edge Cloud Computing
    Ding, Shiyao
    Lin, Donghui
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (05) : 936 - 945
  • [12] Optimization of Task Offloading Strategy for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning
    Lu, Haifeng
    Gu, Chunhua
    Luo, Fei
    Ding, Weichao
    Zheng, Shuai
    Shen, Yifan
    IEEE ACCESS, 2020, 8 : 202573 - 202584
  • [13] Organization and optimization of distributed logistics: estimation and patrolling approach based on multi-agent system
    Zoghlami, Nesrine
    Hammadi, Slim
    PROCEEDINGS OF THE 11TH WSEAS INTERNATIONAL CONFERENCE ON SYSTEMS, VOL 2: SYSTEMS THEORY AND APPLICATIONS, 2007, : 461 - +
  • [14] Distributed edge control for multi-agent based on binocular vision system
    Shao, Nuan
    Li, Huiguang
    Zou, Liying
    Liu, Le
    Journal of Computational Information Systems, 2014, 10 (07): : 2907 - 2915
  • [15] Learning in coach-based Distributed Multi-Agent System
    Hong, H
    Yu, YC
    Gao, X
    PROCEEDINGS OF THE 4TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-4, 2002, : 2520 - 2523
  • [16] Multi-task scheduling in vehicular edge computing: a multi-agent reinforcement learning approach
    Zhao, Yiming
    Mo, Lei
    Liu, Ji
    CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2024, 6 (04) : 348 - 364
  • [17] QoS Optimization for Mobile Ad Hoc Cloud: A Multi-Agent Independent Learning Approach
    Zhang, Fenghui
    Wang, Michael Mao
    Deng, Ruilong
    You, Xiaohu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (01) : 1077 - 1082
  • [18] A scenario-based approach to multi-agent optimization with distributed information
    Falsone, Alessandro
    Margellos, Kostas
    Prandini, Maria
    Garatti, Simone
    IFAC PAPERSONLINE, 2020, 53 (02): : 20 - 25
  • [19] Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach
    Zhang, Yuming
    Feng, Bohao
    Quan, Wei
    Tian, Aleteng
    Sood, Keshav
    Lin, Youfang
    Zhang, Hongke
    IEEE ACCESS, 2020, 8 (08): : 133212 - 133224
  • [20] Multi-agent Approach to Computational Resource Allocation in Edge Computing
    Kovtunenko, Alexey
    Timirov, Marat
    Bilyalov, Azat
    INTERNET OF THINGS, SMART SPACES, AND NEXT GENERATION NETWORKS AND SYSTEMS, NEW2AN 2019, RUSMART 2019, 2019, 11660 : 135 - 146