QoS Optimization for Distributed Edge Computing System: A Multi-agent State-based Learning Approach

被引:0
|
作者
Zhang, Fenghui [1 ,2 ]
Wang, Michael Mao [1 ]
Shan, Liqing [1 ]
Wang, Xiangqing [2 ]
Fu, Maosheng [2 ]
Zhou, Xiancun [2 ]
机构
[1] Southeast Univ, Sch Informat Sci & Engn, Nanjing 211189, Peoples R China
[2] West Anhui Univ, Sch Elect & Informat Engn, Luan 237012, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Edge computing; state-based game; distributed learning; QoS;
D O I
10.1109/VTC2021-Spring51267.2021.9449000
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Placement of edge computing servers at the edge of the network can reduce task transmission delay. Connecting them into a system can provide services for a wider range. However, due to the mobility of the crowd and mobile devices, the number of tasks offloaded to each edge server may be quite different, which will seriously affect the QoS of the system. To this end, we investigate the QoS improvement of the distributed edge computing system from the game-theoretic perspective and propose a multi-agent state-based learning algorithm. Firstly, by modeling the cost of an edge computing server as the deviation between its execution time and the system average execution time, we formulate the QoS improvement of the system as a state-based game where each agent competes to maximize its own utility. Then, we propose a multi-agent state-based learning algorithm to obtain the pure Nash equilibrium strategy of each agent. Finally, compared with the existing approaches, the experiments show that the proposed algorithm can improve the QoS of the distributed edge computing system.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] State-based episodic memory for multi-agent reinforcement learning
    Ma, Xiao
    Li, Wu-Jun
    MACHINE LEARNING, 2023, 112 (12) : 5163 - 5190
  • [2] State-based episodic memory for multi-agent reinforcement learning
    Xiao Ma
    Wu-Jun Li
    Machine Learning, 2023, 112 : 5163 - 5190
  • [3] A state-based multi-agent system model of taxi fleets
    Ribas-Xirgo, Lluis
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3515 - 3534
  • [4] A state-based multi-agent system model of taxi fleets
    Lluís Ribas-Xirgo
    Multimedia Tools and Applications, 2022, 81 : 3515 - 3534
  • [5] Load Balancing for Distributed Intelligent Edge Computing: A State-Based Game Approach
    Zhang, Fenghui
    Deng, Ruilong
    Zhao, Xinsheng
    Wang, Michael Mao
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (04) : 1066 - 1077
  • [6] A Deeper Understanding of State-Based Critics in Multi-Agent Reinforcement Learning
    Lyu, Xueguang
    Baisero, Andrea
    Xiao, Yuchen
    Amato, Christopher
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 9396 - 9404
  • [7] Organization of the Secure Distributed Computing Based On Multi-Agent System
    Khovanskov, Sergey
    Rumyantsev, Konstantin
    Khovanskova, Vera
    INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, MATERIALS AND APPLIED SCIENCE, 2018, 1952
  • [8] Mobile multi-agent system for distributed computing
    Kleijkers, S
    Wiesman, F
    Roos, N
    AGENTS AND PEER-TO-PEER COMPUTING, 2003, 2530 : 158 - 163
  • [9] Consensus Dispatch of Distributed Power Network Based on Multi-Access Edge Computing and Multi-Agent System
    Wang, Liming
    Liu, Yingming
    Wang, Xiaodong
    Wang, Hanbo
    Guo, Guoxian
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [10] Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning
    Zhang, Yutong
    Di, Boya
    Zheng, Zijie
    Lin, Jinlong
    Song, Lingyang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) : 2565 - 2578