Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach

被引:3
|
作者
Nguyen, Bach Long [1 ]
Nguyen, Duong D. [2 ]
Nguyen, Hung X. [2 ]
Ngo, Duy T. [3 ]
Wagner, Markus [1 ]
机构
[1] Monash Univ, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[3] Univ Newcastle, Sch Engn, Callaghan, NSW 2308, Australia
基金
澳大利亚研究理事会;
关键词
Correlated equilibrium; intelligent transportation systems; multi-agent learning; regret matching; task assignment; vehicular edge computing; REINFORCEMENT; EQUILIBRIUM; COMPLEXITY; MIGRATION; VEHICLES;
D O I
10.1109/TETCI.2023.3339540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicular edge computing has emerged as a solution for enabling computation-intensive applications within Intelligent Transportation Systems (ITS), encompassing domains like autonomous driving and augmented reality. Despite notable progress in this domain, the efficient allocation of constrained computational resources to a spectrum of time-critical ITS tasks remains a substantial challenge. We address this challenge by devising an innovative task assignment scheme tailored for vehicles navigating a highway. Given the high speed of vehicles and the limited communication radius of roadside units (RSUs), the dynamic migration of computation tasks among multiple servers becomes imperative. We present a novel approach that formulates the task assignment challenge as a binary nonlinear programming (BNLP) problem, managing the allocation of computation tasks from vehicles to RSUs and a macrocell base station. To tackle the potentially large dimensionality of this optimization problem, we develop a distributed multi-agent regret-matching learning algorithm. Incorporating the method of regret minimization, our proposed algorithm employs a forgetting mechanism that enables a continuous learning process, thereby accommodating the high mobility of vehicle networks. We prove that this algorithm converges towards correlated equilibrium solutions for our BNLP formulation. Extensive simulations, grounded in practical parameter settings, underscore the algorithm's ability to minimize total delay and task processing costs, while ensuring equitable utility distribution among agents.
引用
收藏
页码:1527 / 1539
页数:13
相关论文
共 50 条
  • [41] Dynamic Task Offloading in Multi-Agent Mobile Edge Computing Networks
    Heydari, Javad
    Ganapathy, Viswanath
    Shah, Mohak
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [42] A federated multi-agent deep reinforcement learning for vehicular fog computing
    Shabir, Balawal
    Rahman, Anis U.
    Malik, Asad Waqar
    Buyya, Rajkumar
    Khan, Muazzam A.
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (06): : 6141 - 6167
  • [43] Regret-Based Multi-Agent Coordination with Uncertain Task Rewards
    Wu, Feng
    Jennings, Nicholas R.
    PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 1492 - 1499
  • [44] Multi-agent reinforcement learning for edge information sharing in vehicular networks
    Wang, Ruyan
    Jiang, Xue
    Zhou, Yujie
    Li, Zhidu
    Wu, Dapeng
    Tang, Tong
    Fedotov, Alexander
    Badenko, Vladimir
    DIGITAL COMMUNICATIONS AND NETWORKS, 2022, 8 (03) : 267 - 277
  • [45] Multi-agent reinforcement learning for edge information sharing in vehicular networks
    Ruyan Wang
    Xue Jiang
    Yujie Zhou
    Zhidu Li
    Dapeng Wu
    Tong Tang
    Alexander Fedotov
    Vladimir Badenko
    Digital Communications and Networks, 2022, 8 (03) : 267 - 277
  • [46] AGENT BASED APPROACH FOR TASK OFFLOADING IN EDGE COMPUTING
    Morshedlou, Hossein
    Shoar, Reza Vafa
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2023, 9 (02): : 154 - 165
  • [47] Value Decomposition based Multi-Task Multi-Agent Deep Reinforcement Learning in Vehicular Networks
    Xu, Shilin
    Guo, Caili
    Hu, Rose Qingyang
    Qian, Yi
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [48] Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach
    Zhang, Yuming
    Feng, Bohao
    Quan, Wei
    Tian, Aleteng
    Sood, Keshav
    Lin, Youfang
    Zhang, Hongke
    IEEE ACCESS, 2020, 8 (08): : 133212 - 133224
  • [49] Multi-agent reinforcement learning for task offloading with hybrid decision space in multi-access edge computing
    Wang, Ji
    Zhang, Miao
    Yin, Quanjun
    Yin, Lujia
    Peng, Yong
    AD HOC NETWORKS, 2025, 166
  • [50] Multi-agent Approach to Computational Resource Allocation in Edge Computing
    Kovtunenko, Alexey
    Timirov, Marat
    Bilyalov, Azat
    INTERNET OF THINGS, SMART SPACES, AND NEXT GENERATION NETWORKS AND SYSTEMS, NEW2AN 2019, RUSMART 2019, 2019, 11660 : 135 - 146