Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach

被引:3
|
作者
Nguyen, Bach Long [1 ]
Nguyen, Duong D. [2 ]
Nguyen, Hung X. [2 ]
Ngo, Duy T. [3 ]
Wagner, Markus [1 ]
机构
[1] Monash Univ, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[3] Univ Newcastle, Sch Engn, Callaghan, NSW 2308, Australia
基金
澳大利亚研究理事会;
关键词
Correlated equilibrium; intelligent transportation systems; multi-agent learning; regret matching; task assignment; vehicular edge computing; REINFORCEMENT; EQUILIBRIUM; COMPLEXITY; MIGRATION; VEHICLES;
D O I
10.1109/TETCI.2023.3339540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicular edge computing has emerged as a solution for enabling computation-intensive applications within Intelligent Transportation Systems (ITS), encompassing domains like autonomous driving and augmented reality. Despite notable progress in this domain, the efficient allocation of constrained computational resources to a spectrum of time-critical ITS tasks remains a substantial challenge. We address this challenge by devising an innovative task assignment scheme tailored for vehicles navigating a highway. Given the high speed of vehicles and the limited communication radius of roadside units (RSUs), the dynamic migration of computation tasks among multiple servers becomes imperative. We present a novel approach that formulates the task assignment challenge as a binary nonlinear programming (BNLP) problem, managing the allocation of computation tasks from vehicles to RSUs and a macrocell base station. To tackle the potentially large dimensionality of this optimization problem, we develop a distributed multi-agent regret-matching learning algorithm. Incorporating the method of regret minimization, our proposed algorithm employs a forgetting mechanism that enables a continuous learning process, thereby accommodating the high mobility of vehicle networks. We prove that this algorithm converges towards correlated equilibrium solutions for our BNLP formulation. Extensive simulations, grounded in practical parameter settings, underscore the algorithm's ability to minimize total delay and task processing costs, while ensuring equitable utility distribution among agents.
引用
收藏
页码:1527 / 1539
页数:13
相关论文
共 50 条
  • [1] Multi-task scheduling in vehicular edge computing: a multi-agent reinforcement learning approach
    Zhao, Yiming
    Mo, Lei
    Liu, Ji
    CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2024, 6 (04) : 348 - 364
  • [2] Deep Learning-Based Task Offloading for Vehicular Edge Computing
    Zeng, Feng
    Liu, Chengsheng
    Tangjiang, Junzhe
    Li, Wenjia
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT III, 2021, 12939 : 291 - 298
  • [3] Multi-agent deep reinforcement learning-based partial offloading and resource allocation in vehicular edge computing networks
    Xue, Jianbin
    Wang, Luyao
    Yu, Qingda
    Mao, Peipei
    COMPUTER COMMUNICATIONS, 2025, 234
  • [4] Task Offloading for Vehicular Edge Computing: A Learning-Based Intent-Aware Approach
    Kong, Wenxuan
    Jia, Lurui
    Zhou, Zhenyu
    Liao, Haijun
    2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 651 - 656
  • [5] Vehicle Speed Aware Computing Task Offloading and Resource Allocation Based on Multi-Agent Reinforcement Learning in a Vehicular Edge Computing Network
    Huang, Xinyu
    He, Lijun
    Zhang, Wanyue
    2020 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING (EDGE 2020), 2020, : 1 - 8
  • [6] Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment
    Ke, Hongchang
    Wang, Hui
    Sun, Hongbin
    ELECTRONICS, 2022, 11 (15)
  • [7] Deep Learning-Based Task Discrimination Offloading in Vehicular Edge Computing
    Zhang J.
    Qi K.
    Zhang Q.
    Sun L.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2024, 53 (01): : 29 - 39
  • [8] Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems
    Sun, Yuxuan
    Guo, Xueying
    Song, Jinhui
    Zhou, Sheng
    Jiang, Zhiyuan
    Liu, Xin
    Niu, Zhisheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (04) : 3061 - 3074
  • [9] Hierarchical Task Offloading for Vehicular Fog Computing Based on Multi-Agent Deep Reinforcement Learning
    Hou, Yukai
    Wei, Zhiwei
    Zhang, Rongqing
    Cheng, Xiang
    Yang, Liuqing
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (04) : 3074 - 3085
  • [10] A Multi-Agent Reinforcement Learning-Based Task-Offloading Strategy in a Blockchain-Enabled Edge Computing Network
    Liu, Chenlei
    Sun, Zhixin
    MATHEMATICS, 2024, 12 (14)