Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach

被引:3
|
作者
Nguyen, Bach Long [1 ]
Nguyen, Duong D. [2 ]
Nguyen, Hung X. [2 ]
Ngo, Duy T. [3 ]
Wagner, Markus [1 ]
机构
[1] Monash Univ, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[3] Univ Newcastle, Sch Engn, Callaghan, NSW 2308, Australia
基金
澳大利亚研究理事会;
关键词
Correlated equilibrium; intelligent transportation systems; multi-agent learning; regret matching; task assignment; vehicular edge computing; REINFORCEMENT; EQUILIBRIUM; COMPLEXITY; MIGRATION; VEHICLES;
D O I
10.1109/TETCI.2023.3339540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicular edge computing has emerged as a solution for enabling computation-intensive applications within Intelligent Transportation Systems (ITS), encompassing domains like autonomous driving and augmented reality. Despite notable progress in this domain, the efficient allocation of constrained computational resources to a spectrum of time-critical ITS tasks remains a substantial challenge. We address this challenge by devising an innovative task assignment scheme tailored for vehicles navigating a highway. Given the high speed of vehicles and the limited communication radius of roadside units (RSUs), the dynamic migration of computation tasks among multiple servers becomes imperative. We present a novel approach that formulates the task assignment challenge as a binary nonlinear programming (BNLP) problem, managing the allocation of computation tasks from vehicles to RSUs and a macrocell base station. To tackle the potentially large dimensionality of this optimization problem, we develop a distributed multi-agent regret-matching learning algorithm. Incorporating the method of regret minimization, our proposed algorithm employs a forgetting mechanism that enables a continuous learning process, thereby accommodating the high mobility of vehicle networks. We prove that this algorithm converges towards correlated equilibrium solutions for our BNLP formulation. Extensive simulations, grounded in practical parameter settings, underscore the algorithm's ability to minimize total delay and task processing costs, while ensuring equitable utility distribution among agents.
引用
收藏
页码:1527 / 1539
页数:13
相关论文
共 50 条
  • [31] Learning-Based Task Offloading for Vehicular Cloud Computing Systems
    Sun, Yuxuan
    Guo, Xueying
    Zhou, Sheng
    Jiang, Zhiyuan
    Liu, Xin
    Niu, Zhisheng
    2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2018,
  • [32] Machine Learning-Based Workload Orchestrator for Vehicular Edge Computing
    Sonmez, Cagatay
    Tunca, Can
    Ozgovde, Atay
    Ersoy, Cem
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (04) : 2239 - 2251
  • [33] Dynamic Many-to-Many Task Offloading in Vehicular Fog Computing: A Multi-Agent DRL Approach
    Wei, Zhiwei
    Li, Bing
    Zhang, Rongqing
    Cheng, Xiang
    Yang, Liuqing
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 6301 - 6306
  • [34] Multi-agent Deep Reinforcement Learning-based Trajectory Design for UAV-aided Edge Computing System
    Lu, Gengyuan
    Chang, Zheng
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [35] Multi-Agent Reinforcement Learning-Based Cooperative Beam Selection in mmWave Vehicular Networks
    Wang, Lei
    Ge, Shuxin
    Zhou, Xiaobo
    Qiu, Tie
    Li, Keqiu
    2021 IEEE 18TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2021), 2021, : 510 - 517
  • [36] Task-oriented Resource Allocation for Mobile Edge Computing with Multi-Agent Reinforcement Learning
    Zou, Yue
    Shen, Fei
    Yan, Feng
    Tang, Liang
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [37] Multi-agent deep reinforcement learning for collaborative task offloading in mobile edge computing networks
    Chen, Minxuan
    Guo, Aihuang
    Song, Chunlin
    DIGITAL SIGNAL PROCESSING, 2023, 140
  • [38] Learning-Based Task Offloading for Mobile Edge Computing
    Garaali, Rim
    Chaieb, Cirine
    Ajib, Wessam
    Afif, Meriem
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 1659 - 1664
  • [39] QoS Optimization for Distributed Edge Computing System: A Multi-agent State-based Learning Approach
    Zhang, Fenghui
    Wang, Michael Mao
    Shan, Liqing
    Wang, Xiangqing
    Fu, Maosheng
    Zhou, Xiancun
    2021 IEEE 93RD VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-SPRING), 2021,
  • [40] A federated multi-agent deep reinforcement learning for vehicular fog computing
    Balawal Shabir
    Anis U. Rahman
    Asad Waqar Malik
    Rajkumar Buyya
    Muazzam A. Khan
    The Journal of Supercomputing, 2023, 79 : 6141 - 6167