Multiagent Deep Deterministic Policy Gradient-Based Computation Offloading and Resource Allocation for ISAC-Aided 6G V2X Networks

被引:4
|
作者
Hu, Bintao [1 ]
Zhang, Wenzhang [1 ]
Gao, Yuan [2 ]
Du, Jianbo [3 ]
Chu, Xiaoli [4 ]
机构
[1] Xian Jiaotong Liverpool Univ, Sch Internet Things, Suzhou 215123, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
[4] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, England
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 20期
关键词
Resource management; Task analysis; Optimization; Vehicle-to-everything; Delays; Communication networks; Servers; Computation offloading; deep reinforcement learning (DRL); edge intelligence; integrated sensing and communications (ISACs); resource allocation; vehicle-to-everything (V2X) communications;
D O I
10.1109/JIOT.2024.3432728
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular communications in future sixth-generation (6G) networks are expected to leverage integrated sensing and communications (ISACs) and mobile edge computing (MEC) techniques. However, the rapid proliferation of vehicle user equipment (V-UE) and the diversity of ISAC-aided and MEC-empowered vehicular communication and computation services demand a more intelligent and efficient resource allocation framework for the next-generation vehicular networks. To address this issue, we propose a comprehensive ISAC-aided vehicle-to-everything (V2X) MEC framework, where the V-UEs can offload their tasks to the edge server collocated at the roadside unit (RSU). We aim to minimize the long-term average total service delay of all the V-UEs by jointly optimizing the offloading decisions of all the V-UEs, the computation resource allocation at the ISAC-aided RSU, the transmission power, and the allocation of resource blocks for all the V-UEs, where the total service delay of a V-UE includes the task processing delay and the transmission delay if the V-UE offloads its task to the RSU. To solve the formulated mixed integer nonlinear programming problem, we design a multiagent deep deterministic policy gradient (MADDPG)-based offloading optimization and resource allocation algorithm (MADDPG-O2RA2). Simulation results demonstrate that our proposed algorithm outperforms the benchmarks in terms of convergence and the long-term average delay among all the V-UEs.
引用
收藏
页码:33890 / 33902
页数:13
相关论文
共 50 条
  • [21] FAQ: A Fuzzy-Logic-Assisted Q-Learning Model for Resource Allocation in 6G V2X
    Zhang, Minglong
    Dou, Yi
    Marojevic, Vuk
    Chong, Peter Han Joo
    Chan, Henry C. B.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 2472 - 2489
  • [22] Graph Neural Networks and Deep Reinforcement Learning-Based Resource Allocation for V2X Communications
    Ji, Maoxin
    Wu, Qiong
    Fan, Pingyi
    Cheng, Nan
    Chen, Wen
    Wang, Jiangzhou
    Letaief, Khaled B.
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (04): : 3613 - 3628
  • [23] Resource Allocation Using Deep Deterministic Policy Gradient-Based Federated Learning for Multi-Access Edge Computing
    Zhou, Zheyu
    Wang, Qi
    Li, Jizhou
    Li, Ziyuan
    JOURNAL OF GRID COMPUTING, 2024, 22 (03)
  • [24] Deep Learning of Transferable MIMO Channel Modes for 6G V2X Communications
    Cazzella, Lorenzo
    Tagliaferri, Dario
    Mizmizi, Marouan
    Badini, Damiano
    Mazzucco, Christian
    Matteucci, Matteo
    Spagnolini, Umberto
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2022, 70 (06) : 4127 - 4139
  • [25] Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing
    Peng Hou
    Xiaohan Jiang
    Zhihui Lu
    Bo Li
    Zongshan Wang
    Applied Intelligence, 2023, 53 : 22446 - 22466
  • [26] Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing
    Hou, Peng
    Jiang, Xiaohan
    Lu, Zhihui
    Li, Bo
    Wang, Zongshan
    APPLIED INTELLIGENCE, 2023, 53 (19) : 22446 - 22466
  • [27] Efficient End-Edge-Cloud Task Offloading in 6G Networks Based on Multiagent Deep Reinforcement Learning
    She, Hao
    Yan, Lixing
    Guo, Yongan
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 20260 - 20270
  • [28] Federated Learning Empowered Computation Offloading and Resource Management in 6G-V2X
    Prathiba, Sahaya Beni
    Raja, Gunasekaran
    Anbalagan, Sudha
    Dev, Kapal
    Gurumoorthy, Sugeerthi
    Sankaran, Atshaya P.
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3234 - 3243
  • [29] Deep Reinforcement Learning Based Resource Allocation with Heterogeneous QoS for Cellular V2X
    Tian, Jin
    Shi, Yan
    Tong, Xiaolu
    Chen, Shanzhi
    Zhao, Rui
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [30] Deep Reinforcement Learning-Based Resource Allocation for Cellular V2X Communications
    Chung, Yi-Ching
    Chang, Hsin-Yuan
    Chang, Ronald Y.
    Chung, Wei -Ho
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,