Multiagent Deep Deterministic Policy Gradient-Based Computation Offloading and Resource Allocation for ISAC-Aided 6G V2X Networks

被引:4
|
作者
Hu, Bintao [1 ]
Zhang, Wenzhang [1 ]
Gao, Yuan [2 ]
Du, Jianbo [3 ]
Chu, Xiaoli [4 ]
机构
[1] Xian Jiaotong Liverpool Univ, Sch Internet Things, Suzhou 215123, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
[4] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, England
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 20期
关键词
Resource management; Task analysis; Optimization; Vehicle-to-everything; Delays; Communication networks; Servers; Computation offloading; deep reinforcement learning (DRL); edge intelligence; integrated sensing and communications (ISACs); resource allocation; vehicle-to-everything (V2X) communications;
D O I
10.1109/JIOT.2024.3432728
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular communications in future sixth-generation (6G) networks are expected to leverage integrated sensing and communications (ISACs) and mobile edge computing (MEC) techniques. However, the rapid proliferation of vehicle user equipment (V-UE) and the diversity of ISAC-aided and MEC-empowered vehicular communication and computation services demand a more intelligent and efficient resource allocation framework for the next-generation vehicular networks. To address this issue, we propose a comprehensive ISAC-aided vehicle-to-everything (V2X) MEC framework, where the V-UEs can offload their tasks to the edge server collocated at the roadside unit (RSU). We aim to minimize the long-term average total service delay of all the V-UEs by jointly optimizing the offloading decisions of all the V-UEs, the computation resource allocation at the ISAC-aided RSU, the transmission power, and the allocation of resource blocks for all the V-UEs, where the total service delay of a V-UE includes the task processing delay and the transmission delay if the V-UE offloads its task to the RSU. To solve the formulated mixed integer nonlinear programming problem, we design a multiagent deep deterministic policy gradient (MADDPG)-based offloading optimization and resource allocation algorithm (MADDPG-O2RA2). Simulation results demonstrate that our proposed algorithm outperforms the benchmarks in terms of convergence and the long-term average delay among all the V-UEs.
引用
收藏
页码:33890 / 33902
页数:13
相关论文
共 50 条
  • [41] Deep Reinforcement Learning Enabled Energy-Efficient Resource Allocation in Energy Harvesting Aided V2X Communication
    Song, Yuqian
    Xiao, Yang
    Chen, Yaozhi
    Li, Guanyu
    Liu, Jun
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 313 - 319
  • [42] Evaluation of Radio Access Protocols for V2X in 6G Scenario-Based Models
    Orrillo, Hector
    Sabino, Andre
    da Silva, Mario Marques
    FUTURE INTERNET, 2024, 16 (06)
  • [43] Deep Reinforcement Learning-Empowered Resource Allocation for Mobile Edge Computing in Cellular V2X Networks
    Li, Dongji
    Xu, Shaoyi
    Li, Pengyu
    SENSORS, 2021, 21 (02) : 1 - 18
  • [44] Deep-Reinforcement-Learning-Based Mode Selection and Resource Allocation for Cellular V2X Communications
    Zhang, Xinran
    Peng, Mugen
    Yan, Shi
    Sun, Yaohua
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) : 6380 - 6391
  • [45] Deep Reinforcement Learning for Integrated Sensing and Communication in RIS-Assisted 6G V2X System
    Long, Xudong
    Zhao, Yubin
    Wu, Huaming
    Xu, Cheng-Zhong
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (24): : 39834 - 39849
  • [46] Learning-Based Resource Allocation for Ultra-Reliable V2X Networks With Partial CSI
    Chai, Guanhua
    Wu, Weihua
    Yang, Qinghai
    Liu, Runzi
    Yu, F. Richard
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (10) : 6532 - 6546
  • [47] Resource Allocation in V2X Networks: From Classical Optimization to Machine Learning-Based Solutions
    Parvini, Mohammad
    Schulz, Philipp
    Fettweis, Gerhard
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 1958 - 1974
  • [48] Deep Reinforcement Learning-based Offloading for Latency Minimization in 3-tier V2X Networks
    Hieu Dinh
    Nang Hung Nguyen
    Trung Thanh Nguyen
    Thanh Hung Nguyen
    Nguyen, Truong Thao
    Phi Le Nguyen
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1803 - 1808
  • [49] Deep reinforcement learning-based joint task and energy offloading in UAV-aided 6G intelligent edge networks
    Cheng, Zhipeng
    Liwang, Minghui
    Chen, Ning
    Huang, Lianfen
    Du, Xiaojiang
    Guizani, Mohsen
    COMPUTER COMMUNICATIONS, 2022, 192 : 234 - 244
  • [50] DT-SFC-6G: Digital Twins Assisted Service Function Chains in Softwarized 6G Networks for Emerging V2X
    Cao, Haotong
    Lin, Zhi
    Yang, Longxiang
    Wang, Jiangzhou
    Guizani, Mohsen
    IEEE NETWORK, 2023, 37 (04): : 289 - 296