Deep Reinforcement Learning-Based Computation Offloading and Optimal Resource Allocation in Industrial Internet of Things with NOMA

被引:2
|
作者
Gao, Haofeng [1 ]
Guo, Xing [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
关键词
industrial Internet of Things(IIoT); Deep Reinforcement Learning(DRL); NOMA; Mobile edge computing(MEC); POWERED COMMUNICATION-NETWORKS; RATE MAXIMIZATION; WIRELESS;
D O I
10.1109/ICCCAS55266.2022.9825343
中图分类号
学科分类号
摘要
Multi-access mobile edge computing is considered as an important way to enable computationally intensive but latency-sensitive services in the future industrial IoT. In this paper, we consider a multi-access MEC network. Powered by WPT, each IID (IIoT devices) collects energy and then follows a binary offload policy, i.e., either executes the task locally or offloads to the MEC server for execution via a non-orthogonal multiple access (NOMA) approach. Where the channel gain from each IID (IoT device) to the edge computing server is time-varying. To address the goal of maximizing the total computation rate of all IIDs by jointly optimizing the selection of computation modes and the allocation of transmission time in dynamic channel scenarios, we propose a Deep Reinforcement Learning (DRL)-based computation offloading and resource allocation optimization method (DCOORA). The method is able to obtain near-optimal solutions under timevarying channels and, moreover, can solve the problem with very low computational complexity. Simulation results show that the hybrid framework based on online offloading of DRL obtains near-optimal computational performance for different network settings. In addition, it has very low computation time, which is particularly suitable for time-varying channel environments.
引用
收藏
页码:198 / 203
页数:6
相关论文
共 50 条
  • [31] Deep reinforcement learning-based joint optimization model for vehicular task offloading and resource allocation
    Li, Zhi-Yuan
    Zhang, Zeng-Xiang
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2024, 17 (04) : 2001 - 2015
  • [32] Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things
    Shi, Zhaoyuan
    Xie, Xianzhong
    Lu, Huabing
    Yang, Helin
    Kadoch, Michel
    Cheriet, Mohamed
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) : 3476 - 3489
  • [33] Federated Deep Reinforcement Learning for Energy-Efficient Edge Computing Offloading and Resource Allocation in Industrial Internet
    Li, Xuehua
    Zhang, Jiuchuan
    Pan, Chunyu
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [34] SDN Based Computation Offloading for Industrial Internet of Things
    Li, Gen
    Hua, Shutian
    Liu, Liang
    Zheng, Xiaolong
    Ma, Huadong
    2020 16TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2020), 2020, : 402 - 409
  • [35] Energy-efficient UAV-enabled computation offloading for industrial internet of things: a deep reinforcement learning approach
    Shi, Shuo
    Wang, Meng
    Gu, Shushi
    Zheng, Zhong
    WIRELESS NETWORKS, 2024, 30 (05) : 3921 - 3934
  • [36] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [37] Deep Reinforcement Learning-Based Adaptive Computation Offloading and Power Allocation in Vehicular Edge Computing Networks
    Qiu, Bin
    Wang, Yunxiao
    Xiao, Hailin
    Zhang, Zhongshan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13339 - 13349
  • [38] Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning
    Huang, Jiwei
    Wan, Jiangyuan
    Lv, Bofeng
    Ye, Qiang
    Chen, Ying
    IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2500 - 2511
  • [39] A Deep Reinforcement Learning-Based Caching Strategy for Internet of Things
    Nasehzadeh, Ali
    Wang, Ping
    2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 969 - 974
  • [40] Deep Reinforcement Learning-Based Cloud-Edge Collaborative Mobile Computation Offloading in Industrial Networks
    Chen, Siguang
    Chen, Jiamin
    Miao, Yifeng
    Wang, Qian
    Zhao, Chuanxin
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 : 364 - 375