Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment

被引:0
|
作者
Yiwei Zhang
Min Zhang
Caixia Fan
Fuqiang Li
Baofang Li
机构
[1] Henan Agricultural University,College of Sciences
[2] State Grid Henan Skills Training Center,undefined
关键词
Internet of Vehicles; Mobile edge computing; Reinforcement learning; Experience replay method; Resource allocation; Offloading strategy;
D O I
暂无
中图分类号
学科分类号
摘要
With the emergence and development of 5G technology, Mobile Edge Computing (MEC) has been closely integrated with Internet of Vehicles (IoV) technology, which can effectively support and improve network performance in IoV. However, the high-speed mobility of vehicles and diversity of communication quality make computing task offloading strategies more complex. To solve the problem, this paper proposes a computing resource allocation scheme based on deep reinforcement learning network for mobile edge computing scenarios in IoV. Firstly, the task resource allocation model for IoV in corresponding edge computing scenario is determined regarding the computing capacity of service nodes and vehicle moving speed as constraints. Besides, the mathematical model for task offloading and resource allocation is established with the minimum total computing cost as objective function. Then, deep Q-learning network based on deep reinforcement learning network is proposed to solve the mathematical model of resource allocation. Moreover, experience replay method is used to solve the instability of nonlinear approximate function neural network, which can avoid falling into dimension disaster and ensure the low-overhead and low-latency operation requirements of resource allocation. Finally, simulation results show that proposed scheme can effectively allocate the computing resources of IoV in edge computing environment. When the number of user uploaded data is 10K bits and the number of terminals is 15, it still shows the excellent network performance of low-overhead and low-latency.
引用
收藏
相关论文
共 50 条
  • [21] A Scheduling Scheme in a Container-Based Edge Computing Environment Using Deep Reinforcement Learning Approach
    Lu, Tingting
    Zeng, Fanping
    Shen, Jingfei
    Chen, Guozhu
    Shu, Wenjuan
    Zhang, Weikang
    2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021), 2021, : 56 - 65
  • [22] Deep reinforcement learning-based resource allocation in multi-access edge computing
    Khani, Mohsen
    Sadr, Mohammad Mohsen
    Jamali, Shahram
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023,
  • [23] Resource Allocation for Mobile Edge Computing System Considering User Mobility with Deep Reinforcement Learning
    Tokuda, Kairi
    Sato, Takehiro
    Oki, Eiji
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2024, E107B (01) : 173 - 184
  • [24] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Jianqiao
    Xu, Zhuohan
    Shi, Bing
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [25] Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Zhao, Junhui
    Quan, Haoyu
    Xia, Minghua
    Wang, Dongming
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5834 - 5848
  • [26] Blockchain-Based Edge Computing Resource Allocation in IoT: A Deep Reinforcement Learning Approach
    He, Ying
    Wang, Yuhang
    Qiu, Chao
    Lin, Qiuzhen
    Li, Jianqiang
    Ming, Zhong
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2226 - 2237
  • [27] Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing
    Deng, Xiaoheng
    Zhang, Jingjing
    Zhang, Honggang
    Jiang, Ping
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (06) : 5364 - 5377
  • [28] Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning
    Chu, Jiawen
    Pan, Chunyun
    Wang, Yafei
    Yun, Xiang
    LI, Xuehua
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (05) : 439 - 447
  • [29] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Zhuohan
    Zhong, Zeheng
    Shi, Bing
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [30] Deep Reinforcement Learning for Edge Computing Resource Allocation in Blockchain Network Slicing Broker Framework
    Gong, Yu
    Sun, Siyuan
    Wei, Yifei
    Song, Mei
    2021 IEEE 93RD VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-SPRING), 2021,