Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment

被引:0
|
作者
Yiwei Zhang
Min Zhang
Caixia Fan
Fuqiang Li
Baofang Li
机构
[1] Henan Agricultural University,College of Sciences
[2] State Grid Henan Skills Training Center,undefined
关键词
Internet of Vehicles; Mobile edge computing; Reinforcement learning; Experience replay method; Resource allocation; Offloading strategy;
D O I
暂无
中图分类号
学科分类号
摘要
With the emergence and development of 5G technology, Mobile Edge Computing (MEC) has been closely integrated with Internet of Vehicles (IoV) technology, which can effectively support and improve network performance in IoV. However, the high-speed mobility of vehicles and diversity of communication quality make computing task offloading strategies more complex. To solve the problem, this paper proposes a computing resource allocation scheme based on deep reinforcement learning network for mobile edge computing scenarios in IoV. Firstly, the task resource allocation model for IoV in corresponding edge computing scenario is determined regarding the computing capacity of service nodes and vehicle moving speed as constraints. Besides, the mathematical model for task offloading and resource allocation is established with the minimum total computing cost as objective function. Then, deep Q-learning network based on deep reinforcement learning network is proposed to solve the mathematical model of resource allocation. Moreover, experience replay method is used to solve the instability of nonlinear approximate function neural network, which can avoid falling into dimension disaster and ensure the low-overhead and low-latency operation requirements of resource allocation. Finally, simulation results show that proposed scheme can effectively allocate the computing resources of IoV in edge computing environment. When the number of user uploaded data is 10K bits and the number of terminals is 15, it still shows the excellent network performance of low-overhead and low-latency.
引用
收藏
相关论文
共 50 条
  • [31] Deep Reinforcement Learning for Performance-Aware Adaptive Resource Allocation in Mobile Edge Computing
    Huang, Binbin
    Li, Zhongjin
    Xu, Yunqiu
    Pan, Linxuan
    Wang, Shangguang
    Hu, Haiyang
    Chang, Victor
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
  • [32] Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
    Alfakih, Taha
    Hassan, Mohammad Mehedi
    Gumaei, Abdu
    Savaglio, Claudio
    Fortino, Giancarlo
    IEEE ACCESS, 2020, 8 : 54074 - 54084
  • [33] Mobility-Aware Resource Allocation in Multi-Access Edge Computing using Deep Reinforcement Learning
    Din, Najamul
    Chen, Haopeng
    Khan, Daud
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 202 - 209
  • [34] Resource Allocation for Edge Computing in IoT Networks via Reinforcement Learning
    Liu, Xiaolan
    Qin, Zhijin
    Gao, Yue
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [35] Bandwidth Allocation and Trajectory Control in UAV-Assisted IoV Edge Computing Using Multiagent Reinforcement Learning
    Wang, Juzhen
    Zhang, Xiaoli
    He, Xingshi
    Sun, Yongqiang
    IEEE TRANSACTIONS ON RELIABILITY, 2023, 72 (02) : 599 - 608
  • [36] An efficient green computing fair resource allocation in cloud computing using modified deep reinforcement learning algorithm
    Karthiban, K.
    Raj, Jennifer S.
    SOFT COMPUTING, 2020, 24 (19) : 14933 - 14942
  • [37] User Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Panda, Subrat Prasad
    Banerjee, Ansuman
    Bhattacharya, Arani
    2021 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2021, 2021, : 447 - 458
  • [38] Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems via Multi-Agent Deep Reinforcement Learning
    Chen, Yan
    Sun, Yanjing
    Yu, Hao
    Taleb, Tarik
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04): : 3479 - 3494
  • [39] Deep Reinforcement Learning Empowered Resource Allocation in Vehicular Fog Computing
    Sun, Lijun
    Liu, Mingzhi
    Guo, Jiachen
    Yu, Xu
    Wang, Shangguang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7066 - 7076
  • [40] A deep reinforcement learning based hybrid algorithm for efficient resource scheduling in edge computing environment
    Xue, Fei
    Hai, Qiuru
    Dong, Tingting
    Cui, Zhihua
    Gong, Yuelu
    INFORMATION SCIENCES, 2022, 608 : 362 - 374