Distributed Deep Deterministic Policy Gradient for Power Allocation Control in D2D-Based V2V Communications

被引:40
|
作者
Khoi Khac Nguyen [1 ]
Trung Q Duong [1 ]
Ngo Anh Vien [1 ]
Nhien-An Le-Khac [2 ]
Long D Nguyen [3 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Univ Coll Dublin, Sch Comp Sci, Dublin, Ireland
[3] Duy Tan Univ, Da Nang 550000, Vietnam
关键词
Non-cooperative D2D communication; D2D-based V2V communications; power allocation; multi-agent deep reinforcement learning; and deep deterministic policy gradient (DDPG); RESOURCE-ALLOCATION; NETWORKS;
D O I
10.1109/ACCESS.2019.2952411
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Device-to-device (D2D) communication is an emerging technology in the evolution of the 5G network enabled vehicle-to-vehicle (V2V) communications. It is a core technique for the next generation of many platforms and applications, e.g. real-time high-quality video streaming, virtual reality game, and smart city operation. However, the rapid proliferation of user devices and sensors leads to the need for more efficient resource allocation algorithms to enhance network performance while still capable of guaranteeing the quality-of-service. Currently, deep reinforcement learning is rising as a powerful tool to enable each node in the network to have a real-time self-organising ability. In this paper, we present two novel approaches based on deep deterministic policy gradient algorithm, namely "distributed deep deterministic policy gradient'' and "sharing deep deterministic policy gradient'', for the multi-agent power allocation problem in D2D-based V2V communications. Numerical results show that our proposed models outperform other deep reinforcement learning approaches in terms of the network's energy efficiency and fiexibility.
引用
收藏
页码:164533 / 164543
页数:11
相关论文
共 50 条
  • [21] Coalitional game based resource allocation in D2D-enabled V2V communication
    Ma Piming
    Zhao Peng
    Bai Zhiquan
    Dong Xu
    Yang Xinghai
    Kwak, Kyungsup
    JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2023, 34 (06) : 1508 - 1519
  • [22] Power Allocation With Energy Efficiency Optimization in Cellular D2D-Based V2X Communication Network
    Xiao, Hailin
    Zhu, Dan
    Chronopoulos, Anthony Theodore
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (12) : 4947 - 4957
  • [23] Resource Allocation for D2D-Based V2X Communication With Imperfect CSI
    Li, Xiaoshuai
    Ma, Lin
    Xu, Yubin
    Shankaran, Rajan
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (04) : 3545 - 3558
  • [24] A Joint Power and Bandwidth Allocation Method Based on Deep Reinforcement Learning for V2V Communications in 5G
    Hu, Xin
    Xu, Sujie
    Wang, Libing
    Wang, Yin
    Liu, Zhijun
    Xu, Lexi
    Li, You
    Wang, Weidong
    CHINA COMMUNICATIONS, 2021, 18 (07) : 25 - 35
  • [25] A Joint Power and Bandwidth Allocation Method Based on Deep Reinforcement Learning for V2V Communications in 5G
    Xin Hu
    Sujie Xu
    Libing Wang
    Yin Wang
    Zhijun Liu
    Lexi Xu
    You Li
    Weidong Wang
    中国通信, 2021, 18 (07) : 25 - 35
  • [26] 时延QoS保证的D2D-based V2V车载通信功率分配方案
    李国睿
    周迪
    肖海林
    电子技术应用, 2019, 45 (03) : 71 - 75
  • [27] Efficient Radio Resource Management for D2D-based LTE-V2X communications
    Masmoudi, Ahlem
    Feki, Souhir
    Mnif, Kais
    Zarai, Faouzi
    2018 IEEE/ACS 15TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2018,
  • [28] Secure, Resilient and Stable Resource Allocation for D2D-based V2X Communication
    Yucel, Fatih
    Bhuyan, Arupjyoti
    Bulut, Eyuphan
    2020 RESILIENCE WEEK (RWS), 2020, : 71 - 77
  • [29] AoI-Driven Power Allocation and Batch Sampling Control for V2V Status Update Communications
    Guo, Chongtao
    Liu, Songtao
    Liao, Bin
    Wang, Zhigang
    Liang, Le
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (01) : 291 - 302
  • [30] Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications
    Han, Donghee
    So, Jaewoo
    SENSORS, 2023, 23 (03)