Distributed Deep Deterministic Policy Gradient for Power Allocation Control in D2D-Based V2V Communications

被引:40
|
作者
Khoi Khac Nguyen [1 ]
Trung Q Duong [1 ]
Ngo Anh Vien [1 ]
Nhien-An Le-Khac [2 ]
Long D Nguyen [3 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Univ Coll Dublin, Sch Comp Sci, Dublin, Ireland
[3] Duy Tan Univ, Da Nang 550000, Vietnam
关键词
Non-cooperative D2D communication; D2D-based V2V communications; power allocation; multi-agent deep reinforcement learning; and deep deterministic policy gradient (DDPG); RESOURCE-ALLOCATION; NETWORKS;
D O I
10.1109/ACCESS.2019.2952411
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Device-to-device (D2D) communication is an emerging technology in the evolution of the 5G network enabled vehicle-to-vehicle (V2V) communications. It is a core technique for the next generation of many platforms and applications, e.g. real-time high-quality video streaming, virtual reality game, and smart city operation. However, the rapid proliferation of user devices and sensors leads to the need for more efficient resource allocation algorithms to enhance network performance while still capable of guaranteeing the quality-of-service. Currently, deep reinforcement learning is rising as a powerful tool to enable each node in the network to have a real-time self-organising ability. In this paper, we present two novel approaches based on deep deterministic policy gradient algorithm, namely "distributed deep deterministic policy gradient'' and "sharing deep deterministic policy gradient'', for the multi-agent power allocation problem in D2D-based V2V communications. Numerical results show that our proposed models outperform other deep reinforcement learning approaches in terms of the network's energy efficiency and fiexibility.
引用
收藏
页码:164533 / 164543
页数:11
相关论文
共 50 条
  • [31] Power Control and Evolutionary Strategy Based Slicing Resource Allocation for V2V Communication
    Liang, Yan
    Chen, Xin
    Ma, Teng
    Ma, Shengcheng
    Jiao, Libo
    2021 22ND ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2021, : 96 - 101
  • [32] Deep Reinforcement Learning Based Resource Allocation for 5G V2V Groupcast Communications
    Wu, Shang-Huan
    Hwang, Ren-Hung
    Wang, Chih-Yu
    Chou, Ching-Hsuan
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 1 - 6
  • [33] Joint Distributed and Centralized Resource Scheduling for D2D-based V2X Communication
    Li, Xiaoshuai
    Ma, Lin
    Xu, Yubin
    Shankaran, Rajan
    Orgun, Mehmet
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [34] Power Control for Broadcast V2V Communications with Adjacent Carrier Interference Effects
    Hisham, Anver
    Sun, Wanlu
    Strom, Erik G.
    Brannstrom, Fredrik
    2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
  • [35] Deep Deterministic Policy Gradient to Minimize the Age of Information in Cellular V2X Communications
    Mlika, Zoubeir
    Cherkaoui, Soumaya
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 23597 - 23612
  • [36] Energy-Efficient Power Control and Resource Allocation for V2V Communication
    Gao, Lei
    Hou, Yanzhao
    Tao, Xiaofeng
    Zhu, Min
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [37] Relay Selection in V2V Communications Based on 3-D Geometrical Channel Modeling
    Michailidis, Emmanouel T.
    Maliatsos, Konstantinos
    Kanatas, Athanasios G.
    2016 10TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION (EUCAP), 2016,
  • [38] Beam management optimization for V2V communications based on deep reinforcement learning
    Junliang Ye
    Xiaohu Ge
    Scientific Reports, 13
  • [39] Beam management optimization for V2V communications based on deep reinforcement learning
    Ye, Junliang
    Ge, Xiaohu
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [40] Graph-Based Resource Allocation with Conflict Avoidance for V2V Broadcast Communications
    Abanto-Leon, Luis F.
    Koppelaar, Arie
    de Groot, Sonia Heemstra
    2017 IEEE 28TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2017,