Distributed Deep Deterministic Policy Gradient for Power Allocation Control in D2D-Based V2V Communications

被引:40
|
作者
Khoi Khac Nguyen [1 ]
Trung Q Duong [1 ]
Ngo Anh Vien [1 ]
Nhien-An Le-Khac [2 ]
Long D Nguyen [3 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Univ Coll Dublin, Sch Comp Sci, Dublin, Ireland
[3] Duy Tan Univ, Da Nang 550000, Vietnam
关键词
Non-cooperative D2D communication; D2D-based V2V communications; power allocation; multi-agent deep reinforcement learning; and deep deterministic policy gradient (DDPG); RESOURCE-ALLOCATION; NETWORKS;
D O I
10.1109/ACCESS.2019.2952411
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Device-to-device (D2D) communication is an emerging technology in the evolution of the 5G network enabled vehicle-to-vehicle (V2V) communications. It is a core technique for the next generation of many platforms and applications, e.g. real-time high-quality video streaming, virtual reality game, and smart city operation. However, the rapid proliferation of user devices and sensors leads to the need for more efficient resource allocation algorithms to enhance network performance while still capable of guaranteeing the quality-of-service. Currently, deep reinforcement learning is rising as a powerful tool to enable each node in the network to have a real-time self-organising ability. In this paper, we present two novel approaches based on deep deterministic policy gradient algorithm, namely "distributed deep deterministic policy gradient'' and "sharing deep deterministic policy gradient'', for the multi-agent power allocation problem in D2D-based V2V communications. Numerical results show that our proposed models outperform other deep reinforcement learning approaches in terms of the network's energy efficiency and fiexibility.
引用
收藏
页码:164533 / 164543
页数:11
相关论文
共 50 条
  • [1] Radio resource allocation for D2D-based V2V communications with Lyapunov optimization
    Yu, Nan
    Mei, Jie
    Zhao, Long
    Zheng, Kan
    Zhao, Hui
    2017 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2017, : 310 - 315
  • [2] D2D-based V2V Communications with Latency and Reliability Constraints
    Sun, Wanlu
    Strom, Erik G.
    Brannstrom, Fredrik
    Sui, Yutao
    Sou, Kin Cheong
    2014 GLOBECOM WORKSHOPS (GC WKSHPS), 2014, : 1414 - 1419
  • [3] Three-Dimensional Resource Allocation in D2D-Based V2V Communication
    Khan, Usman Ali
    Lee, Sang Sun
    ELECTRONICS, 2019, 8 (09)
  • [4] Resource Allocation in D2D-based V2V Communication for Maximizing the Number of Concurrent Transmissions
    Zhang, Shiyu
    Hou, Yanzhao
    Xu, Xiaodong
    Tao, Xiaofeng
    2016 IEEE 27TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2016, : 1811 - 1816
  • [5] Radio Resource Management for D2D-Based V2V Communication
    Sun, Wanlu
    Strom, Erik G.
    Brannstrom, Fredrik
    Sou, Kin Cheong
    Sui, Yutao
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2016, 65 (08) : 6636 - 6650
  • [6] Open sub-granting radio resources in overlay D2D-based V2V communications
    Dariush Moahammad Soleymani
    Mohammad Reza Gholami
    Giovanni Del Galdo
    Jens Mueckenheim
    Andreas Mitschele-Thiel
    EURASIP Journal on Wireless Communications and Networking, 2022
  • [7] Open sub-granting radio resources in overlay D2D-based V2V communications
    Soleymani, Dariush Moahammad
    Gholami, Mohammad Reza
    Del Galdo, Giovanni
    Mueckenheim, Jens
    Mitschele-Thiel, Andreas
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2022, 2022 (01)
  • [8] Power Control in D2D-Based Multi-Antenna V2V Underlay Cellular Networks with Rate Constraints
    Liu, Xinxin
    Li, Yunzhou
    Xiao, Limin
    Wang, Jing
    MILCOM 2017 - 2017 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2017, : 197 - 202
  • [9] Multiobjective optimization-based radio resource allocation and sharing algorithm for D2D-based V2V communication
    Feki, Souhir
    Belghith, Aymen
    Zarai, Faouzi
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2020, 31 (03)
  • [10] Resource Sharing and Power Allocation for D2D-based Safety-Critical V2X Communications
    Sun, Wanlu
    Yuan, Di
    Strom, Erik G.
    Brannstrom, Fredrik
    2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION WORKSHOP (ICCW), 2015, : 2399 - 2405