Deep Reinforcement Learning-based Context-Aware Redundancy Mitigation for Vehicular Collective Perception Services

被引:6
|
作者
Jung, Beopgwon [1 ]
Kim, Joonwoo [1 ]
Pack, Sangheon [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Collective Perception Service; Intelligent Transportation System; ETSI Redundancy Mitigation Scheme; Deep Reinforcement Learning;
D O I
10.1109/ICOIN53446.2022.9687254
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Collective perception service (CPS) is one of the most fundamental services in intelligent transportation systems. Since it can incur significant overhead in exchanging perceived object containers (POCs), european telecommunications standards institute (ETSI) introduced several redundancy mitigation schemes; however, there are several limitations in application to the vehicular environment. In this paper, we propose a deep reinforcement learning (DRL)-based context-aware redundancy mitigation (DRL-CARM) scheme where various vehicular contexts (i.e., location, speed, heading, and perception area) are employed for redundancy mitigation. To derive the optimal policy on redundancy mitigation, the DRL-CARM scheme employs a deep Q-network (DQN) with a reward function on the usefulness of POC. Evaluation results demonstrate that the DRL-CARM scheme can improve the average usefulness of POC by 254% and reduce the network load by 49.4%, compared with conventional redundancy mitigation schemes.
引用
收藏
页码:276 / 279
页数:4
相关论文
共 50 条
  • [41] Deep reinforcement learning-based cooperative interactions among heterogeneous vehicular networks
    Wang, Jingyu
    Zhuang, Zirui
    Qi, Qi
    Li, Tonghong
    Liao, Jianxin
    APPLIED SOFT COMPUTING, 2019, 82
  • [42] Context-Aware Reinforcement Learning for Supporting WiFi Connectivity for Vehicles
    Hussain, Mushahid
    Franca, Felipe
    Aguiar, Ana
    2023 IEEE VEHICULAR NETWORKING CONFERENCE, VNC, 2023, : 65 - 68
  • [43] Federated Deep Reinforcement Learning-Based Task Allocation in Vehicular Fog Computing
    Shi, Jinming
    Du, Jun
    Wang, Jian
    Yuan, Jian
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [44] A Deep Reinforcement Learning-Based Resource Management Game in Vehicular Edge Computing
    Zhu, Xiaoyu
    Luo, Yueyi
    Liu, Anfeng
    Xiong, Neal N.
    Dong, Mianxiong
    Zhang, Shaobo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (03) : 2422 - 2433
  • [45] A context-aware approach to automated negotiation using reinforcement learning
    Krohling, Dan E.
    Chiotti, Omar J. A.
    Martinez, Ernesto C.
    ADVANCED ENGINEERING INFORMATICS, 2021, 47
  • [46] Context-Aware Mobility Management in HetNets: A Reinforcement Learning Approach
    Simsek, Meryem
    Bennis, Mehdi
    Guvenc, Ismail
    2015 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2015, : 1536 - 1541
  • [47] A context-aware approach to automated negotiation using reinforcement learning
    Kröhling, Dan E.
    Chiotti, Omar J.A.
    Martínez, Ernesto C.
    Advanced Engineering Informatics, 2021, 47
  • [48] Context-Aware Ranking by Constructing a Virtual Environment for Reinforcement Learning
    Zhang, Junqi
    Mao, Jiaxin
    Liu, Yiqun
    Zhang, Ruizhe
    Zhang, Min
    Ma, Shaoping
    Xu, Jun
    Tian, Qi
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 1603 - 1612
  • [49] Toward Smart Multizone HVAC Control by Combining Context-Aware System and Deep Reinforcement Learning
    Deng, Xiangtian
    Zhang, Yi
    Zhang, Yi
    Qi, He
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (21) : 21010 - 21024
  • [50] Request-adaptive Packet Dissemination for Context-aware Services in Vehicular Networks
    Shafiee, Kaveh
    Leung, Victor C. M.
    Sengupta, Raja
    2012 IEEE VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2012,