Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving

被引:24
|
作者
Xing, Rui [1 ]
Su, Zhou [2 ]
Zhang, Ning [4 ]
Peng, Yan [3 ]
Pu, Huayan [1 ]
Luo, Jun [2 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
[2] Shanghai Univ, Shanghai, Peoples R China
[3] Shanghai Univ, Res Inst USV Engn, Shanghai, Peoples R China
[4] Texas A&M Univ Christi, Corpus Christi, TX USA
来源
IEEE NETWORK | 2019年 / 33卷 / 05期
关键词
Intrusion detection; Reinforcement learning; Autonomous vehicles; Servers; Accidents; Vehicle safety; Internet of Things; SCHEME;
D O I
10.1109/MNET.001.1800535
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With ever-increasing penetration of autonomous driving vehicles (ADVs), security becomes of significant essence to autonomous vehicular networks (AVNs). On one hand, although cryptographic systems help deal with various attacks, they cannot resolve inside attacks from compromised or malfunctioning ADVs. On the other hand, ADVs with higher automated levels are easier to attack because the automated components onboard are vulnerable to inside attacks. These issues can be mitigated well by trust-based intrusion detection. Therefore,this article presents an efficient trust-based intrusion detection framework for AVNs. First, we propose a novel trust evaluation model for ADVs, in which all the trust evaluation information of a given ADV is utilized to compute its trust value. Then, based on the trust evaluation model, a two-level intrusion detection framework is presented. In the framework, the trustworthiness of an accident or attack warning is established not only based on trust evaluation with the coverage of a roadside unit (RSU), but also the information exchanged between RSUs through the cloud server. Afterward, we propose a reinforcement-learning-based incentive mechanism to stimulate ADVs to report warnings. Through the case study, the proposed framework outperforms the conventional mechanism and can reach a higher warning detection ratio than the conventional methods.
引用
收藏
页码:54 / 60
页数:7
相关论文
共 50 条
  • [31] A Selective Federated Reinforcement Learning Strategy for Autonomous Driving
    Fu, Yuchuan
    Li, Changle
    Yu, F. Richard
    Luan, Tom H.
    Zhang, Yao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (02) : 1655 - 1668
  • [32] Distributed Deep Reinforcement Learning on the Cloud for Autonomous Driving
    Spryn, Mitchell
    Sharma, Aditya
    Parkar, Dhawal
    Shrimal, Madhur
    PROCEEDINGS 2018 IEEE/ACM 1ST INTERNATIONAL WORKSHOP ON SOFTWARE ENGINEERING FOR AI IN AUTONOMOUS SYSTEMS (SEFAIAS), 2018, : 16 - 22
  • [33] Autonomous Highway Driving using Deep Reinforcement Learning
    Nageshrao, Subramanya
    Tseng, H. Eric
    Filev, Dimitar
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2326 - 2331
  • [34] A Deep Reinforcement Learning Approach for Autonomous Highway Driving
    Zhao, Junwu
    Qu, Ting
    Xu, Fang
    IFAC PAPERSONLINE, 2020, 53 (05): : 542 - 546
  • [35] Planning for Negotiations in Autonomous Driving using Reinforcement Learning
    Reshef, Roi
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 10595 - 10602
  • [36] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [37] A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios
    Liu, Yuqi
    Zhang, Qichao
    Zhao, Dongbin
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [38] Autonomous driving planning and decision making based on game theory and reinforcement learning
    Duan, Weiping
    Tang, Zhongyi
    Liu, Wei
    Zhou, Hongbiao
    EXPERT SYSTEMS, 2023, 40 (05)
  • [39] Prioritized Experience-Based Reinforcement Learning With Human Guidance for Autonomous Driving
    Wu, Jingda
    Huang, Zhiyu
    Huang, Wenhui
    Lv, Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 855 - 869
  • [40] DQN Reinforcement Learning-based Steering Control Strategy for Autonomous Driving
    Lin, Xinyou
    Ye, Zhuoming
    Zhou, Binhao
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2023, 59 (16): : 315 - 324