Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving

被引:24
|
作者
Xing, Rui [1 ]
Su, Zhou [2 ]
Zhang, Ning [4 ]
Peng, Yan [3 ]
Pu, Huayan [1 ]
Luo, Jun [2 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
[2] Shanghai Univ, Shanghai, Peoples R China
[3] Shanghai Univ, Res Inst USV Engn, Shanghai, Peoples R China
[4] Texas A&M Univ Christi, Corpus Christi, TX USA
来源
IEEE NETWORK | 2019年 / 33卷 / 05期
关键词
Intrusion detection; Reinforcement learning; Autonomous vehicles; Servers; Accidents; Vehicle safety; Internet of Things; SCHEME;
D O I
10.1109/MNET.001.1800535
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With ever-increasing penetration of autonomous driving vehicles (ADVs), security becomes of significant essence to autonomous vehicular networks (AVNs). On one hand, although cryptographic systems help deal with various attacks, they cannot resolve inside attacks from compromised or malfunctioning ADVs. On the other hand, ADVs with higher automated levels are easier to attack because the automated components onboard are vulnerable to inside attacks. These issues can be mitigated well by trust-based intrusion detection. Therefore,this article presents an efficient trust-based intrusion detection framework for AVNs. First, we propose a novel trust evaluation model for ADVs, in which all the trust evaluation information of a given ADV is utilized to compute its trust value. Then, based on the trust evaluation model, a two-level intrusion detection framework is presented. In the framework, the trustworthiness of an accident or attack warning is established not only based on trust evaluation with the coverage of a roadside unit (RSU), but also the information exchanged between RSUs through the cloud server. Afterward, we propose a reinforcement-learning-based incentive mechanism to stimulate ADVs to report warnings. Through the case study, the proposed framework outperforms the conventional mechanism and can reach a higher warning detection ratio than the conventional methods.
引用
收藏
页码:54 / 60
页数:7
相关论文
共 50 条
  • [1] Evaluation of Deep Reinforcement Learning Algorithms for Autonomous Driving
    Stang, Marco
    Grimm, Daniel
    Gaiser, Moritz
    Sax, Eric
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1576 - 1582
  • [2] Reinforcement Learning and Deep Learning Based Lateral Control for Autonomous Driving
    Li, Dong
    Zhao, Dongbin
    Zhang, Qichao
    Chen, Yaran
    IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (02) : 83 - 98
  • [3] Interpretable Autonomous Driving Model Based on Cognitive Reinforcement Learning
    Li, Yijia
    Qi, Hao
    Zhu, Fenghua
    Lv, Yisheng
    Ye, Peijun
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 515 - 520
  • [4] A Behavior Decision Method Based on Reinforcement Learning for Autonomous Driving
    Zheng, Kan
    Yang, Haojun
    Liu, Shiwen
    Zhang, Kuan
    Lei, Lei
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 25386 - 25394
  • [5] Reinforcement-Learning-Based Trajectory Learning in Frenet Frame for Autonomous Driving
    Yoon, Sangho
    Kwon, Youngjoon
    Ryu, Jaesung
    Kim, Sungkwan
    Choi, Sungwoo
    Lee, Kyungjae
    APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [6] Intrusion Detection in Autonomous Vehicular Networks: A Trust Assessment and Q-learning Approach
    Xing, Rui
    Su, Zhou
    Wang, Yuntao
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 79 - 83
  • [7] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [8] Path tracking control based on Deep reinforcement learning in Autonomous driving
    Jiang, Le
    Wang, Yafei
    Wang, Lin
    Wu, Jingkai
    2019 3RD CONFERENCE ON VEHICLE CONTROL AND INTELLIGENCE (CVCI), 2019, : 414 - 419
  • [9] Policy Gradient based Reinforcement Learning Approach for Autonomous Highway Driving
    Aradi, Szilard
    Becsi, Tamas
    Gaspar, Peter
    2018 IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS (CCTA), 2018, : 670 - 675
  • [10] Reinforcement Learning-Based Autonomous Driving at Intersections in CARLA Simulator
    Gutierrez-Moreno, Rodrigo
    Barea, Rafael
    Lopez-Guillen, Elena
    Araluce, Javier
    Bergasa, Luis M.
    SENSORS, 2022, 22 (21)