Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving

被引:24
|
作者
Xing, Rui [1 ]
Su, Zhou [2 ]
Zhang, Ning [4 ]
Peng, Yan [3 ]
Pu, Huayan [1 ]
Luo, Jun [2 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
[2] Shanghai Univ, Shanghai, Peoples R China
[3] Shanghai Univ, Res Inst USV Engn, Shanghai, Peoples R China
[4] Texas A&M Univ Christi, Corpus Christi, TX USA
来源
IEEE NETWORK | 2019年 / 33卷 / 05期
关键词
Intrusion detection; Reinforcement learning; Autonomous vehicles; Servers; Accidents; Vehicle safety; Internet of Things; SCHEME;
D O I
10.1109/MNET.001.1800535
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With ever-increasing penetration of autonomous driving vehicles (ADVs), security becomes of significant essence to autonomous vehicular networks (AVNs). On one hand, although cryptographic systems help deal with various attacks, they cannot resolve inside attacks from compromised or malfunctioning ADVs. On the other hand, ADVs with higher automated levels are easier to attack because the automated components onboard are vulnerable to inside attacks. These issues can be mitigated well by trust-based intrusion detection. Therefore,this article presents an efficient trust-based intrusion detection framework for AVNs. First, we propose a novel trust evaluation model for ADVs, in which all the trust evaluation information of a given ADV is utilized to compute its trust value. Then, based on the trust evaluation model, a two-level intrusion detection framework is presented. In the framework, the trustworthiness of an accident or attack warning is established not only based on trust evaluation with the coverage of a roadside unit (RSU), but also the information exchanged between RSUs through the cloud server. Afterward, we propose a reinforcement-learning-based incentive mechanism to stimulate ADVs to report warnings. Through the case study, the proposed framework outperforms the conventional mechanism and can reach a higher warning detection ratio than the conventional methods.
引用
收藏
页码:54 / 60
页数:7
相关论文
共 50 条
  • [21] Deep reinforcement-learning-based driving policy for autonomous road vehicles
    Makantasis, Konstantinos
    Kontorinaki, Maria
    Nikolos, Ioannis
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (01) : 13 - 24
  • [22] Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving
    Zhu, Meixin
    Wang, Yinhai
    Pu, Ziyuan
    Hu, Jingyun
    Wang, Xuesong
    Ke, Ruimin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 117
  • [23] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [24] Deep Reinforcement Learning with Intervention Module for Autonomous Driving
    Chi, Huicong
    Wang, Ping
    Wang, Chao
    Wang, Xinhong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [25] Attention-Based Distributional Reinforcement Learning for Safe and Efficient Autonomous Driving
    Liu, Jia
    Yin, Jianwen
    Jiang, Zhengmin
    Liang, Qingyi
    Li, Huiyun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7477 - 7484
  • [26] Simulation-Based Reinforcement Learning for Real-World Autonomous Driving
    Osinski, Blazej
    Jakubowski, Adam
    Ziecina, Pawel
    Milos, Piotr
    Galias, Christopher
    Homoceanu, Silviu
    Michalewski, Henryk
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6411 - 6418
  • [27] Reinforcement Learning Based Overtaking Decision-Making for Highway Autonomous Driving
    Li, Xin
    Xu, Xin
    Zuo, Lei
    2015 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2015, : 336 - 342
  • [28] Dynamic Input for Deep Reinforcement Learning in Autonomous Driving
    Huegle, Maria
    Kalweit, Gabriel
    Mirchevska, Branka
    Werling, Moritz
    Boedecker, Joschka
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 7566 - 7573
  • [29] Deep Reinforcement Learning with Noisy Exploration for Autonomous Driving
    Li, Ruyang
    Zhang, Yaqiang
    Zhao, Yaqian
    Wei, Hui
    Xu, Zhe
    Zhao, Kun
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 8 - 14
  • [30] A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning
    Zhang, Xiaohui
    Sun, Jie
    Wang, Yunpeng
    Sun, Jian
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 4 : 626 - 638