Reachability Analysis of Deep ReLU Neural Networks using Facet-Vertex Incidence

被引:9
|
作者
Yang, Xiaodong [1 ]
Johnson, Taylor T. [1 ]
Hoang-Dung Tran [2 ]
Yamaguchi, Tomoya [3 ]
Hoxha, Bardh [3 ]
Prokhorov, Danil [3 ]
机构
[1] Vanderbilt Univ, 221 Kirkland Hall, Nashville, TN 37235 USA
[2] Univ Nebraska, Lincoln, NE USA
[3] Toyota Res Inst, Ann Arbor, MI USA
关键词
D O I
10.1145/3447928.3456650
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep Neural Networks (DNNs) are powerful machine learning models for approximating complex functions. In this work, we provide an exact reachability analysis method for DNNs with Rectified Linear Unit (ReLU) activation functions. At its core, our set-based method utilizes a facet-vertex incidence matrix, which represents a complete encoding of the combinatorial structure of convex sets. When a safety violation is detected, our approach provides backtracking which determines the complete input set that caused the safety violation. The performance of our method is evaluated and compared to other state-of-the-art methods by using the ACAS Xu flight controller and other benchmarks.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] Error bounds for approximations with deep ReLU neural networks in Ws,p norms
    Guehring, Ingo
    Kutyniok, Gitta
    Petersen, Philipp
    ANALYSIS AND APPLICATIONS, 2020, 18 (05) : 803 - 859
  • [32] Optimal Approximation Rates for Deep ReLU Neural Networks on Sobolev and Besov Spaces
    Siegel, Jonathan W.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [33] Tight Bounds on the Smallest Eigenvalue of the Neural Tangent Kernel for Deep ReLU Networks
    Nguyen, Quynh
    Mondelli, Marco
    Montufar, Guido
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [34] USING DEEP NEURAL NETWORKS FOR RADIOGENOMIC ANALYSIS
    Smedley, Nova F.
    Hsu, William
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1529 - 1533
  • [35] Learning algorithm analysis for deep neural network with ReLu activation functions
    Placzek, Stanislaw
    Placzek, Aleksander
    COMPUTER APPLICATIONS IN ELECTRICAL ENGINEERING (ZKWE'2018), 2018, 19
  • [36] Stability Analysis and Controller Synthesis Using Single-Hidden-Layer ReLU Neural Networks
    Samanipour, Pouya
    Poonawala, Hasan A.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (01) : 202 - 213
  • [37] An exploration of testing genetic associations using goodness-of-fit statistics based on deep ReLU neural networks
    Shen, Xiaoxi
    Wang, Xiaoming
    FRONTIERS IN SYSTEMS BIOLOGY, 2024, 4
  • [38] Star based Reachability Analysis of Interval Neural Networks
    Bondalakunta, Vishnu
    Prabhakar, Pavithra
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 7982 - 7987
  • [39] NONPARAMETRIC REGRESSION USING DEEP NEURAL NETWORKS WITH RELU ACTIVATION FUNCTION (vol 48, pg 1875, 2020)
    Schmidt-Hieber, Johannes
    Vu, Don
    ANNALS OF STATISTICS, 2024, 52 (01): : 413 - 414
  • [40] Convergence Analysis of Two-layer Neural Networks with ReLU Activation
    Li, Yuanzhi
    Yuan, Yang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30