Adaptive Search-based Repair of Deep Neural Networks

被引:3
|
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Laurent, Thomas [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023 | 2023年
关键词
Deep Neural Networks; DNN Repair; Search-Based Software Engineering; Fault Localisation; LOCALIZATION;
D O I
10.1145/3583131.3590477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep Neural Networks (DNNs) are finding a place at the heart of more and more critical systems, and it is necessary to ensure they perform in as correct a way as possible. Search-based repair methods, that search for new values for target neuron weights in the network to better process fault-inducing inputs, have shown promising results. These methods rely on fault localisation to determine what weights the search should target. However, as the search progresses and the network evolves, the weights responsible for the faults in the system will change, and the search will lose in effectiveness. In this work, we propose an adaptive search method for DNN repair that adaptively updates the target weights during the search by performing fault localisation on the current state of the model. We propose and implement two methods to decide when to update the target weights, based on the progress of the search's fitness value or on the evolution of fault localisation results. We apply our technique to two image classification DNN architectures against a dataset of autonomous driving images, and compare it with a state-of-the art search-based DNN repair approach.
引用
收藏
页码:1527 / 1536
页数:10
相关论文
共 50 条
  • [21] A novel LSTM-CNN-grid search-based deep neural network for sentiment analysis
    Priyadarshini, Ishaani
    Cotton, Chase
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (12): : 13911 - 13932
  • [22] Gravitational search-based optimal deep neural network for occluded face recognition system in videos
    Shirley, C. P.
    Mohan, N. R. Ram
    Chitra, B.
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2021, 32 (01) : 189 - 215
  • [23] RRGcode: Deep hierarchical search-based code generation
    Gou, Qianwen
    Dong, Yunwei
    Wu, Yujiao
    Ke, Qiao
    JOURNAL OF SYSTEMS AND SOFTWARE, 2024, 211
  • [24] Digging into Semantics: Where Do Search-Based Software Repair Methods Search?
    Ahmad, Hammad
    Cashin, Padriac
    Forrest, Stephanie
    Weimer, Westley
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT II, 2022, 13399 : 3 - 18
  • [25] Orthogonal search-based rule extraction (OSRE) for trained neural networks: A practical and efficient approach
    Etchells, TA
    Lisboa, PJG
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (02): : 374 - 384
  • [26] Search for deep graph neural networks
    Feng, Guosheng
    Wang, Hongzhi
    Wang, Chunnan
    INFORMATION SCIENCES, 2023, 649
  • [27] Distributed Repair of Deep Neural Networks
    Calsi, Davide Li
    Duran, Matias
    Zhang, Xiao-Yi
    Arcaini, Paolo
    Ishikawa, Fuyuki
    2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2023, : 83 - 94
  • [28] Provable Repair of Deep Neural Networks
    Sotoudeh, Matthew
    Thakur, Aditya, V
    PROCEEDINGS OF THE 42ND ACM SIGPLAN INTERNATIONAL CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '21), 2021, : 588 - 603
  • [29] Federated Repair of Deep Neural Networks
    Li Calsi, Davide
    Laurent, Thomas
    Arcaini, Paolo
    Ishikawa, Fuyuki
    PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL WORKSHOP ON DEEP LEARNING FOR TESTING AND TESTING FOR DEEP LEARNING, DEEPTEST 2024, 2024, : 17 - 24
  • [30] An Adaptive Search Budget Allocation Approach for Search-Based Test Case Generation
    Scalabrino, Simone
    Mastropaolo, Antonio
    Bavota, Gabriele
    Oliveto, Rocco
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2021, 30 (03)