Adaptive Search-based Repair of Deep Neural Networks

被引:3
|
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Laurent, Thomas [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
关键词
Deep Neural Networks; DNN Repair; Search-Based Software Engineering; Fault Localisation; LOCALIZATION;
D O I
10.1145/3583131.3590477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep Neural Networks (DNNs) are finding a place at the heart of more and more critical systems, and it is necessary to ensure they perform in as correct a way as possible. Search-based repair methods, that search for new values for target neuron weights in the network to better process fault-inducing inputs, have shown promising results. These methods rely on fault localisation to determine what weights the search should target. However, as the search progresses and the network evolves, the weights responsible for the faults in the system will change, and the search will lose in effectiveness. In this work, we propose an adaptive search method for DNN repair that adaptively updates the target weights during the search by performing fault localisation on the current state of the model. We propose and implement two methods to decide when to update the target weights, based on the progress of the search's fitness value or on the evolution of fault localisation results. We apply our technique to two image classification DNN architectures against a dataset of autonomous driving images, and compare it with a state-of-the art search-based DNN repair approach.
引用
收藏
页码:1527 / 1536
页数:10
相关论文
共 50 条
  • [1] Arachne: Search-Based Repair of Deep Neural Networks
    Sohn, Jeongju
    Kang, Sungmin
    Yoo, Shin
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2023, 32 (04)
  • [2] DeepEvolution: A Search-Based Testing Approach for Deep Neural Networks
    Ben Braiek, Houssem
    Khomh, Foutse
    2019 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2019), 2019, : 454 - 458
  • [3] A Search-Based Testing Framework for Deep Neural Networks of Source Code Embedding
    Pour, Maryam Vahdat
    Li, Zhuo
    Ma, Lei
    Hemmati, Hadi
    2021 14TH IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2021), 2021, : 36 - 46
  • [4] Stochastic Search-Based Neural Networks Learning Algorithms
    Nikolic, Konstantin P.
    Scepanovic, Ivan B.
    NEUREL 2008: NINTH SYMPOSIUM ON NEURAL NETWORK APPLICATIONS IN ELECTRICAL ENGINEERING, PROCEEDINGS, 2008, : 98 - 102
  • [5] Improving Search-Based Automatic Program Repair With Neural Machine Translation
    Li, Dongcheng
    Wong, W. Eric
    Jian, Mingyong
    Geng, Yi
    Chau, Matthew
    IEEE ACCESS, 2022, 10 : 51167 - 51175
  • [6] Constructing Search Spaces for Search-Based Software Testing Using Neural Networks
    Joffe, Leonid
    Clark, David
    SEARCH-BASED SOFTWARE ENGINEERING, SSBSE 2019, 2019, 11664 : 27 - 41
  • [7] Accelerating Search-based Program Repair
    Mehne, Ben
    Yoshida, Hiroaki
    Prasad, Mukul R.
    Sen, Koushik
    Gopinath, Divya
    Khurshid, Sarfraz
    2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST), 2018, : 227 - 238
  • [8] A Novel Approach For Search-Based Program Repair
    Trujillo, Leonardo
    Villanueva, Omar M.
    Hernandez, Daniel Eduardo
    IEEE SOFTWARE, 2021, 38 (04) : 36 - 42
  • [9] Ex2: Monte Carlo Tree Search-based test inputs prioritization for fuzzing deep neural networks
    Ye, Aoshuang
    Wang, Lina
    Zhao, Lei
    Ke, Jianpeng
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (12) : 11966 - 11984
  • [10] A novel LSTM–CNN–grid search-based deep neural network for sentiment analysis
    Ishaani Priyadarshini
    Chase Cotton
    The Journal of Supercomputing, 2021, 77 : 13911 - 13932