Black-Box Test Generation from Inferred Models

被引:14
|
作者
Papadopoulos, Petros [1 ]
Walkinshaw, Neil [1 ]
机构
[1] Univ Leicester, Dept Comp Sci, Leicester LE1 7RH, Leics, England
关键词
D O I
10.1109/RAISE.2015.11
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatically generating test inputs for components without source code (are 'black-box') and specification is challenging. One particularly interesting solution to this problem is to use Machine Learning algorithms to infer testable models from program executions in an iterative cycle. Although the idea has been around for over 30 years, there is little empirical information to inform the choice of suitable learning algorithms, or to show how good the resulting test sets are. This paper presents an openly available framework to facilitate experimentation in this area, and provides a proof-of-concept inference-driven testing framework, along with evidence of the efficacy of its test sets on three programs.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [41] Global sensitivity analyses for test planning with black-box models for Mars Sample Return
    Cataldo, Giuseppe
    Borgonovo, Emanuele
    Siddens, Aaron
    Carpenter, Kevin
    Nado, Martin
    Plischke, Elmar
    RISK ANALYSIS, 2025,
  • [42] Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models
    Zhan, Zhihan
    Wang, Shuohang
    Yu, Wenhao
    Xu, Yichong
    Iter, Dan
    Zeng, Qingkai
    Liu, Yang
    Zhu, Chenguang
    Jiang, Meng
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 9850 - 9867
  • [43] On path-wise automatic generation of test data for both white-box and black-box testing
    Shan, JH
    Wang, J
    Qi, ZC
    APSEC 2001: EIGHTH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, PROCEEDINGS, 2001, : 237 - 240
  • [44] A New Method for SSD Black-box Performance Test
    Xie, Qiyou
    2017 PROGRESS IN ELECTROMAGNETICS RESEARCH SYMPOSIUM - SPRING (PIERS), 2017, : 1116 - 1122
  • [45] AN ALGORITHM FOR AUTOMATICALLY GENERATING BLACK-BOX TEST CASES
    Xu Baowen Nie Changhai Shi Qunfeng Lu Hong (Department of computer Science & Engineering
    JournalofElectronics(China), 2003, (01) : 74 - 77
  • [46] Comparing Explanations from Glass-Box and Black-Box Machine-Learning Models
    Kuk, Michal
    Bobek, Szymon
    Nalepa, Grzegorz J.
    COMPUTATIONAL SCIENCE - ICCS 2022, PT III, 2022, 13352 : 668 - 675
  • [47] Black-box Adversarial Attacks on Video Recognition Models
    Jiang, Linxi
    Ma, Xingjun
    Chen, Shaoxiang
    Bailey, James
    Jiang, Yu-Gang
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 864 - 872
  • [48] Feature Importance Explanations for Temporal Black-Box Models
    Sood, Akshay
    Craven, Mark
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 8351 - 8360
  • [49] On the Impossibility of Virtual Black-Box Obfuscation in Idealized Models
    Mahmoody, Mohammad
    Mohammed, Ameer
    Nematihaji, Soheil
    THEORY OF CRYPTOGRAPHY, TCC 2016-A, PT I, 2016, 9562 : 18 - 48
  • [50] Capturing the form of feature interactions in black-box models
    Zhang, Hanying
    Zhang, Xiaohang
    Zhang, Tianbo
    Zhu, Ji
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (04)