<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
|
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Optimization and promotion of automatic generation control strategy under large-scale wind power<bold> </bold>
    Li, Jun
    Sun, WenChuan
    Shi, Yu
    Li, Huicong
    Li, WeiWei
    Li, Na
    Hua, Feng
    2018 INTERNATIONAL CONFERENCE OF GREEN BUILDINGS AND ENVIRONMENTAL MANAGEMENT (GBEM 2018), 2018, 186
  • [22] Simulation System Based on Augmented Reality for Optimization of Training Tactics on Military Operations<bold> </bold>
    Amaguana, Fabricio
    Collaguazo, Brayan
    Tituana, Jonathan
    Aguilar, Wilbert G.
    AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2018, PT I, 2018, 10850 : 394 - 403
  • [23] <bold>Uncertainty propagation analysis using sparse grid technique and saddlepoint approximation based on</bold> parameterized <bold>p-box representation</bold>
    Liu, H. B.
    Jiang, C.
    Liu, J.
    Mao, J. Z.
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2019, 59 (01) : 61 - 74
  • [24] Simulation and Optimization for Investment Casting of Impeller Based on 3D Printing<bold> </bold>
    Zhang, Yue
    Li, Xue-Ying
    Zhang, Le-Ying
    Rong, Bei-Shang
    Cai, Qiang-Hu
    Zhu, Run-Feng
    Xu, Yue
    2018 INTERNATIONAL CONFERENCE OF GREEN BUILDINGS AND ENVIRONMENTAL MANAGEMENT (GBEM 2018), 2018, 186
  • [25] Quantity Optimization of Spare Parts For Offshore Wind Farm Based on Component Updating<bold> </bold>
    Zhang, KaiYu
    Feng, YuYao
    Cui, Yong
    Wang, ZeNing
    Yang, Fan
    2018 INTERNATIONAL CONFERENCE OF GREEN BUILDINGS AND ENVIRONMENTAL MANAGEMENT (GBEM 2018), 2018, 186
  • [26] Intelligent Routing Algorithm Based on Deep Belief Network for Multimedia Service in Knowledge Centric VANETs<bold> </bold>
    Zhang, Tao
    Chen, Xingyan
    Xu, Changqiao
    2018 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS (NANA), 2018, : 1 - 6
  • [27] Analysis of Atmospheric Effects on Millimeter Wave Frequency Bands for Fifth Generation Mobile Networks<bold> </bold>
    Erdogan, Kursad
    Ilgin, Hakki Alparslan
    2018 2ND INTERNATIONAL SYMPOSIUM ON MULTIDISCIPLINARY STUDIES AND INNOVATIVE TECHNOLOGIES (ISMSIT), 2018, : 319 - 322
  • [28] <bold>Computerized summary scoring: crowdsourcing-based latent semantic analysis</bold>
    Li, Haiying
    Cai, Zhiqiang
    Graesser, Arthur C.
    BEHAVIOR RESEARCH METHODS, 2018, 50 (05) : 2144 - 2161
  • [29] Data Mining Analysis Models Based on Prospective Detection of Infectious Disease<bold> </bold>
    Obaid, Ahmed J.
    MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING, ICMETE 2021, 2022, 373 : 425 - 437
  • [30] <bold>Design and Implementation of Automatic Test Instrument for Digital Circuits Based on USB 2.0 Interface</bold>
    Wang Weiguo
    Liu Hongbo
    Yang Fangtao
    Zheng Xinliao
    ICEMI 2007: PROCEEDINGS OF 2007 8TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS, VOL IV, 2007, : 758 - +