<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
|
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [41] <bold>Preliminary Usability Evaluation of PolyMeCo: A Visualization Based Tool for Mesh Analysis and Comparison</bold>
    Santos, Beatriz Sousa
    Silva, Samuel
    Teixeira, Leonor
    Ferreira, Carlos
    Dias, Paulo
    Madeira, Joaquim
    GMAI 2007: GEOMETRIC MODELING AND IMAGING, PROCEEDINGS, 2007, : 133 - +
  • [42] Group Mobility-Based Optimization of Cache Content in Wireless Device-to-Device Networks<bold> </bold>
    Naguib, K. M.
    Ali, A. S.
    Mahmoud, K. R.
    2018 14TH INTERNATIONAL COMPUTER ENGINEERING CONFERENCE (ICENCO), 2018, : 260 - 265
  • [43] Analysis of Handling Stability of Hydraulic Hybrid Vehicle based on ADAMS/Car Simulation<bold> </bold>
    Wang, Chao
    He, Xiaohui
    Shen, Xinmin
    Zhu, Jingwei
    Yin, Qin
    Xu, Lei
    2018 INTERNATIONAL CONFERENCE OF GREEN BUILDINGS AND ENVIRONMENTAL MANAGEMENT (GBEM 2018), 2018, 186
  • [44] Power System Low Frequency Oscillations Analysis Based on Adaptive ESPRIT method<bold> </bold>
    Wen, Lepeng
    Song, Jian
    Liu, Yupeng
    Zhang, Junhao
    Wen, He
    2021 IEEE 11TH INTERNATIONAL WORKSHOP ON APPLIED MEASUREMENTS FOR POWER SYSTEMS (AMPS), 2021,
  • [45] Test case generation of a protocol by a fault coverage analysis
    Kim, TH
    Hwang, IS
    Jang, MS
    Kang, SW
    Lee, JY
    Lee, SB
    TWELFTH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN-12), PROCEEDINGS, 1998, : 690 - 695
  • [46] <bold>FEASIBILITY TEST OF GMPLS BASED UNIFIED CONTROL PLANE FOR OPTICAL QUALITY CONTROL AND OPTICAL RESOURCE MANAGEMENT</bold>
    Mohamad, Abroad Suffian
    Asano, Shoichiro
    PROCEEDINGS OF THE FIFTH IASTED INTERNATIONAL CONFERENCE ON COMMUNICATIONS, INTERNET, AND INFORMATION TECHNOLOGY, 2006, : 123 - +
  • [47] An Eigenvalue Decomposition Method for Analysis and Design of Discrete-Time Multivariable Feedback Control Systems<bold> </bold>
    Gasparyan, Oleg N.
    ICNPAA 2018 WORLD CONGRESS: 12TH INTERNATIONAL CONFERENCE ON MATHEMATICAL PROBLEMS IN ENGINEERING, AEROSPACE AND SCIENCES, 2018, 2046
  • [48] Prediction of the 2017 French Election Based on Twitter Data Analysis Using Term Weighting<bold> </bold>
    Wang, Lei
    Gan, John Q.
    2018 10TH COMPUTER SCIENCE AND ELECTRONIC ENGINEERING CONFERENCE (CEEC), 2018, : 231 - 235
  • [49] Exposing the Rat in the Tunnel: Using Traffic Analysis for Tor-based Malware Detection<bold> </bold>
    Dodia, Priyanka
    AlSabah, Mashael
    Alrawi, Omar
    Wang, Tao
    PROCEEDINGS OF THE 2022 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, CCS 2022, 2022, : 875 - 889
  • [50] <bold>Techno-economic analysis of multiple bio-based routes to adipic acid</bold>
    Gunukula, Sampath
    Anex, Robert P.
    BIOFUELS BIOPRODUCTS & BIOREFINING-BIOFPR, 2017, 11 (05): : 897 - 907