<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
|
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [1] ISTA: Automatic Test Case Generation and Optimization for Intelligent Systems based on Coverage Analysis
    Zheng, Wei
    Lin, Lidan
    Chen, Xiang
    Liu, Guoliang
    Huang, Hao
    Shen, Jinjin
    Xu, Qingqing
    Gu, Yizeng
    2023 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING, SANER, 2023, : 758 - 762
  • [2] <bold>Study on Optimization Method for CNC Machining Plastic</bold>-<bold>Shaped Appliances Based on ICOA Algorithm</bold>
    Chen, Guo-hua
    Zhou, Bo
    Zhao, Xiao
    Zhang, Zhi-yang
    Yan, Qing
    Mao, Jie
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2025, 26 (03) : 613 - 634
  • [3] <bold>Markov Process-Based Availability Analysis of Rendering Cluster Systems</bold>
    Wang, Yongbin
    Hong, Zhiguo
    Shi, Minyong
    ADVANCED RESEARCH ON AUTOMATION, COMMUNICATION, ARCHITECTONICS AND MATERIALS, PTS 1 AND 2, 2011, 225-226 (1-2): : 1024 - +
  • [4] <bold>Intelligent Data Analysis of Out-of-Hospital Cardiac Arrest</bold>
    Verlic, Mateja
    Krizmaric, Mijenko
    Grmec, Stefek
    Kokol, Peter
    TWENTIETH IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, PROCEEDINGS, 2007, : 109 - +
  • [5] <bold>Thermal Analysis and Optimization of Multiple LED Packaging </bold>Based on a General Analytical Solution
    Cheng, Ting
    Luo, Xiaobing
    Huang, Suyi
    Liu, Sheng
    2009 IEEE 59TH ELECTRONIC COMPONENTS AND TECHNOLOGY CONFERENCE, VOLS 1-4, 2009, : 1988 - +
  • [6] <bold>Analysis of Alternative Advisory Systems for Truck Dispatching</bold>
    da Silva, Aline Veronese
    Makowski, Bruno Grau
    Bass, Ellen J.
    Danziger, Eric
    Bassols, Fernando Fialho
    de Macedo Guimaraes, Lia Buarque
    2007 IEEE SYSTEMS AND INFORMATION ENGINEERING DESIGN SYMPOSIUM, 2007, : 164 - +
  • [7] <bold>Design Intelligent Multi-sensor Fire Monitoring Based on DSP</bold>
    Liu Baifen
    Zhang Yongxian
    Gan Fangcheng
    Wang Donghai
    ICEMI 2007: PROCEEDINGS OF 2007 8TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS, VOL IV, 2007, : 799 - +
  • [8] Automated Test Case Generation based on Coverage Analysis
    Majchrzak, Tim A.
    Kuchen, Herbert
    THIRD INTERNATIONAL SYMPOSIUM ON THEORETICAL ASPECTS OF SOFTWARE ENGINEERING, PROCEEDINGS, 2009, : 259 - 266
  • [9] Warpage Analysis and Optimization of IGBT Package Module in Reflow Process<bold> </bold>
    Shi, Hutao
    Cheng, Chunmin
    Ma, Kun
    Wu, Gai
    Sun, Xiang
    Shen, Wei
    Liang, Kang
    2024 25TH INTERNATIONAL CONFERENCE ON ELECTRONIC PACKAGING TECHNOLOGY, ICEPT, 2024,
  • [10] Real Loss Minimization in Power Systems via Recent Optimization Techniques<bold> </bold>
    Kuyu, Yigit Cagatay
    Vatansever, Fahri
    2018 2ND INTERNATIONAL SYMPOSIUM ON MULTIDISCIPLINARY STUDIES AND INNOVATIVE TECHNOLOGIES (ISMSIT), 2018, : 403 - 406