<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
|
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Performance Analysis of kNN-Based Image Demosaicing for VariableWindow Sizes<bold> </bold>
    Walia, Gurjot Kaur
    Sidhu, Jagroop Singh
    MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING, ICMETE 2021, 2022, 373 : 71 - 79
  • [32] SFuzz: Slice-based Fuzzing for Real-Time Operating Systems<bold> </bold>
    Chen, Libo
    Cai, Quanpu
    Ma, Zhenbang
    Wang, Yanhao
    Hu, Hong
    Shen, Minghang
    Liu, Yue
    Guo, Shanqing
    Duan, Haixin
    Jiang, Kaida
    Xue, Zhi
    PROCEEDINGS OF THE 2022 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, CCS 2022, 2022, : 485 - 498
  • [33] Large-scale microwave analysis based on domain decomposition method<bold> </bold>
    Takei, Amane
    Sakamoto, Makoto
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY ROBOTICS (ICT-ROBOT), 2018,
  • [34] Analysis and Protection of DDOS Attack Based on RSSP-II Protocol<bold> </bold>
    Liang, Zhongdi
    Hei, Xinhong
    Wang, Yichuan
    Ji, Wenjiang
    Zhu, Lei
    Zhang, Yefei
    2018 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS (NANA), 2018, : 117 - 120
  • [35] <bold>Quantification of Intermarket Influence Based on the Global Optimization and Its Application for Stock Market Prediction</bold>
    Tilakaratne, C. D.
    Mammadov, M. A.
    Hurst, C. P.
    AIDM 2006: INTERNATIONAL WORKSHOP ON INTEGRATING AI AND DATING MINING, 2006, : 42 - +
  • [36] Erosion potential assessment of watersheds through GIS<bold>-</bold>based hypsometric analysis: a case study of Kurram Tangi Dam
    Yousaf, Wasif
    Mohayud-Din-Hashmi, Syed Ghulam
    Akram, Usman
    Saeed, Urooj
    Ahmad, Sajid Rashid
    Umar, Muhammad
    Mubashir, Ambreena
    ARABIAN JOURNAL OF GEOSCIENCES, 2018, 11 (22)
  • [37] Intelligent Parameter Tuning Using Deep Q-Network for RED Algorithm in Adaptive Queue Management Systems<bold> </bold>
    Basheer, Ayman
    Hassan, Hassan Jaleel
    Muttasher, Gaida
    MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING, ICMETE 2021, 2022, 373 : 439 - 446
  • [38] Test Scenario Generation and Optimization Technology for Intelligent Driving Systems
    Duan, Jianli
    Gao, Feng
    He, Yingdong
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2022, 14 (01) : 115 - 127
  • [39] QuerySnout: Automating the Discovery of Attribute Inference Attacks against Query-Based Systems<bold> </bold>
    Cretu, Ana-Maria
    Houssiau, Florimond
    Cully, Antoine
    de Montjoye, Yves-Alexandre
    PROCEEDINGS OF THE 2022 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, CCS 2022, 2022, : 623 - 637
  • [40] <bold>PERFECTO: A SYSTEMC-BASED PERFORMANCE EVALUATION FRAMEWORK FOR DYNAMICALLY PARTIALLY RECONFIGURABLE SYSTEMS</bold>
    Hsiung, Pao-Ann
    Huang, Chun-Hsian
    Liao, Chih-Feng
    2006 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS, PROCEEDINGS, 2006, : 190 - 195