Test input generation from cause-effect graphs

被引:9
|
作者
Ufuktepe, Deniz Kavzak [1 ]
Ayav, Tolga [2 ]
Belli, Fevzi [2 ,3 ]
机构
[1] Univ Missouri, Dept Elect Engn & Comp Sci, Columbia, MO USA
[2] Izmir Inst Technol, Dept Comp Engn, Izmir, Turkey
[3] Paderborn Univ, Dept Elect Engn & Informat Technol, Paderborn, Germany
关键词
Test input generation; Specification-based testing; Cause-effect graph; Spectral analysis; Boolean expressions; SELECTION-STRATEGIES;
D O I
10.1007/s11219-021-09560-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Cause-effect graphing is a well-known requirement-based and systematic testing method with a heuristic approach. Since it was introduced by Myers in 1979, there have not been any sufficiently comprehensive studies to generate test inputs from these graphs. However, there exist several methods for test input generation from Boolean expressions. Cause-effect graphs can be more convenient for a wide variety of users compared to Boolean expressions. Moreover, they can be used to enforce common constraints and rules on the system variables of different expressions of the system. This study proposes a new mutant-based test input generation method, Spectral Testing for Boolean specification models based on spectral analysis of Boolean expressions using mutations of the original expression. Unlike Myers' method, Spectral Testing is an algorithmic and deterministic method, in which we model the possible faults systematically. Furthermore, the conversion of cause-effect graphs between Boolean expressions is explored so that the existing test input generation methods for Boolean expressions can be exploited for cause-effect graphing. A software is developed as an open-source extendable tool for generating test inputs from cause-effect graphs by using different methods and performing mutation analysis for quantitative evaluation on these methods for further analysis and comparison. Selected methods, MI, MAX-A, MUTP, MNFP, CUTPNFP, MUMCUT, Unique MC/DC, and Masking MC/DC are implemented together with Myers' technique and the proposed Spectral Testing in the developed tool. For mutation testing, 9 common fault types of Boolean expressions are modeled, implemented, and generated in the tool. An XML-based standard on top of GraphML representing a cause-effect graph is proposed and is used as the input type to the approach. An empirical study is performed by a case study on 5 different systems with various requirements, including the benchmark set from the TCAS-II system. Our results show that the proposed XML-based cause-effect graph model can be used to represent system requirements. The developed tool can be used for test input generation from proposed cause-effect graph models and can perform mutation analysis to distinguish between the methods with respect to the effectiveness of test inputs and their mutant kill scores. The proposed Spectral Testing method outperforms the state-of-the-art methods in the context of critical systems, regarding both the effectiveness and mutant kill scores of the generated test inputs, and increasing the chances of revealing faults in the system and reducing the cost of testing. Moreover, the proposed method can be used as a separate or complementary method to other well-performing test input generation methods for covering specific fault types.
引用
收藏
页码:733 / 782
页数:50
相关论文
共 50 条
  • [21] Endometriosis and infertility - A cause-effect relationship?
    Barbieri, RL
    Missmer, S
    ENDOMETRIOSIS: EMERGING RESEARCH AND INTERVENTION STRATEGIES, 2002, 955 : 23 - 36
  • [22] Cause-effect of oxidative stress and apoptosis
    Kehrer, JP
    TERATOLOGY, 2000, 62 (04) : 235 - 236
  • [23] Chemical reactivity: cause-effect or interaction?
    Alfio Zambon
    Foundations of Chemistry, 2022, 24 : 375 - 387
  • [24] The GRA in Cause-Effect Space of Resources
    Deng Julong
    JOURNAL OF GREY SYSTEM, 2009, 21 (02): : 113 - 118
  • [25] PREDICTING CAUSE-EFFECT RELATIONSHIPS FROM INCOMPLETE DISCRETE OBSERVATIONS
    BOROS, E
    HAMMER, PL
    HOOKER, JN
    SIAM JOURNAL ON DISCRETE MATHEMATICS, 1994, 7 (04) : 531 - 543
  • [26] An Algorithm for Orienting Graphs Based on Cause-Effect Pairs and Its Applications to Orienting Protein Networks
    Medvedovsky, Alexander
    Bafna, Vineet
    Zwick, Uri
    Sharan, Roded
    ALGORITHMS IN BIOINFORMATICS, WABI 2008, 2008, 5251 : 222 - +
  • [27] Using cause-effect graphs to elicit expert knowledge for cross-impact balance analysis
    Stankov, Ivana
    Useche, Andres F.
    Meisel, Jose D.
    Montes, Felipe
    Morais, Lidia M. O.
    Al Friche, Amelia
    Langellier, Brent A.
    Hovmand, Peter
    Sarmiento, Olga L.
    Hammond, Ross A.
    Roux, Ana V. Diez
    METHODSX, 2021, 8
  • [28] Cause-Effect Models of Large Landslides
    Ewald P. Brückl
    Natural Hazards, 2001, 23 : 291 - 314
  • [29] Imitation Learning as Cause-Effect Reasoning
    Katz, Garrett
    Huang, Di-Wei
    Gentili, Rodolphe
    Reggia, James
    ARTIFICIAL GENERAL INTELLIGENCE (AGI 2016), 2016, 9782 : 64 - 73
  • [30] Cause-effect models of large landslides
    Bückl, EP
    NATURAL HAZARDS, 2001, 23 (2-3) : 291 - 314