Specification testing of agent-based simulation using property-based testing

被引:0
|
作者
Thaler, Jonathan [1 ,2 ]
Siebers, Peer-Olaf [1 ]
机构
[1] Univ Nottingham, Sch Comp Sci, 7301 Wollaton Rd, Nottingham, England
[2] FH Vorarlberg, Dept Comp Sci, Hsch Str 1, A-6850 Dornbirn, Austria
关键词
Agent-based simulation testing; Code testing; Test driven development; Model specification; FRAMEWORK;
D O I
10.1007/s10458-020-09473-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The importance of Agent-Based Simulation (ABS) as scientific method to generate data for scientific models in general and for informed policy decisions in particular has been widely recognised. However, the important technique of code testing of implementations like unit testing has not generated much research interested so far. As a possible solution, in previous work we have explored the conceptual use ofproperty-based testing. In this code testing method, model specifications and invariants are expressed directly in code and tested throughautomatedandrandomisedtest data generation. This paper expands on our previous work and explores how to use property-based testing on a technical level to encode and test specifications of ABS. As use case the simple agent-based SIR model is used, where it is shown how to test agent behaviour, transition probabilities and model invariants. The outcome are specifications expressed directly in code, which relate whole classes of random input to expected classes of output. During test execution, random test data is generated automatically, potentially covering the equivalent of thousands of unit tests, run within seconds on modern hardware. This makes property-based testing in the context of ABS strictly more powerful than unit testing, as it is a much more natural fit due to its stochastic nature.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] A property-based testing framework for encryption programs
    Sun, Chang-ai
    Wang, Zuoyi
    Wang, Guan
    FRONTIERS OF COMPUTER SCIENCE, 2014, 8 (03) : 478 - 489
  • [32] A generic testing framework for agent-based simulation models
    Gurcan, O.
    Dikenelli, O.
    Bernon, C.
    JOURNAL OF SIMULATION, 2013, 7 (03) : 183 - 201
  • [33] A property-based testing framework for encryption programs
    Chang-ai Sun
    Zuoyi Wang
    Guan Wang
    Frontiers of Computer Science, 2014, 8 : 478 - 489
  • [34] Property-based Testing for LG Home Appliances using Accelerated Software-in-the-Loop Simulation
    Park, Mingyu
    Jang, Hoon
    Byun, Taejoon
    Choi, Yunja
    2020 IEEE/ACM 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: SOFTWARE ENGINEERING IN PRACTICE (ICSE-SEIP), 2020, : 120 - 129
  • [35] Property-based Testing of JSON']JSON based Web Services
    Fredlund, Lars-Ake
    Herranz, Angel
    Benac Earle, Clara
    Marino, Julio
    2014 IEEE 21ST INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2014), 2014, : 704 - 707
  • [36] Validation of SDN policies: a property-based testing perspective
    Castro, Laura M.
    Paladi, Nicolae
    10TH INT CONF ON EMERGING UBIQUITOUS SYST AND PERVAS NETWORKS (EUSPN-2019) / THE 9TH INT CONF ON CURRENT AND FUTURE TRENDS OF INFORMAT AND COMMUN TECHNOLOGIES IN HEALTHCARE (ICTH-2019) / AFFILIATED WORKOPS, 2019, 160 : 23 - 29
  • [37] Property-Based Testing in Simulation for Verifying Robot Action Execution in Tabletop Manipulation
    Sohail, Salman Omar
    Mitrevski, Alex
    Hochgeschwender, Nico
    Ploger, Paul G.
    10TH EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2021), 2021,
  • [38] Automating Property-based Testing of Evolving Web Services
    Li, Huiqing
    Thompson, Simon
    Seijas, Pablo Lamela
    Angel Francisco, Miguel
    PEPM '14: PROCEEDINGS OF THE ACM SIGPLAN WORKSHOP ON PARTIAL EVALUATION AND PROGRAM MANIPULATION, 2014, : 169 - 180
  • [39] Quickstrom: Property-Based Acceptance Testing with LTL Specifications
    O'Connor, Liam
    Wickstrom, Oskar
    PROCEEDINGS OF THE 43RD ACM SIGPLAN INTERNATIONAL CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '22), 2022, : 1025 - 1038
  • [40] Testing the Feasibility of an Agent-Based Model for Hydrologic Flow Simulation
    Simmonds, Jose
    Gomez, Juan Antonio
    Ledezma, Agapito
    INFORMATION, 2024, 15 (08)