Specification testing of agent-based simulation using property-based testing

被引:0
|
作者
Thaler, Jonathan [1 ,2 ]
Siebers, Peer-Olaf [1 ]
机构
[1] Univ Nottingham, Sch Comp Sci, 7301 Wollaton Rd, Nottingham, England
[2] FH Vorarlberg, Dept Comp Sci, Hsch Str 1, A-6850 Dornbirn, Austria
关键词
Agent-based simulation testing; Code testing; Test driven development; Model specification; FRAMEWORK;
D O I
10.1007/s10458-020-09473-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The importance of Agent-Based Simulation (ABS) as scientific method to generate data for scientific models in general and for informed policy decisions in particular has been widely recognised. However, the important technique of code testing of implementations like unit testing has not generated much research interested so far. As a possible solution, in previous work we have explored the conceptual use ofproperty-based testing. In this code testing method, model specifications and invariants are expressed directly in code and tested throughautomatedandrandomisedtest data generation. This paper expands on our previous work and explores how to use property-based testing on a technical level to encode and test specifications of ABS. As use case the simple agent-based SIR model is used, where it is shown how to test agent behaviour, transition probabilities and model invariants. The outcome are specifications expressed directly in code, which relate whole classes of random input to expected classes of output. During test execution, random test data is generated automatically, potentially covering the equivalent of thousands of unit tests, run within seconds on modern hardware. This makes property-based testing in the context of ABS strictly more powerful than unit testing, as it is a much more natural fit due to its stochastic nature.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Specification testing of agent-based simulation using property-based testing
    Jonathan Thaler
    Peer-Olaf Siebers
    Autonomous Agents and Multi-Agent Systems, 2020, 34
  • [2] SHOW ME YOUR PROPERTIES! THE POTENTIAL OF PROPERTY-BASED TESTING IN AGENT-BASED SIMULATION
    Thaler, Jonathan
    Siebers, Peer-Olaf
    PROCEEDINGS OF THE 2019 SUMMER SIMULATION CONFERENCE (SUMMERSIM '19), 2019,
  • [3] Developments in Property-Based Testing
    Midtgaard, Jan
    PROCEEDINGS OF THE ACM SIGPLAN WORKSHOP ON PARTIAL EVALUATION AND PROGRAM MANIPULATION (PEPM'18), 2018, : 1 - 1
  • [4] Targeted Property-Based Testing
    Loscher, Andreas
    Sagonas, Konstantinos
    PROCEEDINGS OF THE 26TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS (ISSTA'17), 2017, : 46 - 56
  • [5] A Primer on Property-Based Testing
    Koparkar, Chaitanya
    XRDS: Crossroads, 2024, 30 (02): : 40 - 41
  • [6] Property-Based Mutation Testing
    Bartocci, Ezio
    Mariani, Leonardo
    Nickovic, Dejan
    Yadav, Drishti
    2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2023, : 222 - 233
  • [7] Foundational Property-Based Testing
    Paraskevopoulou, Zoe
    Hritcu, Catalin
    Denes, Maxime
    Lampropoulos, Leonidas
    Pierce, Benjamin C.
    INTERACTIVE THEOREM PROVING, 2015, 9236 : 325 - 343
  • [8] AgentTest: A specification language for agent-based system testing
    Babac, Marina Bagic
    Jevtic, Dragan
    NEUROCOMPUTING, 2014, 146 : 230 - 248
  • [9] A Property-based Testing Framework for Multi-Agent Systems
    Benac Earle, Clara
    Fredlund, Lars-Ake
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 1823 - 1825
  • [10] Application of Property-based Testing Tools for Metamorphic Testing
    Alzahrani, Nasser
    Spichkova, Maria
    Harland, James
    ENASE: PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON EVALUATION OF NOVEL APPROACHES TO SOFTWARE ENGINEERING, 2022, : 553 - 560