Performance characterisation and verification of Java']JavaSpaces based on design of experiments

In the ever increasing world of distributed systems, different middleware implementations can be compared qualitatively or quantitatively. Existing evaluation techniques are often not satisfying. In this contribution we apply Design of Experiments (DoE) to evaluate and model the performance of JavaSpaces, a Tuple Spaces implementation for distributing tasks through a virtual space. DoE is a statistical technique for identifying relevant inputfactors from a (large) set of inputfactors. The setup of the experiments is determined using Experimental Design (ED) and a selection of the relevant inputfactors is based on Analysis of Variance (ANOVA). Then Regression Analysis (RA) is used to obtain a multivariate representation. Some extra experiments are performed to validate this approach.