ZEN: A directive-based language for automatic experiment management of distributed and parallel programs

So far there exists very little support to specify and to control execution of a large number of experiments on distributed and parallel architectures. This paper describes ZEN, a directive-based language for the specification of arbitrarily complex program executions by varying problem, system, or machine parameters for parallel and distributed applications. ZEN introduces directives to substitute strings and to insert assignment statements inside arbitrary files, such as program, input, script, or make files. The programmer thus can invoke experiments for arbitrary value ranges of any problem parameter, including program variables, file names, compiler options, target machines, machine sizes, scheduling strategies, data distributions, etc. The number of experiments can be controlled through ZEN constraint directives. Finally, the programmer may request a large set of performance metrics to be computed for any code region of interest. The scope of ZEN directives can be restricted to arbitrary file or code regions. We have implemented a prototype tool for automatic experiment management that is based on ZEN. We will report results for performance analysis of an ocean simulation application and for parameter study of a computational finance code.