Simulation Studies for Complex Sampling Designs

Choosing the appropriate variance estimation method in complex surveys is a difficult task since there exist a variety of techniques which usually cannot be compared mathematically. A relatively easy way to accomplish such a comparison is on the basis of simulation studies. Though simulation studies are widely used in statistics, they are not a standard tool for investigating properties of estimators in complex survey sampling designs. In this paper we describe the setup for a simulation study according to the sampling plan of the Austrian Microcensus (AMC), used 1994-2003 which is an example for a very complex sampling plan. To illustrate the proceeding we conducted a simulation study comparing basic variance estimators. Results of the study reveal the extent to which simple variance estimators may underestimate the true sampling error in close to reality situations.