Simulation and Emulation techniques are fundamental to aid the process of large-scale protocol design and network operations. However, the results from these techniques are often view with a great deal of skepticism from the networking community. Criticisms come in two flavors: (i) the study presents isolated and potentially random feature interactions, and (ii) the parameters used in the study may not be representative of real-world conditions. The first issue (random isolated results) can be addressed by large-scale experiment design techniques that extract maximum information and confidence from a minimum number of carefully designed experiments. Such techniques can be used to find "good" results fast to guide either incremental protocol design or operational parameter tuning. The second issue (representativeness) is more problematic and relates to formulating benchmarks that to the greatest possible extent characterize the structure of the system under study. In this pap...
David W. Bauer, Garrett R. Yaun, Christopher D. Ca