Due to cost, time, and flexibility constraints, simulators are often used to explore the design space when developing a new processor architecture, as well as when evaluating the performance of new compiler-based and microarchitectural performance-enhancement mechanisms. However, despite this continued dependence on simulators, statistically rigorous simulation methodologies are not typically used for computer architecture research. Without a formal methodology, however, it is possible to underemphasize the effect of parameter interactions when choosing processor parameter values for simulations or when performing sensitivity analyses. A formal methodology can provide a sound basis for drawing conclusions gathered from simulation results by adding statistical rigor and, consequently, can increase confidence in the simulation results. This paper demonstrates the application of a rigorous statistical technique to the setup and analysis phases of the simulation process. Specifically, we ...
Joshua J. Yi, David J. Lilja, Douglas M. Hawkins