On the Predictability of Program Behavior Using Different Input Data Sets

Smaller input data sets such as the test and the train input sets are commonly used in simulation to estimate the impact of architecture/micro-architecture features on the performance of SPEC benchmarks. They are also used for profile feedback compiler optimizations. In this paper, we examine the reliability of reduced input sets for performance simulation and profile feedback optimizations. We study the high level metrics such as IPC and procedure level profiles as well as lower level measurements such as execution paths exercised by various input sets on the SPEC2000int benchmark. Our study indicates that the test input sets are not suitable to be used for simulation because they do not have an execution profile similar to the reference input runs. The train data set is better than the test data sets at maintaining similar profiles to the reference input set. However, the observed execution paths leading to cache misses are very different between using the smaller input sets and the...

• Type: Conference
• Year: 2002
• Where: IEEEINTERACT
• Authors: Wei-Chung Hsu, Howard Chen, Pen-Chung Yew, Dong-yuan Chen
• Keywords: Data Sets, Hardware, IEEEINTERACT 2002, Input Sets, Reference Input