Trace-based evaluation of job runtime and queue wait time predictions in grids

Large-scale distributed computing systems such as grids are serving a growing number of scientists. These environments bring about not only the advantages of an economy of scale, but also the challenges of resource and workload heterogeneity. A consequence of these two forms of heterogeneity is that job runtimes and queue wait times are highly variable, which generally reduces system performance and makes grids difficult to use by the common scientist. Predicting job runtimes and queue wait times has been widely studied for parallel environments. However, there is no detailed investigation on how the proposed prediction methods perform in grids, whose resource structure and workload characteristics are very different from those in parallel systems. In this paper, we assess the performance and benefit of predicting job runtimes and queue wait times in grids based on traces gathered from various research and production grid environments. First, we evaluate the performance of simple ye...

• Type: Conference
• Year: 2009
• Where: HPDC
• Authors: Omer Ozan Sonmez, Nezih Yigitbasi, Alexandru Iosup, Dick H. J. Epema
• Keywords: Distributed Computing, HPDC 2009, Job Runtimes, Prediction Methods, Queue Wait Time