Performance-Guided Load (Un)balancing under Autocorrelated Flows

Size-based policies have been shown in the literature to effectively balance load and improve performance in cluster environments. Size-based policies assign jobs to servers based on the job size and their performance improvements are an outcome of separating "short" from "long" jobs, by avoiding having short jobs waiting behind long jobs for service. In this paper, we present evidence that performance improvements due to this separation quickly vanish if the arrival process to the cluster is autocorrelated. Based on our observations, we devise a new size-based policy called D EQAL that still strives to separate jobs to servers according to job size but this separation is now biased by an effort to reduce performance loss due to autocorrelation in the arrival flows of jobs that are directed to each server. As a result of this bias, all servers may not be equally utilized (i.e., load in the system may be "unbalanced"), but performance benefits become signi...

• Type: Journal
• Year: 2008
• Where: TPDS
• Authors: Qi Zhang, Ningfang Mi, Alma Riska, Evgenia Smirni
• Keywords: Performance, Performance Improvements, Size-based Policies, TPDS 2008