Fair, effective, efficient and differentiated scheduling in an enterprise data warehouse

A typical online Business Intelligence (BI) workload consists of a combination of short, less intensive queries, along with long, resource intensive queries. As such, the longest queries in a typical BI workload may take several orders of magnitude more time to execute, compared with the shortest queries in the workload. This makes it challenging to design a good Mixed Workload Scheduler (MWS). In this paper we first define the design criteria that make a `good' MWS. We then use these criteria to design rFEED, a MWS that is fair, effective, efficient, and differentiated. We simulate real workloads and compare our rFEED MWS with models of the current best of breed commercial systems. We show that the rFEED MWS works extremely well.

• Type: Journal
• Year: 2009
• Where: EDBT
• Authors: Chetan Gupta, Abhay Mehta, Song Wang, Umeshwar Dayal
• Keywords: Database, EDBT 2009, Intensive Queries, Rfeed Mws, Workload