Servicing range queries on multidimensional datasets with partial replicas

Partial replication is one type of optimization to speed up execution of queries submitted to large datasets. In partial replication, a portion of the dataset is extracted, re-organized, and re-distributed across the storage system. The objective is to reduce the volume of I/O and increase I/O parallelism for different types of queries and for the portions of the dataset that are likely to be accessed frequently. When multiple partial replicas of a dataset exist, query execution plan should be generated so as to use the best combination of subsets of partial replicas (and possibly the original dataset) to minimize query execution time. In this paper, we present a compiler and runtime approach for range queries submitted against distributed scientific datasets. A heuristic algorithm is proposed to choose the set of replicas to reduce query execution. We show the efficiency of the proposed method using datasets and queries in oil reservoir simulation studies on a cluster machine.

• Type: Conference
• Year: 2005
• Where: CCGRID
• Authors: Li Weng, Ümit V. Çatalyürek, Tahsin M. Kurç, Gagan Agrawal, Joel H. Saltz
• Keywords: CCGRID 2005, Cluster Computing, Dataset, Partial Replication, Query Execution