Dynamic Memory Allocation for Large Query Execution

The execution time of a large query depends mainly on the memory utilization which should avoid disk accesses for intermediate results. Poor memory management can hurt performance and even lead to system thrashing because of paging. However, memory management optimization is hard to incorporate in a query optimizer because of cost estimate errors. In this paper, we address the problem of efficient memory management for large query execution. We propose a static memory allocation scheme applied at start-up time, and a more efficient dynamic execution model which performs memory-adaptive scheduling of the query. Our execution model handles graciously memory overflow by choosing dynamically the best scheduling among several possible using a simple cost model. The model is robust to cost estimate errors. We describe a performance evaluation using a prototype implementation. The experiments with many queries show significant gain over static strategies. KEY WORDS: Memory Management, Que...

• Type: Journal
• Year: 1998
• Where: NIS
• Authors: Luc Bouganim, Olga Kapitskaia, Patrick Valduriez
• Keywords: La Mémoire, Memory Management, NIS 1998, Query Execution