Towards a theory of cache-efficient algorithms

We present a model that enables us to analyze the running time of an algorithm on a computer with a memory hierarchy with limited associativity, in terms of various cache parameters. Our cache model, an extension of Aggarwal and Vitter's I/O model, enables us to establish useful relationships between the cache complexity and the I/O complexity of computations. As a corollary, we obtain cache-efficient algorithms in the single-level cache model for fundamental problems like sorting, FFT, and an important subclass of permutations. We also analyze the average-case cache behavior of mergesort, show that ignoring associativity concerns could lead to inferior performance, and present supporting experimental evidence. We further extend our model to multiple levels of cache with limited associativity and present optimal algorithms for matrix transpose and sorting. Our techniques may be used for systematic Some of the results in this article appeared in preliminary form in SEN, S., AND CHA...

• Type: Conference
• Year: 2000
• Where: SODA
• Authors: Sandeep Sen, Siddhartha Chatterjee
• Keywords: Algorithms, Cache, Cache Model, Limited Associativity, SODA 2000