Timekeeping in the Memory System: Predicting and Optimizing Memory Behavior

Techniques for analyzing and improving memory referencing behavior continue to be important for achieving good overall program performance due to the ever-increasing performance gap between processors and main memory. This paper offers a fresh perspective on the problem of predicting and optimizing memory behavior. Namely, we show quantitatively the extent to which detailed timing characteristics of past memory reference events are strongly predictive of future program reference behavior. We propose a family of timekeeping techniques that optimize behavior based on observations about particular cache time durations, such as the cache access interval or the cache dead time. Timekeeping techniques can be used to build small, simple, and high-accuracy (often 90% or more) predictors for identifying conflict misses, for predicting dead blocks, and even for estimating the time at which the next reference to a cache frame will occur and the address that will be accessed. Based on these pred...

• Type: Conference
• Year: 2002
• Where: ISCA
• Authors: Zhigang Hu, Margaret Martonosi, Stefanos Kaxiras
• Keywords: Cache, Hardware, ISCA 2002, Time-based Victim Cache, Victim Cache