Memory Forwarding: Enabling Aggressive Layout Optimizations by Guaranteeing the Safety of Data Relocation

By optimizing data layout at run-time, we can potentially enhance the performance of caches by actively creating spatial locality, facilitating prefetching, and avoiding cache conflicts and false sharing. Unfortunately, it is extremely difficult to guarantee that such optimizations are safe in practice on today's machines, since accurately updating all pointers to an object requiresperfect alias information, which is well beyond the scope of the compiler for languagessuch as C. To overcomethis limitation, we proposea technique called memory forwarding which effectively adds a new layer of indirection within the memory system whenever necessary to guarantee that data relocation is always safe. Because actual forwarding rarely occurs (it exists as a safety net), the mechanism can be implemented as an exception in modern superscalar processors. Our experimental results demonstrate that the aggressive layout optimizations enabled by memory forwarding can result in significant speedup...

• Type: Conference
• Year: 1999
• Where: ISCA
• Authors: Chi-Keung Luk, Todd C. Mowry
• Keywords: Hardware, ISCA 1999, Memory Forwarding, Object Requiresperfect Alias, Technique Called Memory