Code Cache Management Schemes for Dynamic Optimizers

A dynamic optimizer is a software-based system that performs code modifications at runtime, and several such systems have been proposed over the past several years. These systems typically perform optimization on the level of an instruction trace, and most use caching mechanisms to store recently optimized portions of code. Since the dynamic optimizers produce variable-length code traces that are modified copies of portions of the original executable, a code cache management scheme must deal with the difficult problem of caching objects that vary in size and cannot be subdivided without adding extra jump instructions. Because of these constraints, many dynamic optimizers have chosen unsophisticated schemes, such as flushing the entire cache when it becomes full. Flushing minimizes the overhead of cache management but tends to discard many useful traces. This paper evaluates several alternative cache management schemes that identify and remove only enough traces to make room for a new ...

• Type: Conference
• Year: 2002
• Where: IEEEINTERACT
• Authors: Kim M. Hazelwood, Michael D. Smith
• Keywords: Cache Management, Code Cache, Dynamic Optimizers, Hardware, IEEEINTERACT 2002