Exploiting inter-thread temporal locality for chip multithreading

Multi-core organizations increasingly support multiple threads per core. Threads on a core usually share a single first-level data cache, so thread schedulers must try to minimize cache contention among threads. While this has been studied for concurrent threads with disjoint working sets, the problem has not been addressed for multi-threaded data-parallel workloads in which threads can be scheduled or constructed to improve inter-thread cache sharing. This paper proposes the symbiotic affinity scheduling (SAS) algorithm in which work is first partitioned according to the number of cores (i.e., the number of caches), and these partitions are then subdivided and scheduled among each core's available thread contexts so that threads sharing a core operate on neighboring elements to maximize cache locality. We demonstrate this concept with a series of data-parallel benchmarks. Simulations on M5 achieve an average speedup

• Type: Journal
• Year: 2010
• Where: IPPS
• Authors: Jiayuan Meng, Jeremy W. Sheaffer, Kevin Skadron
• Keywords: Cache, Distributed And Parallel Computing, First-level Data Cache, IPPS 2010, Threads