Speculative execution on multi-GPU systems

Abstract--The lag of parallel programming models and languages behind the advance of heterogeneous many-core processors has left a gap between the computational capability of modern systems and the ability of applications to exploit them. Emerging programming models, such as CUDA and OpenCL, force developers to explicitly partition applications into components (kernels) and assign them to accelerators in order to utilize them effectively. An accelerator is a processor with a different ISA and micro-architecture than the main CPU. These static partitioning schemes are effective when targeting a system with only a single accelerator. However, they are not robust to changes in the number of accelerators or the performance characteristics of future generations of accelerators. In previous work, we presented the Harmony execution model for computing on heterogeneous systems with several CPUs and accelerators. In this paper, we extend Harmony to target systems with multiple accelerators usin...

• Type: Journal
• Year: 2010
• Where: IPPS
• Authors: Gregory F. Diamos, Sudhakar Yalamanchili
• Keywords: Distinct Accelerator, Distributed And Parallel Computing, Fewer Distinct Accelerators, IPPS 2010, Programming Model