Sciweavers

CLUSTER
2011
IEEE

Exploring Fine-Grained Task-Based Execution on Multi-GPU Systems

12 years 11 months ago
Exploring Fine-Grained Task-Based Execution on Multi-GPU Systems
Using multi-GPU systems, including GPU clusters, is gaining popularity in scientific computing. However, when using multiple GPUs concurrently, the conventional data parallel GPU programming paradigms, e.g., CUDA, cannot satisfactorily address certain issues, such as load balancing, GPU resource utilization, overlapping finegrained computation with communication, etc. In this paper, we present a fine-grained task-based execution framework for multi-GPU systems. By scheduling finer-grained tasks than what is supported in the conventional CUDA programming method among multiple GPUs, and allowing concurrent task execution on a single GPU, our framework provides means for solving the above issues and efficiently utilizing multi-GPU systems. Experiments with a molecular dynamics application show that, for nonuniform distributed workload, the solutions based on our framework achieve good load balance, and considerable performance improvement over other solutions based on the standard C...
Long Chen, Oreste Villa, Guang R. Gao
Added 18 Dec 2011
Updated 18 Dec 2011
Type Journal
Year 2011
Where CLUSTER
Authors Long Chen, Oreste Villa, Guang R. Gao
Comments (0)