Matrix-Matrix Multiplication on Heterogeneous Platforms

In this paper, we address the issue of implementing matrix-matrix multiplication on heterogeneous platforms. We target two different classes of heterogeneous computing resources: heterogeneous networks of workstations, and collections of heterogeneous clusters. Intuitively, the problem is to load balance the work with different-speed resources while minimizing the communication volume. We formally state this problem and prove its NP-completeness. Next we introduce a (polynomial) column-based heuristic, which turns out to be very satisfactory: we derive a theoretical performance guarantee for the heuristic, and we assess its practical usefulness through MPI experiments.

• Type: Conference
• Year: 2000
• Where: ICPP
• Authors: Olivier Beaumont, Vincent Boudet, Fabrice Rastello, Yves Robert
• Keywords: Distributed And Parallel Computing, Heterogeneous Clusters, Heterogeneous Computing Resources, Heterogeneous Platforms, ICPP 2000