Parallel solvers for dense linear systems for heterogeneous computational clusters

This paper describes the design and the implementation of parallel routines in the Heterogeneous ScaLAPACK library that solve a dense system of linear equations. This library is written on top of HeteroMPI and ScaLAPACK whose building blocks, the de facto standard kernels for matrix and vector operations (BLAS and its parallel counterpart PBLAS) and message passing communication (BLACS), are optimized for heterogeneous computational clusters. We show that the efficiency of these parallel routines is due to the most important feature of the library, which is the automation of the difficult optimization tasks of parallel programming on heterogeneous computing clusters. They are the determination of the accurate values of the platform parameters such as the speeds of the processors and the latencies and bandwidths of the communication links connecting different pairs of processors, the optimal values of the algorithmic parameters such as the total number of processes, the 2D process grid...

• Type: Conference
• Year: 2009
• Where: IPPS
• Authors: Ravi Reddy Manumachu, Alexey L. Lastovetsky, Pedro Alonso
• Keywords: Distributed And Parallel Computing, Heterogeneous Computing Cluster, Heterogeneous ScaLAPACK Library, IPPS 2009, Parallel Routines