Optimization of Collective Communications in HeteroMPI

Abstract. HeteroMPI is an extension of MPI designed for high performance computing on heterogeneous networks of computers. The recent new feature of HeteroMPI is the optimized version of collective communications. The optimization is based on a novel performance communication model of switch-based computational clusters. In particular, the model reflects significant non-deterministic and non-linear escalations of the execution time of many-to-one collective operations for medium-sized messages. The paper outlines this communication model and describes how HeteroMPI uses this model to optimize one-to-many (scatter-like) and many-to-one (gather-like) communications. We also demonstrate that HeteroMPI collective communications outperform their native counterparts for various MPI implementations and cluster platforms.

• Type: Conference
• Year: 2007
• Where: PVM
• Authors: Alexey L. Lastovetsky, Maureen O'Flynn, Vladimir Rychkov
• Keywords: Collective Communications, Communication Model, Many-to-one Collective Operations, PVM 2007