Locality and Topology Aware Intra-node Communication among Multicore CPUs

A major trend in HPC is the escalation toward manycore, where systems are composed of shared memory nodes featuring numerous processing units. Unfortunately, with scale comes complexity, here in the form of non-uniform memory accesses and cache hierarchies. For most HPC applications, harnessing the power of multicores is hindered by the topology oblivious tuning of the MPI library. In this paper, we propose a framework to tune every type of shared memory communications according to locality and topology. An implementation inside Open MPI is evaluated experimentally and demonstrates significant speedups compared to vanilla Open MPI and MPICH2.

• Type: Journal
• Year: 2010
• Where: PVM
• Authors: Teng Ma, George Bosilca, Aurelien Bouteiller, Jack J. Dongarra
• Keywords: Distributed And Parallel Computing, Open MPI, PVM 2010, Shared Memory, Topology Oblivious Tuning