Designing High Performance and Scalable MPI Intra-node Communication Support for Clusters

As new processor and memory architectures advance, clusters start to be built from larger SMP systems, which makes MPI intra-node communication a critical issue in high performance computing. This paper presents a new design for MPI intra-node communication that aims to achieve both high performance and good scalability in a cluster environment. The design distinguishes small and large messages and handles them differently to minimize the data transfer overhead for small messages and the memory space consumed by large messages. Moreover, the design utilizes the cache efficiently and requires no locking mechanisms to achieve optimal performance even with large system size. This paper also explores various optimization strategies to reduce polling overhead and maintain data locality. We have evaluated our design on NUMA and dual core NUMA systems. The experimental results on NUMA system show that the new design can improve MPI intra-node latency by up to 35% and bandwidth by up to 50% ...

• Type: Conference
• Year: 2006
• Where: CLUSTER
• Authors: Lei Chai, Albert Hartono, Dhabaleswar K. Panda
• Keywords: CLUSTER 2006, Cluster Computing, Core Numa Systems, Dual Core Numa, MPI Intra-node Communication