Collective communication: theory, practice, and experience

We discuss the design and high-performance implementation of collective communications operations on distributed-memory computer architectures. Using a combination of known techniques (many of which were first proposed in the 1980s and early 1990s) along with careful exploitation of communication modes supported by MPI, we have developed implementations that have improved performance in most situations compared to those currently supported by public domain implementations of MPI such as MPICH. Performance results from a large Intel Xeon/Pentium 4 (R) processor cluster are included.

• Type: Journal
• Year: 2007
• Where: CONCURRENCY
• Authors: Ernie Chan, Marcel Heimlich, Avi Purkayastha, Robert A. van de Geijn
• Keywords: Careful Exploitation, Collective Communications Operations, CONCURRENCY 2007, Public Domain Implementations