A Case for Standard Non-blocking Collective Operations

Abstract. In this paper we make the case for adding standard nonblocking collective operations to the MPI standard. The non-blocking point-to-point and blocking collective operations currently defined by ide important performance and abstraction benefits. To allow these benefits to be simultaneously realized, we present an application programming interface for non-blocking collective operations in MPI. Microbenchmark and application-based performance results demonstrate that non-blocking collective operations offer not only improved convenience, but improved performance as well, when compared to manual use of threads with blocking collectives.

• Type: Conference
• Year: 2007
• Where: PVM
• Authors: Torsten Hoefler, Prabhanjan Kambadur, Richard L. Graham, Galen M. Shipman, Andrew Lumsdaine
• Keywords: Collective Operations, Non-blocking Collective Operations, Nonblocking Collective Operations, PVM 2007