Fine-Grained Multithreading Support for Hybrid Threaded MPI Programming

As high-end computing systems continue to grow in scale, recent advances in multiand many-core architectures have pushed such growth toward more denser architectures, that is, more processing elements per physical node, rather than more physical nodes themselves. Although a large number of scientific applications have relied so far on an MPI-everywhere model for programming high-end parallel systems, this model may not be sufficient for future machines, given their physical constraints such as decreasing amounts of memory per processing element and shared caches. As a result, application and computer scientists are exploring alternative programming models that involve using MPI between address spaces and some other threaded model, such as OpenMP, Pthreads, or Intel TBB, within an address space. Such hybrid models require efficient support from an MPI implementation for MPI messages sent from multiple threads simultaneously. In this paper, we explore the issues involved in designing s...

• Type: Journal
• Year: 2010
• Where: IJHPCA
• Authors: Pavan Balaji, Darius Buntinas, David Goodell, William Gropp, Rajeev Thakur
• Keywords: Address Space, IJHPCA 2010, MPI Implementation, Multiand Many-core Architectures