Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems

This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O. Key words: MPI-IO, Parallel I/O, Parallel File Systems, Supercomputers.

• Type: Conference
• Year: 2009
• Where: PVM
• Authors: Javier García Blas, Florin Isaila, Jesús Carretero, Robert Latham, Robert B. Ross
• Keywords: Asynchronous Data-staging Strategy, One-level Prefetching Solution, PVM 2009, Two-level file Write-back