MPI/IO on DAFS over VIA: Implementation and Performance Evaluation

In this paper, we describe an implementation of MPI-IO on top of the Direct Access File System (DAFS) standard. The implementation is realized by porting ROMIO on top of DAFS. We identify one of the main mismatches between MPI-IO and DAFS is memory management. Three different design alternatives for memory management are proposed, implemented, and evaluated. We find that memory management in the ADIO layer performs better in situations where the DAFS Provider uses Direct data transfer to handle I/O requests. For the other case of Inline data transfer, it may hurt performance. We propose that the DAFS Provider can expose such implementation information for applications to take full advantage of Inline and Direct data transfers and memory management. Comparative analysis of MPI-IO performance over DAFS, network file system (NFS) and local file system (LFS) shows that MPI-IO on DAFS over VIA

• Type: Conference
• Year: 2002
• Where: IPPS
• Authors: Jiesheng Wu, Dhabaleswar K. Panda
• Keywords: Direct Access File, Direct Data Transfers, Distributed And Parallel Computing, IPPS 2002, Memory Management