A Model and Compilation Strategy for Out-of-Core Data Parallel Programs

It is widely acknowledged in high-performance computing circles that parallel input/output needs substantial improvement in order to make scalable computers truly usable. We present a data storage model that allows processors independent access to their own data and a corresponding compilation strategy that integrates data-parallel computation with data distribution for out-of-core problems. Our results compare several communication methods and I/O optimizations using two out-of-core problems, Jacobi iteration and LU factorization.

• Type: Conference
• Year: 1995
• Where: PPOPP
• Authors: Rajesh Bordawekar, Alok N. Choudhary, Ken Kennedy, Charles Koelbel, Michael H. Paleczny
• Keywords: Data Storage Model, Distributed And Parallel Computing, Needs Substantial Improvement, Out-of-core Problems, PPOPP 1995