Dynamic Load Balance for Optimized Message Logging in Fault Tolerant HPC Applications

—Computing systems will grow significantly larger in the near future to satisfy the needs of computational scientists in areas like climate modeling, biophysics and cosmology. Supercomputers being installed in the next few years will comprise millions of cores, hundreds of thousands of processor chips and millions of physical components. However, it is expected that failures become more prevalent in those machines to the point where 10% of an Exascale system will be wasted just recovering from failures. Further, with such large numbers of cores, fine-grained and dynamic load balance will become increasingly critical for maintaining good system utilization. This paper addresses both fault tolerance and load balancing by presenting a novel extension of traditional message logging protocols based on team checkpointing. Message logging makes it possible to recover from localized failures by rolling back just the failed processing elements. Since this comes at a high memory overhead fro...

• Type: Journal
• Year: 2011
• Where: CLUSTER
• Authors: Esteban Meneses, Laxmikant V. Kalé, Greg Bronevetsky
• Keywords: CLUSTER 2011, Computational Scientists, Distributed And Parallel Computing, Fault Tolerance, Processor Chips