Load Balancing on PC Clusters with the Super-Programming Model

Recent work in high-performance computing has shifted attention to PC clusters.. For PC-clusters, member nodes are independent computers connected by generalpurpose networks. The latency of data communications is long and load balancing among the nodes becomes a critical issue. We introduce a new model for program development on PC clusters, namely the SuperProgramming Model (SPM) to address this issue. In SPM, PC clusters are modeled as a single virtual machine with PCs as the processing units. The workload is modeled as a collection of Super-Instructions (SIs). Each SI can achieve a limited workload. Application programs are coded using SIs. SIs are dynamically assigned to available PCs at run time. For limited workload, no SI overloads any PC. Therefore, dynamic load balancing becomes an easier task. We apply SPM to mining association rules. Our experiments show that under normal conditions the workload is balanced very well. A performance model is also developed to describe the sc...

• Type: Conference
• Year: 2003
• Where: ICPPW
• Authors: Dejiang Jin, Sotirios G. Ziavras
• Keywords: Distributed And Parallel Computing, ICPPW 2003, Limited Workload, Load Balancing, PC Clusters