Block-cyclic redistribution over heterogeneous networks

Clusters of workstations and networked parallel computing systems are emerging as promising computational platforms for HPC applications. The processors in such systems are typically interconnected by a collection of heterogeneous networks such as Ethernet, ATM, and FDDI, among others. In this paper, we develop techniques to performblock-cyclic redistributionover P processors interconnected by such a collection of heterogeneous networks. We represent the communication scheduling problem using a timing diagram formalism. Here, each interprocessor communication event is represented by a rectangle whose height denotes the time to perform this event over the heterogeneous network. The communication scheduling problem is then one of appropriately positioning the rectangles so as to minimize the completion time of all the communication events. For the important case where the block size changes by a factor of K, we develop a heuristic algorithm whose completiontime is atmost twice the optim...

• Type: Journal
• Year: 2000
• Where: CLUSTER
• Authors: Prashanth B. Bhat, Viktor K. Prasanna, Cauligi S. Raghavendra
• Keywords: CLUSTER 2000, Communication, Communication Events, Distributed And Parallel Computing, Heterogeneous Network