An Implementation of Parallel File Distribution in an Agent Hierarchy

AgentTeamwork coordinates parallel job execution in a hierarchy of mobile agents. A collection of specialized agents are deployed to remote sites including multiple clusters so as to launch, monitor, check-point, and resume a parallel and distributed-computing job. It is very important to develop an algorithm to deliver data files to each of remote processes in a timely fashion. By taking advantage of an agent hierarchy, we have implemented a file-distribution algorithm in AgentTeamwork that delivers user files through an agent tree by duplicating them at each tree level, dividing them into smaller partitions, and aggregating partitions in a larger fragment in transit to the same sub tree. This paper presents the details of AgentTeamwork’s file-distribution algorithm and demonstrates its convincing performance.

• Type: Conference
• Year: 2007
• Where: PDPTA
• Authors: Jumpei Miyauchi, Munehiro Fukuda, Joshua Phillips
• Keywords: Distributed And Parallel Computing, Distributed-computing Job, Parallel Job Execution, PDPTA 2007, file-distribution Algorithm