Towards a Hierarchical Scheduling System for Distributed WWW Server Clusters

In this paper we present a model for dynamically scheduling HTTP requests across clusters of servers, optimizing the use of client resources as well as the scattered server nodes. We also present a system, H-SWEB, implementing our techniques and showing experimental improvements of over 250%, which have been achieved through utilizing a global approach to scheduling requests. This is the first system to provide a hierarchical scheduling mechanism for distributedHTTP server clusters incorporatingdynamic client-server task distribution and distributed data access. H-SWEB uses sophisticated scheduling techniques in monitoring and adapting to workload variation at the client and server clusters for supporting typical digital library tasks, such as fast WWW image browsing. We provide a discussion of our system architecture and implementation, and briefly summarize theexperimental results that have been achieved.

• Type: Conference
• Year: 1998
• Where: HPDC
• Authors: Daniel Andresen, Timothy McCune
• Keywords: Distributed And Parallel Computing, DistributedHTTP Server Clusters, Hierarchical Scheduling Mechanism, HPDC 1998, Server Clusters