Integrated Resource Management for Cluster-based Internet Services

Client request rates for Internet services tend to be bursty and thus it is important to maintain efficient resource utilization under a wide range of load conditions. Network service clients typically seek services interactively and maintaining reasonable response time is often imperative for such services. In addition, providing differentiated service qualities and resource allocation to multiple service classes can also be desirable at times. This paper presents an integrated resource management framework (part of Neptune system) that provides flexible service quality specification, efficient resource utilization, and service differentiation for cluster-based services. This framework introduces the metric of quality-aware service yield to combine the overall system efficiency and individual service response time in one flexible model. Resources are managed through a two-level request distribution and scheduling scheme. At the cluster level, a fully decentralized request distributio...

• Type: Conference
• Year: 2002
• Where: OSDI
• Authors: Kai Shen, Hong Tang, Tao Yang, Lingkun Chu
• Keywords: Adaptive Scheduling Policy, Client Request Rates, Efficient Resource Utilization, Operating System, OSDI 2002