Understanding internet video sharing site workload: a view from data center design

In this paper we measured and analyzed the workload on Yahoo! Video, the 2nd largest U.S. video sharing site, to understand its nature and the impact on online video data center design. We discovered interesting statistical properties on both static and temporal dimensions of the workload including file duration and popularity distributions, arrival rate dynamics and predictability, and workload stationarity and burstiness. Complemented with queueing-theoretic techniques, we further extended our understanding on the measurement data with a virtual design on the workload and capacity management components of a data center assuming the same workload as measured, which reveals key results regarding the impact of Service Level Agreements (SLAs) and workload scheduling schemes on the design and operations of such large-scale video distribution systems. Categories and Subject Descriptors C.2.0 [Computer-Communication Networks]: General General Terms Measurement, Design, Performance Keywords...

• Type: Conference
• Year: 2008
• Where: WWW
• Authors: Xiaozhu Kang, Hui Zhang 0002, Guofei Jiang, Haifeng Chen, Xiaoqiao Meng, Kenji Yoshihira
• Keywords: Internet Technology, Workload Management, Workload Scheduling Schemes, Workload Stationarity, WWW 2008