Sciweavers

SC
2015
ACM

Comparative I/O workload characterization of two leadership class storage clusters

8 years 6 months ago
Comparative I/O workload characterization of two leadership class storage clusters
The Oak Ridge Leadership Computing Facility (OLCF) is a leader in large-scale parallel file system development, design, deployment and continuous operation. For the last decade, the OLCF has designed and deployed two large center-wide parallel file systems. The first instantiation, Spider 1, served the Jaguar supercomputer and its predecessor, Spider 2, now serves the Titan supercomputer, among many other OLCF computational resources. The OLCF has been rigorously collecting file and storage system statistics from these Spider systems since their transition to production state. In this paper we present the collected I/O workload statistics from the Spider 2 system and compare it to the Spider 1 data. Our analysis show that the Spider 2 workload is more more write-heavy I/O compared to Spider 1 (75% vs. 60%, respectively). The data also show the OLCF storage policies such as periodic purges are effectively managing the capacity resource of Spider 2. Furthermore, due to improvements...
Raghul Gunasekaran, Sarp Oral, Jason Hill, Ross Mi
Added 17 Apr 2016
Updated 17 Apr 2016
Type Journal
Year 2015
Where SC
Authors Raghul Gunasekaran, Sarp Oral, Jason Hill, Ross Miller, Feiyi Wang, Dustin Leverman
Comments (0)