A Framework for Data-Intensive Computing with Cloud Bursting

—For many organizations, one attractive use of cloud resources can be through what is referred to as cloud bursting or the hybrid cloud. These refer to scenarios where an organization acquires and manages in-house resources to meet its base need, but can use additional resources from a cloud provider to maintain an acceptable response time during workload peaks. Cloud bursting has so far been discussed in the context of using additional computing resources from a cloud provider. However, as next generation applications are expected to see orders of magnitude increase in data set sizes, cloud resources can be used to store additional data after local resources are exhausted. In this paper, we consider the challenge of data analysis in a scenario where data is stored across a local cluster and cloud resources. We describe a software framework to enable dataintensive computing with cloud bursting, i.e., using a combination of compute resources from a local cluster and a cloud environmen...

• Type: Journal
• Year: 2011
• Where: CLUSTER
• Authors: Tekin Bicer, David Chiu, Gagan Agrawal
• Keywords: Acceptable Response Time, CLUSTER 2011, Data Intensive Computing, Distributed And Parallel Computing, Magnitude Increase