A self-organized, fault-tolerant and scalable replication scheme for cloud storage

Failures of any type are common in current datacenters, partly due to the higher scales of the data stored. As data scales up, its availability becomes more complex, while different availability levels per application or per data item may be required. In this paper, we propose a self-managed key-value store that dynamically allocates the resources of a data cloud to several applications in a costefficient and fair way. Our approach offers and dynamically maintains multiple differentiated availability guarantees to each different application despite failures. We employ a virtual economy, where each data partition (i.e. a key range in a consistent-hashing space) acts as an individual optimizer and chooses whether to migrate, replicate or remove itself based on net benefit maximization regarding the utility offered by the partition and its storage and maintenance cost. As proved by a game-theoretical model, no migrations or replications occur in the system at equilibrium, which is soon...

• Type: Conference
• Year: 2010
• Where: CLOUD
• Authors: Nicolas Bonvin, Thanasis G. Papaioannou, Karl Aberer
• Keywords: Availability, CLOUD 2010, Data Storage Representations, Distributed And Parallel Computing, Information Storage