GatorShare: a file system framework for high-throughput data management

Voluntary Computing systems or Desktop Grids (DGs) enable sharing of commodity computing resources across the globe and have gained tremendous popularity among scientific research communities. Data management is one of the major challenges of adopting the Voluntary Computing paradigm for large data-intensive applications. To date, middleware for supporting such applications either lacks an efficient cooperative data distribution scheme or cannot easily accommodate existing data-intensive applications due to the requirement for using middleware-specific APIs. To address this challenge, in this paper we introduce GatorShare, a data management framework that offers a file system interface and an extensible architecture designed to support multiple data transfer protocols, including BitTorrent, based on which we implement a cooperative data distribution service for DGs. It eases the integration with Desktop Grids and enables high-throughput data management for unmodified data-intensive ap...

• Type: Conference
• Year: 2010
• Where: HPDC
• Authors: Jiangyan Xu, Renato J. O. Figueiredo
• Keywords: Data Management, Data-intensive Applications, Desktop Grids, Distributed And Parallel Computing, HPDC 2010