File Creation Strategies in a Distributed Metadata File System

As computing breaches petascale limits both in processor performance and storage capacity, the only way that current and future gains in performance can be achieved is by increasing the parallelism of the system. Gains in storage performance remain low due to the use of traditional distributed file systems such as NFS, where although multiple clients can access files at the same time, only one node can serve files to the clients. New file systems that distribute load across multiple data servers are being developed; however, most implementations concentrate all the metadata load at a single server still. Distributing metadata load is important to accommodate growing numbers of more powerful clients. Scaling metadata performance is more complex than scaling raw I/O performance, and with distributed metadata the complexity increases further. In this paper we present strategies for file creation in distributed metadata file systems. Using the PVFS distributed file system as our te...

• Type: Conference
• Year: 2007
• Where: IPPS
• Authors: Ananth Devulapalli, Pete Wyckoff
• Keywords: Distributed And Parallel Computing, IPPS 2007, Metadata, Metadata Load, file Systems