A Novel Weighted-Graph-Based Grouping Algorithm for Metadata Prefetching

— Although data prefetching algorithms have been extensively studied for years, there is no counterpart research done for metadata access performance. Existing data prefetching algorithms, either lack of emphasis on group prefetching, or bearing a high level of computational complexity, do not work well with metadata prefetching cases. Therefore, an efficient, accurate and distributed metadata-oriented prefetching scheme is critical to leverage the overall performance in large distributed storage systems. In this paper, we present a novel weightedgraph-based prefetching technique, built on both direct and indirect successor relationship, to reap performance benefit from prefetching specifically for clustered metadata servers, an arrangement envisioned necessary for petabyte scale distributed storage systems. Extensive trace-driven simulations show that by adopting our new metadata prefetching algorithm, the miss rate for metadata accesses on the client site can be effectively redu...

• Type: Journal
• Year: 2010
• Where: TC
• Authors: Peng Gu, Jun Wang, Yifeng Zhu, Hong Jiang, Pengju Shang
• Keywords: Algorithms, Information Technology, Metadata, Storage Systems, TC 2010