Apples and oranges: a comparison of RDF benchmarks and real RDF datasets

The widespread adoption of the Resource Description Framework (RDF) for the representation of both open web and enterprise data is the driving force behind the increasing research interest in RDF data management. As RDF data management systems proliferate, so are benchmarks to test the scalability and performance of these systems under data and workloads with various characteristics. In this paper, we compare data generated with existing RDF benchmarks and data found in widely used real RDF datasets. The results of our comparison illustrate that existing benchmark data have little in common with real data. Therefore any conclusions drawn from existing benchmark tests might not actually translate to expected behaviours in real settings. In terms of the comparison itself, we show that simple primitive data metrics are inadequate to flesh out the fundamental differences between real and benchmark data. We make two contributions in this paper: (1) To address the limitations of the primit...

• Type: Journal
• Year: 2011
• Where: SIGMOD
• Authors: Songyun Duan, Anastasios Kementsietsidis, Kavitha Srinivas, Octavian Udrea
• Keywords: Database, Integer Programming Problem, Resource Description Framework, SIGMOD 2011, Synthetic Dataset