Computational reproducibility: state-of-the-art, challenges, and database research opportunities

Computational experiments have become an integral part of the scientific method, but reproducing, archiving, and querying them is still a challenge. The first barrier to a wider adoption is the fact that it is hard both for authors to derive a compendium that encapsulates all the components needed to reproduce a result and for reviewers to verify the results. In this tutorial, we will present a series of guidelines and, through hands-on examples, review existing tools to help authors create of reproducible results. We will also outline open problems and new directions for database-related research having to do with querying computational experiments. Categories and Subject Descriptors D.0 [Software]: General; H.4 [Information Systems Applications]: Miscellaneous; H.2 [Database Management]: Database Applications General Terms Documentation, experimentation Keywords Computational reproducibily, provenance

• Type: Journal
• Year: 2012
• Where: SIGMOD
• Authors: Juliana Freire, Philippe Bonnet, Dennis Shasha
• Keywords: C Method, Database, Information Systems Applications, SIGMOD 2012, Subject Descriptors