Towards a provenance framework for sub-image processing for astronomical data

While there has been advances in observational equipment that generate huge high quality images, the processing of these images remains a major bottleneck. We show that provenance data collected during the processing of data can be reused to perform selective processing of data and support network collaboration without clogging distribution networks. We introduce the idea of sub-image processing (SIMP) in the context of processing a subset of pixels of an image and the use of provenance data to assemble pipelines and to select processing metadata for SIMP. We describe an implementation of SIMP in Astro-WISE1 . Categories and Subject Descriptors H.3.4 [Systems and Software]: Distributed Systems; H.4 [Information Systems Applications]: Workflow Management; J.2 [Physcial Sciences and Engineering]: Astronomy General Terms Design, Experimentation

• Type: Journal
• Year: 2010
• Where: CIKM
• Authors: Johnson Mwebaze, John McFarland, Danny Booxhorn, Edwin Valentijn
• Keywords: CIKM 2010, Information Technology, Provenance Data, SIMP, Support Network Collaboration