WORKEM: Representing and Emulating Distributed Scientific Workflow Execution State

- Scientific workflows have become an integral part of cyberinfrastructure as their computational complexity and data sizes have grown. However, the complexity of the distributed infrastructure makes design of new workflows, determining the right management policies, debugging, testing or reproduction of errors challenging. Today, workflow engines manage the dependencies between tasks of workflows and there are tools available to wrap scientific codes. There is a need for a customizable, isolated and manageable testing container for design, evaluation and deployment of distributed workflows. To build such an environment, we need to be able to model and represent, capture and possibly reuse the execution flows within each task of a workflow that accurately captures the execution behavior. In this paper, we present the design and implementation of WORKEM, an extensible framework that can be used to represent and emulate workflow execution state. We also detail the use of the framework in...

• Type: Journal
• Year: 2010
• Where: CCGRID
• Authors: Lavanya Ramakrishnan, Dennis Gannon, Beth Plale
• Keywords: CCGRID 2010, Computational Complexity, Distributed And Parallel Computing, Execution Behavior, Execution State