A Framework for the Evaluation of Semantics-Based Service Composition Approaches

—The benefits of service composition are being largely acknowledged in the literature nowadays. However, as the amount of available services increases, it becomes difficult to manage, discover, select and compose them, so that automation is required in these processes. This can be achieved by using semantic information represented in ontologies. Currently there are many different approaches that support semantics-based service composition. However, still little effort has been spent on creating a common methodology to evaluate and compare such approaches. In this paper we present our initial ideas to create an evaluation framework for semantics-based service composition approaches. We use a collection of existing services, and define a set of evaluation metrics, confusion matrix-based and time-based. Furthermore, we present how composition evaluation scenarios are generated from the collection of services and specify the strategy to be used in the evaluation process. We demonstrat...

• Type: Conference
• Year: 2009
• Where: ECOWS
• Authors: Eduardo Silva, Luís Ferreira Pires, Marten van Sinderen
• Keywords: ECOWS 2009, Evaluation, Internet Technology, Semantics-based Service Composition, Service Composition