A Framework for the Evaluation of Semantics-based Service Composition Approaches

Silva, Eduardo and Ferreira Pires, L. and Sinderen van, Marten (2009) A Framework for the Evaluation of Semantics-based Service Composition Approaches. In: Seventh IEEE European Conference on Web Services, ECOWS 2009, 9-11 November 2009, Eindhoven, The Netherlands.

Preview

PDF
255Kb

Abstract:	The benefits of service composition are being largely acknowledged in the literature nowadays. However, as the amount of available services increases, it becomes difficult to manage, discover, select and compose them, so that automation is required in these processes. This can be achieved by using semantic information represented in ontologies. Currently there are many different approaches that support semantics-based service composition. However, still little effort has been spent on creating a common methodology to evaluate and compare such approaches. In this paper we present our initial ideas to create an evaluation framework for semantics-based service composition approaches. We use a collection of existing services, and define a set of evaluation metrics, confusion matrix-based and time-based. Furthermore, we present how composition evaluation scenarios are generated from the collection of services and specify the strategy to be used in the evaluation process. We demonstrate the proposed framework through an example. Currently there are mechanisms and initiatives to address the evaluation of the semantics-based service discovery and matchmaking approaches. However, still few efforts have been spent on the creation of comprehensive evaluation mechanisms for semantics-based service composition approaches.
Item Type:	Conference or Workshop Item
Copyright:	© 2009 IEEE
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Software Engineering (SE) Information Systems (IS)
Link to this item:	http://purl.utwente.nl/publications/68833
Official URL:	http://dx.doi.org/10.1109/ECOWS.2009.23
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page