Evaluating Semantic Web Service tools using the SEALS platform

Cabral, Liliana and Toma, Ioan (2010). Evaluating Semantic Web Service tools using the SEALS platform. In: International Workshop on Evaluation of Semantic Technologies (IWEST 2010) at ISWC 2010, 8 Nov 2010, Shanghai, China.

URL: http://iswc2010.semanticweb.org/program

Abstract

This paper describes the approach for the automatic evaluation of Semantic Web Service (SWS) tools, based on the infrastructure under development within the SEALS project. We describe the design of evaluations, considering existing test suites as well as repository management and evaluation measure services that will enable evaluation campaign organizers and participants to evaluate SWS tools. Currently, we focus on the SWS discovery activity, which consists of finding Web Services based on their semantic descriptions. Tools for SWS discovery or matchmaking can be evaluated on retrieval performance, where for a given goal, i.e. a semantic description of a service request, and a given set of service descriptions, i.e. semantic descriptions of service offers, the tool returns the match degree between the goal and each service, and the platform measures the rate of matching correctness based on a number of metrics.

Viewing alternatives

Item Actions

Export

You can export this page using these formats