Cabral, Liliana and Toma, Ioan
(2010).
Evaluating Semantic Web Service tools using the SEALS platform.
In: International Workshop on Evaluation of Semantic Technologies (IWEST 2010) at ISWC 2010, 8 November 2010, Shanghai, China.
Full text available as:
|
Due to copyright restrictions, this file is not available for public download
|
Abstract
This paper describes the approach for the automatic evaluation of Semantic Web Service (SWS) tools, based on the infrastructure under development within the SEALS project. We describe the design of evaluations, considering existing test suites as well as repository management and evaluation measure services that will enable evaluation campaign organizers and participants to evaluate SWS tools. Currently, we focus on the SWS discovery activity, which consists of finding Web Services based on their semantic descriptions. Tools for SWS discovery or matchmaking can be evaluated on retrieval performance, where for a given goal, i.e. a semantic description of a service request, and a given set of service descriptions, i.e. semantic descriptions of service offers, the tool returns the match degree between the goal and each service, and the platform measures the rate of matching correctness based on a number of metrics.
| Item Type: |
Conference Item
|
| Copyright Holders: |
2010 The Authors |
| Extra Information: |
Published in Proceedings of the International Workshop on Evaluation of Semantic Technologies (IWEST 2010): 9th International Semantic Web Conference (ISWC2010), Shanghai, China, November 8, 2010. Edited by Asunción Gómez-Pérez Fabio Ciravegna, Frank van Harmelen, Jeff Hefflin (CEUR workshop Proceedings, Vol. 666, ISSN 1613-0073)
|
| Academic Unit/Department: |
Knowledge Media Institute |
| Related URLs: |
|
| Item ID: |
26184 |
| Depositing User: |
Liliana Cabral
|
| Date Deposited: |
12 Jan 2011 09:49 |
| Last Modified: |
24 Oct 2012 06:36 |
| URI: |
http://oro.open.ac.uk/id/eprint/26184 |
Actions (login may be required)
