The Open UniversitySkip to content
 

An overview of evaluation campaigns in multimedia retrieval

Little, Suzanne; Llorente, Ainhoa and Rüger, Stefan (2010). An overview of evaluation campaigns in multimedia retrieval. In: Müller, H.; Clough, P.; Deselaers, T. and Caputo, B. eds. ImageCLEF: Experimental Evaluation in Visual Information Retrieval. Berlin/Heidelberg: Springer-Verlag, pp. 507–522.

URL: http://www.springer.com/978-3-642-15180-4
DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1007/978-3-642-15181-1_27
Google Scholar: Look up in Google Scholar

Abstract

This chapter presents an academic and research perspective on the impact and importance of ImageCLEF and similar evaluation workshops in multimedia information retrieval (MIR). Three main themes are examined: the position of ImageCLEF compared with other evaluation conferences; general views on the usefulness of evaluation conferences and possible alternatives, and the impact and real–world meaning of evaluation metrics used within ImageCLEF. We examine the value of ImageCLEF, and related evaluation conferences, for the multimedia IR researcher as providing not only a forum for assessing and comparing outcomes but also serving to promote research aims, provide practical guidance (e.g. standard data sets) and inspire research directions.

Item Type: Book Chapter
Copyright Holders: 2010 Springer-Verlag
ISBN: 3-642-15180-9, 978-3-642-15180-4
Academic Unit/Department: Knowledge Media Institute
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 23247
Depositing User: Suzanne Little
Date Deposited: 24 Sep 2010 13:28
Last Modified: 23 Oct 2012 14:27
URI: http://oro.open.ac.uk/id/eprint/23247
Share this page:

Altmetrics

Scopus Citations

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk