The Open UniversitySkip to content

An overview of evaluation campaigns in multimedia retrieval

Little, Suzanne; Llorente, Ainhoa and Rüger, Stefan (2010). An overview of evaluation campaigns in multimedia retrieval. In: Müller, H.; Clough, P.; Deselaers, T. and Caputo, B. eds. ImageCLEF: Experimental Evaluation in Visual Information Retrieval. Berlin/Heidelberg: Springer-Verlag, pp. 507–522.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This chapter presents an academic and research perspective on the impact and importance of ImageCLEF and similar evaluation workshops in multimedia information retrieval (MIR). Three main themes are examined: the position of ImageCLEF compared with other evaluation conferences; general views on the usefulness of evaluation conferences and possible alternatives, and the impact and real–world meaning of evaluation metrics used within ImageCLEF. We examine the value of ImageCLEF, and related evaluation conferences, for the multimedia IR researcher as providing not only a forum for assessing and comparing outcomes but also serving to promote research aims, provide practical guidance (e.g. standard data sets) and inspire research directions.

Item Type: Book Chapter
Copyright Holders: 2010 Springer-Verlag
ISBN: 3-642-15180-9, 978-3-642-15180-4
Academic Unit/Department: Knowledge Media Institute
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 23247
Depositing User: Suzanne Little
Date Deposited: 24 Sep 2010 13:28
Last Modified: 23 Oct 2012 14:27
Share this page:


Scopus Citations

Actions (login may be required)

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340