The Open UniversitySkip to content

An overview of evaluation campaigns in multimedia retrieval

Little, Suzanne; Llorente, Ainhoa and Rüger, Stefan (2010). An overview of evaluation campaigns in multimedia retrieval. In: Müller, H.; Clough, P.; Deselaers, T. and Caputo, B. eds. ImageCLEF: Experimental Evaluation in Visual Information Retrieval. Berlin/Heidelberg: Springer-Verlag, pp. 507–522.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This chapter presents an academic and research perspective on the impact and importance of ImageCLEF and similar evaluation workshops in multimedia information retrieval (MIR). Three main themes are examined: the position of ImageCLEF compared with other evaluation conferences; general views on the usefulness of evaluation conferences and possible alternatives, and the impact and real–world meaning of evaluation metrics used within ImageCLEF. We examine the value of ImageCLEF, and related evaluation conferences, for the multimedia IR researcher as providing not only a forum for assessing and comparing outcomes but also serving to promote research aims, provide practical guidance (e.g. standard data sets) and inspire research directions.

Item Type: Book Section
Copyright Holders: 2010 Springer-Verlag
ISBN: 3-642-15180-9, 978-3-642-15180-4
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 23247
Depositing User: Suzanne Little
Date Deposited: 24 Sep 2010 13:28
Last Modified: 07 Dec 2018 09:40
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU