An overview of evaluation campaigns in multimedia retrieval

Little, Suzanne; Llorente, Ainhoa and Rüger, Stefan (2010). An overview of evaluation campaigns in multimedia retrieval. In: Müller, H.; Clough, P.; Deselaers, T. and Caputo, B. eds. ImageCLEF: Experimental Evaluation in Visual Information Retrieval. Berlin/Heidelberg: Springer-Verlag, pp. 507–522.

DOI: https://doi.org/10.1007/978-3-642-15181-1_27

URL: http://www.springer.com/978-3-642-15180-4

Abstract

This chapter presents an academic and research perspective on the impact and importance of ImageCLEF and similar evaluation workshops in multimedia information retrieval (MIR). Three main themes are examined: the position of ImageCLEF compared with other evaluation conferences; general views on the usefulness of evaluation conferences and possible alternatives, and the impact and real–world meaning of evaluation metrics used within ImageCLEF. We examine the value of ImageCLEF, and related evaluation conferences, for the multimedia IR researcher as providing not only a forum for assessing and comparing outcomes but also serving to promote research aims, provide practical guidance (e.g. standard data sets) and inspire research directions.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI