A Pluggable Interactive IR Evaluation Work-bench

Hall, Mark Michael; Katsaris, Spyros and Toms, Elaine (2013). A Pluggable Interactive IR Evaluation Work-bench. In: Proceedings of the 3rd European Workshop on Human-Computer Interaction and Information Retrieval (Wilson, Max L.; Russell-Rose, Tony; Larsen, Birger; Hansen, Preben and Norling, Kristian eds.), 1033 pp. 35–38.

URL: http://ceur-ws.org/Vol-1033/paper4.pdf

Abstract

Information Retrieval (IR) has benefited from standard evaluation practices and re-usable software components, that enable comparability between systems and experiments. However, Interactive IR (IIR) has had only very limited benefit from these developments, in part because experiments are
still built using bespoke components and interfaces. In this paper we propose a flexible workbench for constructing IIR interfaces that will standardise aspects of the IIR experiment process to improve the comparability and reproducibility of IIR experiments.

Viewing alternatives

Item Actions

Export

About

  • Item ORO ID
  • 68770
  • Item Type
  • Conference or Workshop Item
  • ISBN
  • 1613-0073
  • Keywords
  • evaluation; framework; standardisation
  • Academic Unit or School
  • Other Departments > Other Departments
  • Copyright Holders
  • © 2013 The Authors
  • Depositing User
  • Mark Hall

Recommendations