Lessons learned from the CHiC and SBS interactive tracks: a wishlist for interactive IR evaluation

Bogers, Toine; Gäde, Maria; Hall, Mark; Petras, Vivien and Skov, Mette (2017). Lessons learned from the CHiC and SBS interactive tracks: a wishlist for interactive IR evaluation. In: CEUR Workshop Proceedings, 1798 pp. 12–15.

URL: http://ceur-ws.org/Vol-1798/paper2.pdf

Abstract

Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

Viewing alternatives

Download history

Item Actions

Export

About

Recommendations