The Open UniversitySkip to content

Why did you pick that? Capturing reasons for assigning value in exploratory search

Cerviño Beresi, Ulises; Kim, Yunhyong; Song, Dawei and Ruthven, Ian (2011). Why did you pick that? Capturing reasons for assigning value in exploratory search. International Journal on Digital Libraries, 11 pp. 59–74.

Full text available as:
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB)
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


In this article, we present a set of approaches in analysing data gathered during experimentation with exploratory search systems and users’ acts of judging the relevance of the information retrieved by the system. We present three tools for quantitatively analysing encoded qualitative data: relevance-criteria profile, relevance-judgement complexity and session visualisation. Relevance-criteria profiles capture the prominence of each criterion usage with respect to the search sessions of individuals or selected user groups (e.g. groups defined by the users affiliations and/or level of research experience). Relevance-judgement complexity, on the other hand, reflects the number of criteria involved in a single judgment process. Finally, session visualisation brings these results together in a sequential representation of criteria usage and relevance judgements throughout a session, potentially allowing the researcher to quickly detect emerging patterns with respect to interactions, relevance criteria usage and complexity. The use of these tools is demonstrated using results from a pilot-user study that was conducted at the Robert Gordon University in 2008. We conclude by highlighting how these tools might be used to support the improvement of end-user services in digital libraries.

Item Type: Journal Item
Copyright Holders: 2011 Springer-Verlag
ISSN: 1432-1300
Extra Information: From the issue entitled "Focused Issue on ECDL 2010"
Keywords: relevance criteria; exploratory search; information retrieval; literature-based discovery; user study; document valuation
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 33892
Depositing User: Dawei Song
Date Deposited: 21 Jun 2012 09:07
Last Modified: 12 Jun 2020 14:51
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU