The Open UniversitySkip to content

Two step relevance feedback for semantic disambiguation in image retrieval

Heesch, Daniel and Rüger, Stefan (2008). Two step relevance feedback for semantic disambiguation in image retrieval. In: Visual Information Systems Web-Based Visual Information Search and Management.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This paper presents a new approach to the problem of feature weighting for content based image retrieval. If a query image admits to multiple interpretations, user feedback on the set of returned images can be an effective tool to improve retrieval performance in subsequent rounds. For this to work, however, the first results set has to include representatives of the semantic facet of interest. We will argue that relevance feedback techniques that fix the distance metric for the first retrieval round are semantically biased and may fail to distil relevant semantic facets thus limiting the scope of relevance feedback. Our approach is based on the notion of the NN k of a query image, defined as the set of images that are nearest neighbours of the query under some instantiation of a parametrised distance metric. Different neighbours may be viewed as representing different meanings of the query. By associating each NN k with the parameters for which it was ranked closest to the query, the selection of relevant NN k by a user provides us with parameters for the second retrieval round. We evaluate this two step relevance feedback technique on two collections and compare it to an alternative relevance feedback method and to an oracle for which the optimal parameter values are known.

Item Type: Conference or Workshop Item
Copyright Holders: 2008 Springer-Verlag
ISSN: 0302-9743
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 11970
Depositing User: Users 8580 not found.
Date Deposited: 08 Oct 2008 14:11
Last Modified: 07 Dec 2018 09:13
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU