A study of document weight smoothness in pseudo relevance feedback

Zhang, Peng; Song, Dawei; Zhao, Xiaozhao and Hou, Yuexian (2010). A study of document weight smoothness in pseudo relevance feedback. In: 6th Asia Information Retrieval Societies Conference (AIRS2010), 1-3 Dec 2010, Taipei.

DOI: https://doi.org/10.1007/978-3-642-17187-1_50

URL: http://link.springer.com/chapter/10.1007%2F978-3-6...

Abstract

In pseudo relevance feedback (PRF), the document weight which indicates how important a document is for the PRF model, plays a key role. In this paper, we investigate the smoothness issue of the document weights in PRF. The term smoothness means that the document weights decrease smoothly (i.e. gradually) along the document ranking list, and the weights are smooth (i.e. similar) within topically similar documents. We postulate that a reasonably smooth document- weighting function can benefit the PRF performance. This hypothesis is tested under a typical PRF model, namely the Relevance Model (RM). We propose a two-step document weight smoothing method, the different instantiations of which have different effects on weight smoothing. Ex- periments on three TREC collections show that the instantiated methods with better smoothing effects generally lead to better PRF performance. In addition, the proposed method can significantly improve the RM’s performance and outperform various alternative methods which can also be used to smooth the document weights.

Viewing alternatives

Look up in Google Scholar

Download history

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

CORE (COnnecting REpositories)

Recommendations