The Open UniversitySkip to content

Learning and optimization of an aspect hidden Markov model for query language model generation

Huang, Qiang; Song, Dawei; Rüger, Stefan and Bruza, Peter (2007). Learning and optimization of an aspect hidden Markov model for query language model generation. In: International Conference on the Theory of Information Retrieval, 18-20 Oct 2007.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (70kB)
Google Scholar: Look up in Google Scholar


The Relevance Model (RM) incorporates pseudo relevance feedback to derive query language model and has shown a good performance. Generally, it is based on uni-gram models of individual feedback documents from which query terms are sampled independently. In this paper, we present a new method to build the query model with latent state machine (LSM) which captures the inherent term dependencies within the query and the term dependencies between query and documents. Our method firstly splits the query into subsets of query terms (i.e., not only single terms, but different combinations of multiple query terms). Secondly, these query term combinations are then considered as weighted latent states of a hidden Markov Model to derive a new query model from the pseudo relevant documents. Thirdly, our method integrates the Aspect Model (AM) with the EM algorithm to estimate the parameters involved in the model. Specifically, the pseudo relevant documents are segmented into chunks, and different chunks are associated with different weights in relation to a latent state. Our approach is empirically evaluated on three TREC collections, and demonstrates statistically significant improvements over a baseline language model and the Relevance Model.

Item Type: Conference or Workshop Item
Copyright Holders: 2007 The Authors
ISSN: 1587-2386
Keywords: aspect model; latent variable model; segmentation; information retrieval
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Related URLs:
Item ID: 29587
Depositing User: Stefan Rüger
Date Deposited: 28 Sep 2011 12:19
Last Modified: 20 Oct 2017 06:13
Share this page:

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU