The Open UniversitySkip to content

Document Boltzmann Machines for Information Retrieval

Yu, Qian; Zhang, Peng; Hou, Yuexian; Song, Dawei and Wang, Jun (2015). Document Boltzmann Machines for Information Retrieval. In: Advances in Information Retrieval - 37th European Conference on IR Research, Lecture Notes in Computer Science, Springer International Publishing, pp. 666–671.

Full text available as:
Full text not publicly available (Version of Record)
Due to publisher licensing restrictions, this file is not available for public download
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Probabilistic language modelling has been widely used in information retrieval. It estimates document models under the multinomial distribution assumption, and uses query likelihood to rank documents. In this paper, we aim to generalize this distribution assumption by exploring the use of fully-observable Boltzmann Machines (BMs) for document modelling. BM is a stochastic recurrent network and is able to model the distribution of multi-dimensional variables. It yields a kind of Boltzmann distribution which is more general than multinomial distribution. We propose a Document Boltzmann Machine (DBM) that can naturally capture the intrinsic connections among terms and estimate query likelihood efficiently. We formally prove that under certain conditions (with 1-order parameters learnt only), DBM subsumes the traditional document language model. Its relations to other graphical models in IR, e.g., MRF model, are also discussed. Our experiments on the document re-ranking demonstrate the potential of the proposed DBM.

Item Type: Conference or Workshop Item
Copyright Holders: 2015 Springer International Publishing Switzerland
ISBN: 3-319-16353-1, 978-3-319-16353-6
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 42212
Depositing User: Dawei Song
Date Deposited: 24 Aug 2015 08:21
Last Modified: 07 Dec 2018 22:58
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU