Hou, Yuexian; Zhao, Ziaozhao; Song, Dawei and Li, Weijie
(2013).
|
(Version of Record)
Due to publisher licensing restrictions, this file is not available for public download Click here to request a copy from the OU Author. |
| DOI (Digital Object Identifier) Link: | https://doi.org/10.1145/2493175.2493177 |
|---|---|
| Google Scholar: | Look up in Google Scholar |
Abstract
The classical bag-of-word models for Information Retrieval (IR) fail to capture contextual associations between words. In this paper, we propose to investigate the “pure high-order dependence” among a number of words forming an un-separable semantic entity, i.e., the high-order dependence that cannot be reduced to the random coincidence of lower-order dependencies. We believe that identifying these pure high-order dependence patterns will lead to a better representation of documents and novel retrieval models. Specifically, two formal definitions of pure dependence: Unconditional Pure Dependence (UPD) and Conditional Pure Dependence (CPD) are presented. The decision on UPD and CPD, however, is a NP-hard in general.
We hence prove the sufficient criteria that entail UPD and CPD, within the well-principled Information Geometry (IG) framework, leading to a more feasible UPD/CPD identification procedure. We further develop novel methods to extract word patterns with pure high-order dependence. Our methods are applied to and extensively evaluated on three typical IR tasks: text classification, and text retrieval without and with query expansion.
| Item Type: | Journal Item |
|---|---|
| Copyright Holders: | 2013 ACM |
| ISSN: | 1558-2868 |
| Academic Unit/School: | Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications Faculty of Science, Technology, Engineering and Mathematics (STEM) |
| Related URLs: |
|
| Item ID: | 36460 |
| Depositing User: | Dawei Song |
| Date Deposited: | 31 Jan 2013 11:01 |
| Last Modified: | 15 Sep 2018 14:37 |
| URI: | http://oro.open.ac.uk/id/eprint/36460 |
| Share this page: |     |
Metrics
Altmetrics from Altmetric | Citations from Dimensions |
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)