The Open UniversitySkip to content
 

Semantic processing using the Hidden Vector State Model

He, Yulan and Young, Steve (2005). Semantic processing using the Hidden Vector State Model. Computer Speech and Language, 19(1) pp. 85–106.

Full text available as:
Full text not publicly available
Due to copyright restrictions, this file is not available for public download
DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1016/j.csl.2004.03.001
Google Scholar: Look up in Google Scholar

Abstract

This paper discusses semantic processing using the Hidden Vector State (HVS) model. The HVS model extends the basic discrete Markov model by encoding context in each state as a vector. State transitions are then factored into a stack shift operation similar to those of a push-down automaton followed by a push of a new preterminal semantic category label. The key feature of the model is that it can capture hierarchical structure without the use of treebank data for training.

Experiments have been conducted in the travel domain using the relatively simple ATIS corpus and the more complex DARPA Communicator Task. The results show that the HVS model can be robustly trained from only minimally annotated corpus data. Furthermore, when measured by its ability to extract attribute-value pairs from natural language queries in the travel domain, the HVS model outperforms a conventional finite-state semantic tagger by 4.1% in F-measure for ATIS and by 6.6% in F-measure for Communicator, suggesting that the benefit of the HVS model's ability to encode context increases as the task becomes more complex.

Item Type: Journal Article
Copyright Holders: 2004 Elsevier Ltd
ISSN: 0885-2308
Academic Unit/Department: Knowledge Media Institute
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 23371
Depositing User: Kay Dave
Date Deposited: 28 Mar 2011 09:28
Last Modified: 24 Oct 2012 13:55
URI: http://oro.open.ac.uk/id/eprint/23371
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk