The Open UniversitySkip to content

Generation of referring expressions: assessing the incremental algorithm

van Deemter, Kees; Gatt, Albert; van der Sluis, Ielka and Power, Richard (2012). Generation of referring expressions: assessing the incremental algorithm. Cognitive Science, 36(5) pp. 799–836.

Full text available as:
Full text not publicly available (Accepted Manuscript)
Due to publisher licensing restrictions, this file is not available for public download
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


A substantial amount of recent work in natural language generation has focussed on the generation of “one-shot” referring expressions whose only aim is to identify a target referent. Dale and Reiter’s Incremental Algo- rithm (ia) is often thought to be the best algorithm for maximising the similarity to referring expressions produced by people. We test this hy- pothesis by eliciting referring expressions from human subjects and com- puting the similarity between the expressions elicited and the ones gener- ated by algorithms. It turns out that the success of the IA depends sub- stantially on the “preference order” (po) employed by the ia, particularly in complex domains. While some pos cause the IA to produce referring expressions that are very similar to expressions produced by human sub- jects, others cause the IA to perform worse than its main competitors; moreover, it turns out to be difficult to predict the success of a po on the basis of existing psycholinguistic findings or frequencies in corpora. We also examine the computational complexity of the algorithms in ques- tion and argue that there are no compelling reasons for preferring the ia over some of its main competitors on these grounds. We conclude that future research on the generation of referring expressions should explore alternatives to the ia, focussing on algorithms, inspired by the Greedy Algorithm, which do not work with a fixed po.

Item Type: Journal Item
Copyright Holders: 2012 Cognitive Science Society Inc
ISSN: 1551-6709
Keywords: generation/production of referring expression; evaluation metrics for generation algorithms; psycholinguistics; reference; incremental algorithm
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Related URLs:
Item ID: 35154
Depositing User: Richard Power
Date Deposited: 02 Nov 2012 11:12
Last Modified: 07 Dec 2018 23:09
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU