Mitkov, Ruslan and Hallett, Catalina
(2007).
Comparing pronoun resolution algorithms.
Computational Intelligence, 23(2),
pp. 262–297.
Abstract
This paper discusses the comparative evaluation of five well-known pronoun resolution algorithms conducted with the help of a purpose-built tool for consistent evaluation in anaphora resolution, termed the evaluation workbench. The workbench enables the evaluation and comparison of pronoun resolution algorithms on the basis of the same preprocessing tools and test data. The tool is controlled by the user who can conduct the evaluation according to a variety of parameters, with regard to the types of anaphors and the samples used for evaluation. The extensive comparative evaluation of the pronoun resolution algorithms showed that their performance was significantly lower than the figures reported in the original papers describing the algorithms. The evaluation study concluded that the main reason for this drop in performance is the fact that all algorithms operate in a fully automatic mode.
| Item Type: |
Journal Article
|
| ISSN: |
0824-7935 |
| Keywords: |
Natural language processing; NLP; Computer science; Artificial intelligence; Computational intelligence; Human-computer interaction; Electronic data processing; Pronoun resolution |
| Academic Unit/Department: |
Mathematics, Computing and Technology > Computing |
| Item ID: |
15641 |
| Depositing User: |
Colin Smith
|
| Date Deposited: |
20 Apr 2009 13:40 |
| Last Modified: |
02 Dec 2010 20:26 |
| URI: |
http://oro.open.ac.uk/id/eprint/15641 |
Actions (login may be required)