Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5)

Striegnitz, Kristina; Denis, Alexandre; Gargett, Andrew; Garoufi, Konstantina; Koller, Alexander and Theune, Marië (2011). Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5). In: Proceedings of the 13th European Workshop on Natural Language Generation, 28-30 Sep 2011, Nancy, France, Association for Computational Linguistics, 270–279.

Abstract

GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users.

Viewing alternatives

Item Actions

Export

You can export this page using these formats