The Open UniversitySkip to content

A detailed account of the First Question Generation Shared Task Evaluation challenge

Rus, Vasile; Wyse, Brendan; Piwek, Paul; Lintean, Mihai; Stoyanchev, Svetlana and Moldovan, Cristian (2012). A detailed account of the First Question Generation Shared Task Evaluation challenge. Dialogue & Discourse, 3(2) pp. 177–204.

Full text available as:
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (961Kb)
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


The paper provides a detailed account of the First Shared Task Evaluation Challenge on Question Generation that took place in 2010. The campaign included two tasks that take text as input and produce text, i.e. questions, as output: Task A – Question Generation from Paragraphs and Task B – Question Generation from Sentences. Motivation, data sets, evaluation criteria, guidelines for judges, and results are presented for the two tasks. Lessons learned and advice for future Question Generation Shared Task Evaluation Challenges (QG-STEC) are also offered.

Item Type: Journal Article
Copyright Holders: 2012 Vasile Rus, Brendan Wyse, et al.
ISSN: 2152-9620
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetNational Science Foundation (NSF)
Not SetNot SetThe Institute for Education Sciences
Not SetNot SetThe Engineering and Physical Sciences Research Council (EPSRC)
Keywords: natural language processing; natural language generation; Shared Task and Evaluation Campaign; question generation
Academic Unit/Department: Mathematics, Computing and Technology > Computing & Communications
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 33235
Depositing User: Paul Piwek
Date Deposited: 21 Mar 2012 14:09
Last Modified: 25 Nov 2014 21:38
Share this page:


Scopus Citations

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340