The Open UniversitySkip to content

A detailed account of the First Question Generation Shared Task Evaluation challenge

Rus, Vasile; Wyse, Brendan; Piwek, Paul; Lintean, Mihai; Stoyanchev, Svetlana and Moldovan, Cristian (2012). A detailed account of the First Question Generation Shared Task Evaluation challenge. Dialogue & Discourse, 3(2) pp. 177–204.

Full text available as:
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (984kB)
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


The paper provides a detailed account of the First Shared Task Evaluation Challenge on Question Generation that took place in 2010. The campaign included two tasks that take text as input and produce text, i.e. questions, as output: Task A – Question Generation from Paragraphs and Task B – Question Generation from Sentences. Motivation, data sets, evaluation criteria, guidelines for judges, and results are presented for the two tasks. Lessons learned and advice for future Question Generation Shared Task Evaluation Challenges (QG-STEC) are also offered.

Item Type: Journal Item
Copyright Holders: 2012 Vasile Rus, Brendan Wyse, et al.
ISSN: 2152-9620
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetNational Science Foundation (NSF)
Not SetNot SetThe Institute for Education Sciences
Not SetNot SetThe Engineering and Physical Sciences Research Council (EPSRC)
Keywords: natural language processing; natural language generation; Shared Task and Evaluation Campaign; question generation
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 33235
Depositing User: Paul Piwek
Date Deposited: 21 Mar 2012 14:09
Last Modified: 12 Jun 2020 14:04
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU