A detailed account of the First Question Generation Shared Task Evaluation challenge

Rus, Vasile; Wyse, Brendan; Piwek, Paul; Lintean, Mihai; Stoyanchev, Svetlana and Moldovan, Cristian (2012). A detailed account of the First Question Generation Shared Task Evaluation challenge. Dialogue & Discourse, 3(2) pp. 177–204.

DOI: https://doi.org/10.5087/dad

URL: http://dad.uni-bielefeld.de/index.php/dad/article/...

Abstract

The paper provides a detailed account of the First Shared Task Evaluation Challenge on Question Generation that took place in 2010. The campaign included two tasks that take text as input and produce text, i.e. questions, as output: Task A – Question Generation from Paragraphs and Task B – Question Generation from Sentences. Motivation, data sets, evaluation criteria, guidelines for judges, and results are presented for the two tasks. Lessons learned and advice for future Question Generation Shared Task Evaluation Challenges (QG-STEC) are also offered.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI

About

• Item ORO ID
• 33235
• Item Type
• Journal Item
• ISSN
• 2152-9620
• Project Funding Details

• Funded Project Name	Project ID	Funding Body
  Not Set	Not Set	National Science Foundation (NSF)
  Not Set	Not Set	The Institute for Education Sciences
  Not Set	Not Set	The Engineering and Physical Sciences Research Council (EPSRC)

• Keywords
• natural language processing; natural language generation; Shared Task and Evaluation Campaign; question generation
• Academic Unit or School
• Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
  Faculty of Science, Technology, Engineering and Mathematics (STEM)
• Research Group
• Centre for Research in Computing (CRC)
• Copyright Holders
• © 2012 The Authors
• Depositing User
• Paul Piwek