The Open UniversitySkip to content

Fully automated generation of question-answer pairs for scripted virtual instruction

Kuyten, Pascal; Bickmore, Timothy; Stoyanchev, Svetlana; Piwek, Paul; Prendinger, Helmut and Ishizuka, Mitsuru (2012). Fully automated generation of question-answer pairs for scripted virtual instruction. In: 12th International Conference on Intelligent Virtual Agents (Nakano, Yukiko; Neff, Michael; Paiva, Ana and Walker, Marilyn eds.), 12 - 14 September 2012, Santa Cruz, CA, USA.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


We introduce a novel approach for automatically generating a virtual instructor from textual input only. Our fully implemented system first analyzes the rhetorical structure of the input text and then creates various question-answer pairs using patterns. These patterns have been derived from correlations found between rhetorical structure of monologue texts and question-answer pairs in the corresponding dialogues. A selection of the candidate pairs is verbalized into a diverse collection of question-answer pairs. Finally the system compiles the collection of question-answer pairs into scripts for a virtual instructor. Our end-to-end system presents questions in pre-fixed order and the agent answers them. Our system was evaluated with a group of twenty-four subjects. The evaluation was conducted using three informed consent documents of clinical trials from the domain of colon cancer. Each of the documents was explained by a virtual instructor using 1) text, 2) text and agent monologue, and 3) text and agent performing question-answering. Results show that an agent explaining an informed consent document did not provide significantly better comprehension scores, but did score higher on satisfaction, compared to two control conditions.

Item Type: Conference Item
Copyright Holders: 2012 Springer-Verlag
Extra Information: Intelligent
Virtual Agents
12th International Conference, IVA 2012
Santa Cruz, CA, USA, September, 12-14, 2012
Edited by Yukiko Nakano, Michael Neff, Ana Paiva, Marilyn Walker
Berlin : Springer-Verlag, 2012
Lecture Notes in Artificial Intelligence, 7502
ISBN 978-3-642-33196-1
Keywords: embodied conversational agent; question generation; natural language generation; dialogue system
Academic Unit/Department: Mathematics, Computing and Technology > Computing & Communications
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Related URLs:
Item ID: 34669
Depositing User: Paul Piwek
Date Deposited: 17 Oct 2012 13:01
Last Modified: 24 Nov 2014 12:04
Share this page:


Scopus Citations

Actions (login may be required)

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340