The Open UniversitySkip to content

Generating multimedia presentations: from plain text to screenplay

Piwek, Paul; Power, Richard; Scott, Donia and Van Deemter, Kees (2005). Generating multimedia presentations: from plain text to screenplay. In: Stock, Oliviero and Zancanaro, Massimo eds. Multimodal intelligent information presentation. Text, speech and language technology, 27. Dordrecht, The Netherlands: Springer, pp. 203–226.

Full text available as:
PDF (Not Set) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (181Kb)
Google Scholar: Look up in Google Scholar


In many Natural Language Generation (NLG) applications, the output is limited to plain text – i.e., a string of words with punctuation and paragraph breaks, but no indications for layout, or pictures, or dialogue. In several projects, we have begun to explore NLG applications in which these extra media are brought into play. This paper gives an informal account of what we have learned. For coherence, we focus on the domain of patient information leaflets, and follow an example in which the same content is expressed first in plain text, then in formatted text, then in text with pictures, and finally in a dialogue script that can be performed by two animated agents. We show how the same meaning can be mapped to realisation patterns in different media, and how the expanded options for expressing meaning are related to the perceived style and tone of the presentation. Throughout, we stress that the extra media are not simple added to plain text, but integrated with it: thus the use of formatting, or pictures, or dialogue, may require radical rewording of the text itself.

Item Type: Book Chapter
ISBN: 1-4020-3049-5, 978-1-4020-3049-9
Keywords: Computational Linguistics; Natural Language Generation; Document Structure; Multimodality; Scripted Dialogue
Academic Unit/Department: Mathematics, Computing and Technology > Computing & Communications
Mathematics, Computing and Technology
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 3184
Depositing User: Paul Piwek
Date Deposited: 26 Jun 2006
Last Modified: 25 Nov 2014 15:28
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340