The Open UniversitySkip to content

Sentiment and behaviour annotation in a corpus of dialogue summaries

Roman, Norton Trevisan; Piwek, Paul; Carvalho, Ariadne Maria Brito Rizzoni and Alvares, Alexandre Rossi (2015). Sentiment and behaviour annotation in a corpus of dialogue summaries. Journal of Universal Computer Science, 21(4) pp. 561–586.

Full text available as:
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (271kB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This paper proposes a scheme for sentiment annotation. We show how the task can be made tractable by focusing on one of the many aspects of sentiment: sentiment as it is recorded in behaviour reports of people and their interactions. Together with a number of measures for supporting the reliable application of the scheme, this allows us to obtain sufficient to good agreement scores (in terms of Krippendorf's alpha) on three key dimensions: polarity, evaluated party and type of clause. Evaluation of the scheme is carried out through the annotation of an existing corpus of dialogue summaries (in English and Portuguese) by nine annotators. Our contribution to the field is twofold: (i) a reliable multi-dimensional annotation scheme for sentiment in behaviour reports; and (ii) an annotated corpus that was used for testing the reliability of the scheme and which is made available to the research community.

Item Type: Journal Item
Copyright Holders: 2015 Journal of Universal Computer Science
ISSN: 0948-6968
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetCNPq (Conselho Nacional de Desenvolvimento Cient´ıfico e Tecnol´ogico
Not SetNot SetCAPE (Coordena¸cao de Aperfeicoamento de Pessoal de Nıvel Superior
Project NECA IST-2000-28580Not SetEC
Not SetNot SetPrograma de Educacao Tutorial (PET) – MEC/ SESu
Keywords: automatic dialogue summarisation; computational linguistics; corpus annotation; natural language processing; sentiment analysis
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 43294
Depositing User: Paul Piwek
Date Deposited: 02 Jun 2015 14:03
Last Modified: 25 May 2019 12:19
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU