Sentiment and behaviour annotation in a corpus of dialogue summaries

Roman, Norton Trevisan; Piwek, Paul; Carvalho, Ariadne Maria Brito Rizzoni and Alvares, Alexandre Rossi (2015). Sentiment and behaviour annotation in a corpus of dialogue summaries. Journal of Universal Computer Science, 21(4) pp. 561–586.

DOI: https://doi.org/10.3217/jucs-021-04-0561

Abstract

This paper proposes a scheme for sentiment annotation. We show how the task can be made tractable by focusing on one of the many aspects of sentiment: sentiment as it is recorded in behaviour reports of people and their interactions. Together with a number of measures for supporting the reliable application of the scheme, this allows us to obtain sufficient to good agreement scores (in terms of Krippendorf's alpha) on three key dimensions: polarity, evaluated party and type of clause. Evaluation of the scheme is carried out through the annotation of an existing corpus of dialogue summaries (in English and Portuguese) by nine annotators. Our contribution to the field is twofold: (i) a reliable multi-dimensional annotation scheme for sentiment in behaviour reports; and (ii) an annotated corpus that was used for testing the reliability of the scheme and which is made available to the research community.

Viewing alternatives

Look up in Google Scholar

Download history

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

CORE (COnnecting REpositories)

Recommendations