Sentiment and behaviour annotation in a corpus of dialogue summaries

Roman, Norton Trevisan; Piwek, Paul; Carvalho, Ariadne Maria Brito Rizzoni and Alvares, Alexandre Rossi (2015). Sentiment and behaviour annotation in a corpus of dialogue summaries. Journal of Universal Computer Science, 21(4) pp. 561–586.

Full text available as:

Preview

PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (271kB) | Preview

URL:	http://www.jucs.org/jucs_21_4/sentiment_and_behavi...
Google Scholar:	Look up in Google Scholar

Abstract

This paper proposes a scheme for sentiment annotation. We show how the task can be made tractable by focusing on one of the many aspects of sentiment: sentiment as it is recorded in behaviour reports of people and their interactions. Together with a number of measures for supporting the reliable application of the scheme, this allows us to obtain sufficient to good agreement scores (in terms of Krippendorf's alpha) on three key dimensions: polarity, evaluated party and type of clause. Evaluation of the scheme is carried out through the annotation of an existing corpus of dialogue summaries (in English and Portuguese) by nine annotators. Our contribution to the field is twofold: (i) a reliable multi-dimensional annotation scheme for sentiment in behaviour reports; and (ii) an annotated corpus that was used for testing the reliability of the scheme and which is made available to the research community.

Item Type:

Journal Item

2015 Journal of Universal Computer Science

ISSN:

0948-6968

Project Funding Details:

Funded Project Name	Project ID	Funding Body
Not Set	Not Set	CNPq (Conselho Nacional de Desenvolvimento Cient´ıfico e Tecnol´ogico
Not Set	Not Set	CAPE (Coordena¸cao de Aperfeicoamento de Pessoal de Nıvel Superior
Project NECA IST-2000-28580	Not Set	EC
Not Set	Not Set	Programa de Educacao Tutorial (PET) – MEC/ SESu

Keywords:

automatic dialogue summarisation; computational linguistics; corpus annotation; natural language processing; sentiment analysis

Academic Unit/School:

Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)

Research Group:

Centre for Research in Computing (CRC)

Item ID:

43294

Depositing User:

Paul Piwek

Date Deposited:

02 Jun 2015 14:03

Last Modified:

07 Dec 2018 22:57

URI:

http://oro.open.ac.uk/id/eprint/43294

Share this page:

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

CORE (COnnecting REpositories)

Policies | Disclaimer