The Open UniversitySkip to content
 

Comparing automatically detected reflective texts with human judgements

Ullmann, Thomas Daniel; Wild, Fridolin and Scott, Peter (2012). Comparing automatically detected reflective texts with human judgements. In: 2nd Workshop on Awareness and Reflection in Technology-Enhanced Learning, 18 Sep 2013, Saarbrucken, Germany, pp. 101–116.

Full text available as:
[img]
Preview
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (271kB) | Preview
URL: http://ceur-ws.org/Vol-931/paper8.pdf
Google Scholar: Look up in Google Scholar

Abstract

This paper reports on the descriptive results of an experiment comparing automatically detected reflective and not-reflective texts against human judgements. Based on the theory of reflective writing assessment and their operationalisation five elements of reflection were defined. For each element of reflection a set of indicators was developed, which automatically annotate texts regarding reflection based on the parameterisation with authoritative texts. Using a large blog corpus 149 texts were retrieved, which were either annotated as reflective or notreflective. An online survey was then used to gather human judgements for these texts. These two data sets were used to compare the quality of the reflection detection algorithm with human judgments. The analysis indicates the expected difference between reflective and not reflective texts.

Item Type: Conference or Workshop Item
Copyright Holders: 2012 The Authors
ISSN: 1613-0073
Extra Information: ARTEL12
Awareness and Reflection in Technology-Enhanced Learning

Proceedings of the 2nd Workshop on Awareness and Reflection in Technology-Enhanced Learning

in conjunction with the 7th European Conference on Technology Enhanced Learning (EC-TEL 2012)
Saarbrücken, Germany, September 18, 2012.

Edited by Adam Moore, Viktoria Pammer, Lucia Pannese, Michael Prilla, Kamakshi Rajagopal, Wolfgang Reinhardt, Thomas Daniel Ullmann, Christian Voigt
Keywords: reflection; detection; thinking skills analytics
Academic Unit/School: Learning and Teaching Innovation (LTI) > Institute of Educational Technology (IET)
Learning and Teaching Innovation (LTI)
Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Centre for Research in Education and Educational Technology (CREET)
Item ID: 37830
Depositing User: Thomas Ullmann
Date Deposited: 21 Jun 2013 09:20
Last Modified: 02 May 2018 13:53
URI: http://oro.open.ac.uk/id/eprint/37830
Share this page:

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU