The Open UniversitySkip to content
 

A comparison of human and computer marking of short free-text student responses

Butcher, Philip G. and Jordan, Sally E. (2010). A comparison of human and computer marking of short free-text student responses. Computers and Education, 55(2) pp. 489–499.

Full text available as:
[img]
Preview
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (456Kb)
DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1016/j.compedu.2010.02.012
Google Scholar: Look up in Google Scholar

Abstract

The computer marking of short-answer free-text responses of around a sentence in length has been found to be at least as good as that of six human markers. The marking accuracy of three separate computerised systems has been compared, one system (Intelligent Assessment Technologies FreeText Author) is based on computational linguistics whilst two (Regular Expressions and OpenMark) are based on the algorithmic manipulation of keywords. In all three cases, the development of high-quality response matching has been achieved by the use of real student responses to developmental versions of the questions and FreeText Author and OpenMark have been found to produce marking of broadly similar accuracy. Reasons for lack of accuracy in human marking and in each of the computer systems are discussed.

Item Type: Journal Article
Copyright Holders: 2010 Elsevier Ltd
ISSN: 0360-1315
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetUK Higher Education Funding Council via the Centre for Open Learning of Mathematics, Computing, Science and Technology (COLMSCT)
Keywords: Authoring tools and methods
Academic Unit/Department: Other Departments > Learning and Teaching Solutions
Science > Physical Sciences
Interdisciplinary Research Centre: Centre for Research in Education and Educational Technology (CREET)
eSTEeM
Item ID: 20868
Depositing User: Sally Jordan
Date Deposited: 13 Apr 2010 12:29
Last Modified: 27 Jul 2014 21:29
URI: http://oro.open.ac.uk/id/eprint/20868
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk