The Open UniversitySkip to content
 

Using NLP to support scalable assessment of short free text responses

Willis, Alistair (2015). Using NLP to support scalable assessment of short free text responses. In: Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, pp. 243–253.

URL: http://aclweb.org/anthology/W/W15/W15-0628.pdf
Google Scholar: Look up in Google Scholar

Abstract

Marking student responses to short answer questions raises particular issues for human markers, as well as for automatic marking systems. In this paper we present the Amati system, which aims to help human markers improve the speed and accuracy of their marking. Amati supports an educator in incrementally developing a set of automatic marking rules, which can then be applied to larger question sets or used for automatic marking. We show that using this system allows markers to develop mark schemes which closely match the judgements of a human expert, with the benefits of consistency, scalability and traceability afforded by an automated marking system. We also consider some difficult cases for automatic marking, and look at some of the computational and linguistic properties of these cases.

Item Type: Conference or Workshop Item
Copyright Holders: 2015 Association for Computational Linguistics
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Related URLs:
Item ID: 43458
Depositing User: Alistair Willis
Date Deposited: 16 Jul 2015 09:01
Last Modified: 04 Oct 2016 11:46
URI: http://oro.open.ac.uk/id/eprint/43458
Share this page:

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU