The Open UniversitySkip to content
 

Computer assisted assessment of diagrams

Thomas, Pete G.; Smith, Neil and Waugh, Kevin G. (2007). Computer assisted assessment of diagrams. In: Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education, 25-27 June 2007, Dundee, Scotland.

DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1145/1268784.1268806
Google Scholar: Look up in Google Scholar

Abstract

In this paper, we describe an approach to the grading (marking) of graph-based diagrams. The work is an application of a framework for the computer interpretation of imprecise diagrams (which students produce in response to assessment questions). We describe the interpretation framework and how it has been applied in the domain of entity-relationship diagrams used in data modeling. In our approach to grading, student diagrams are compared to specimen solutions representing correct solutions to an assessment question. The comparison between a student diagram and a specimen solution diagram results in a matching of the two diagrams from which a grade is computed. The comparison matching is used to provide graphical feedback on the correctness of the student diagram. The approach has been applied to a test corpus of 394 diagrams produced in answer to an examination question with some good results: 91% of all automatically produced grades were within 0.5 of a mark of the human graders. However, when supertype-subtype associations are present, the performance drops to around 87%. The paper concludes with a discussion of some applications of the marker.

Item Type: Conference Item
Copyright Holders: 2007 ACM
ISSN: 0097-8418
Keywords: automatic marking; diagrams; feedback;
Academic Unit/Department: Mathematics, Computing and Technology > Computing & Communications
Interdisciplinary Research Centre: Centre for Research in Computing (CRC)
Item ID: 19373
Depositing User: Kevin Waugh
Date Deposited: 04 Jan 2010 14:23
Last Modified: 02 Dec 2010 20:43
URI: http://oro.open.ac.uk/id/eprint/19373
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk