The Open UniversitySkip to content

Computer assisted assessment of diagrams

Thomas, Pete G.; Smith, Neil and Waugh, Kevin G. (2007). Computer assisted assessment of diagrams. In: Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education, 25-27 Jun 2007, Dundee, Scotland.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


In this paper, we describe an approach to the grading (marking) of graph-based diagrams. The work is an application of a framework for the computer interpretation of imprecise diagrams (which students produce in response to assessment questions). We describe the interpretation framework and how it has been applied in the domain of entity-relationship diagrams used in data modeling. In our approach to grading, student diagrams are compared to specimen solutions representing correct solutions to an assessment question. The comparison between a student diagram and a specimen solution diagram results in a matching of the two diagrams from which a grade is computed. The comparison matching is used to provide graphical feedback on the correctness of the student diagram. The approach has been applied to a test corpus of 394 diagrams produced in answer to an examination question with some good results: 91% of all automatically produced grades were within 0.5 of a mark of the human graders. However, when supertype-subtype associations are present, the performance drops to around 87%. The paper concludes with a discussion of some applications of the marker.

Item Type: Conference or Workshop Item
Copyright Holders: 2007 ACM
ISSN: 0097-8418
Keywords: automatic marking; diagrams; feedback;
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 19373
Depositing User: Kevin Waugh
Date Deposited: 04 Jan 2010 14:23
Last Modified: 07 Dec 2018 09:30
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU