The Open UniversitySkip to content

Automatically assessing graph-based diagrams

Thomas, Pete; Smith, Neil and Waugh, Kevin (2008). Automatically assessing graph-based diagrams. Learning, Media and Technology, 33(3) pp. 249–267.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


To date there has been very little work on the machine understanding of imprecise diagrams, such as diagrams drawn by students in response to assessment questions. Imprecise diagrams exhibit faults such as missing, extraneous and incorrectly formed elements. The semantics of imprecise diagrams are difficult to determine. While there have been successful attempts at assessing text (essays) automatically, little success with diagrams has been reported. In this paper, we explain an approach to the automatic interpretation of graph-based diagrams based on a five-stage framework. The paper describes our approach to automatically grading graph-based diagrams and reports on some experiments into the automatic grading of student diagrams. The diagrams were produced under examination conditions and the output of the automatic marker was compared with the original human marks across a large number of diagrams. The experiments show good agreement between the performance of the automatic marker and the human markers. The paper also describes how the automatic marking algorithm has been incorporated into a variety of software teaching and learning tools. One tool supports the human grading of entity-relationship diagrams (ERDs). Another tool is for student use during the revision of ERDs. This tool automatically marks student answers in real-time and provides dynamically created feedback to help guide the student's progress.

Item Type: Journal Item
Copyright Holders: 2008 Taylor & Francis
ISSN: 1743-9884
Keywords: diagrams; imprecision; automated assessment; revision; software tools
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 19229
Depositing User: Kevin Waugh
Date Deposited: 16 Dec 2009 10:54
Last Modified: 07 Dec 2018 09:30
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU