The Open UniversitySkip to content

Automatically assessing diagrams

Thomas, Pete; Smith, Neil and Waugh, Kevin (2009). Automatically assessing diagrams. In: IADIS International Conference e-Learning, 17-20 Jun 2009, Algarve, Portugal.

Google Scholar: Look up in Google Scholar


Diagrams are ubiquitous; they are used to communicate ideas and are often used to model aspects of the real world. We teach with them and expect students to develop modelling skills using them. In conventional, paper-based assessment, we do not think twice about asking students to draw free-hand diagrams to express both their knowledge and drawing skills. In e-Assessment, the situation is very different. There is very little support for assessing diagramming skills and where students can draw free-form diagrams (with a drawing tool) the assessment has to be human. In this paper we discuss an approach to the automatic marking of a certain class of diagrams (almost graph-based) illustrating how we have incorporated domain knowledge, pedagogy and marking schemes into the process. In particular, the paper examines the general strategy for automatic marking based on meaningful units and how marking schemes are constructed. The paper concludes with the results of applying our method to a corpus of student diagrams and illustrates how the consistency afforded by automatic marking can overcome some of the deficiencies in human marking.

Item Type: Conference or Workshop Item
Copyright Holders: 2009 The Authors
Extra Information: Editors: Miguel Baptista Nunes and Maggie McPherson (series editors: Piet Kommers, Pedro Isaías and Nian-Shing Chen)
ISBN: 978-972-8924-83-6
Volume: V I, 2
Keywords: automatic marking; diagrams; e-assessment;
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 19219
Depositing User: Kevin Waugh
Date Deposited: 16 Dec 2009 11:15
Last Modified: 07 Dec 2018 09:30
Share this page:

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU