The Open UniversitySkip to content

Co-created Evaluation: identifying how games support police learning

Adams, Anne; Hart, Jennefer; Iacovides, Ioanna; Beavers, Sian; Olivera, Manuel and Margoudi, Maria (2019). Co-created Evaluation: identifying how games support police learning. International Journal of Human-Computer Studies, 132 pp. 34–44.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


HCI often produces improved systems through co-creation with practitioners. However, evaluation methods are primarily researcher-led (i.e. not co-created with practitioners). As part of a games-based learning evaluation, we detail a novel co-creation method that produces evaluations on how technology influences learning. Based upon educational threshold concept theories, the Tricky Topic method supported the co-creation of knowledge-based evaluation questionnaires with trainers. The evaluation involved 116 new recruit police officers from three UK police forces who participated in a randomized-control trial. The Tricky Topic method provided insights of how the game significantly increased understanding p<.001 (moderate effect size) in comparison with face-to-face training. Tricky topic breakdowns identify increased tacit understanding (e.g. empathy, attention) after games training, and decreased tacit understanding (e.g. respect) after face-to face training. Finally, further research opportunities are discussed concerning co-created evaluation for valid and relevant deconstruction of participants’ understanding that allow designers to pinpoint systems-specific learning benefits.

Item Type: Journal Item
Copyright Holders: 2019 Elsevier Ltd.
ISSN: 1071-5819
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetHEFCE Higher Education Funding Council for England
Not SetNot SetCollege of Policing
Not SetNot SetCentre for Policing Research and Learning
Keywords: Evaluation; Serious Games; Tricky Topics; Police Training
Academic Unit/School: Institute of Educational Technology (IET)
Item ID: 60196
Depositing User: ORO Import
Date Deposited: 28 Mar 2019 16:00
Last Modified: 18 Jun 2020 02:35
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU