The Open UniversitySkip to content

Co-created Evaluation: identifying how games support police learning

Adams, Anne; Hart, Jennefer; Iacovides, Ioanna; Beavers, Sian; Olivera, Manuel and Margoudi, Maria (2019). Co-created Evaluation: identifying how games support police learning. International Journal of Human-Computer Studies, 132 pp. 34–44.

Full text available as:
Full text not publicly available (Accepted Manuscript)
Due to publisher licensing restrictions, this file is not available for public download until 25 March 2020
Click here to request a copy from the OU Author.
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


HCI often produces improved systems through co-creation with practitioners. However, evaluation methods are primarily researcher-led (i.e. not co-created with practitioners). As part of a games-based learning evaluation, we detail a novel co-creation method that produces evaluations on how technology influences learning. Based upon educational threshold concept theories, the Tricky Topic method supported the co-creation of knowledge-based evaluation questionnaires with trainers. The evaluation involved 116 new recruit police officers from three UK police forces who participated in a randomized-control trial. The Tricky Topic method provided insights of how the game significantly increased understanding p<.001 (moderate effect size) in comparison with face-to-face training. Tricky topic breakdowns identify increased tacit understanding (e.g. empathy, attention) after games training, and decreased tacit understanding (e.g. respect) after face-to face training. Finally, further research opportunities are discussed concerning co-created evaluation for valid and relevant deconstruction of participants’ understanding that allow designers to pinpoint systems-specific learning benefits.

Item Type: Journal Item
Copyright Holders: 2019 Elsevier Ltd.
ISSN: 1071-5819
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetHEFCE Higher Education Funding Council for England
Not SetNot SetCollege of Policing
Not SetNot SetCentre for Policing Research and Learning
Keywords: Evaluation; Serious Games; Tricky Topics; Police Training
Academic Unit/School: Institute of Educational Technology (IET)
Item ID: 60196
Depositing User: ORO Import
Date Deposited: 28 Mar 2019 16:00
Last Modified: 13 Dec 2019 16:28
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU