Co-created Evaluation: identifying how games support police learning

Adams, Anne; Hart, Jennefer; Iacovides, Ioanna; Beavers, Sian; Olivera, Manuel and Margoudi, Maria (2019). Co-created Evaluation: identifying how games support police learning. International Journal of Human-Computer Studies, 132 pp. 34–44.

DOI: https://doi.org/10.1016/j.ijhcs.2019.03.009

Abstract

HCI often produces improved systems through co-creation with practitioners. However, evaluation methods are primarily researcher-led (i.e. not co-created with practitioners). As part of a games-based learning evaluation, we detail a novel co-creation method that produces evaluations on how technology influences learning. Based upon educational threshold concept theories, the Tricky Topic method supported the co-creation of knowledge-based evaluation questionnaires with trainers. The evaluation involved 116 new recruit police officers from three UK police forces who participated in a randomized-control trial. The Tricky Topic method provided insights of how the game significantly increased understanding p<.001 (moderate effect size) in comparison with face-to-face training. Tricky topic breakdowns identify increased tacit understanding (e.g. empathy, attention) after games training, and decreased tacit understanding (e.g. respect) after face-to face training. Finally, further research opportunities are discussed concerning co-created evaluation for valid and relevant deconstruction of participants’ understanding that allow designers to pinpoint systems-specific learning benefits.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI

About

• Item ORO ID
• 60196
• Item Type
• Journal Item
• ISSN
• 1071-5819
• Project Funding Details

• Funded Project Name	Project ID	Funding Body
  Not Set	Not Set	HEFCE Higher Education Funding Council for England
  Not Set	Not Set	College of Policing
  Not Set	Not Set	Centre for Policing Research and Learning

• Keywords
• Evaluation; Serious Games; Tricky Topics; Police Training
• Academic Unit or School
• Institute of Educational Technology (IET)
• Copyright Holders
• © 2019 Elsevier Ltd.
• Depositing User
• ORO Import