The Open UniversitySkip to content

A Mixed Method Approach for Evaluating and Improving the Design of Learning in Puzzle Games

Visani Scozzi, Monica; Iacovides, Ioanna and Linehan, Conor (2017). A Mixed Method Approach for Evaluating and Improving the Design of Learning in Puzzle Games. In: CHI PLAY '17 Proceedings of the Annual Symposium on Computer-Human Interaction in Play, ACM, New York, NY, USA, pp. 217–228.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Despite the acknowledgment that learning is a necessary part of all gameplay, the area of Games User Research lacks an established evidence based method through which designers and researchers can understand, assess, and improve how commercial games teach players game-specific skills and information. In this paper, we propose a mixed method procedure that draws together both quantitative and experiential approaches to examine the extent to which players are supported in learning about the game world and mechanics. We demonstrate the method through presenting a case study of the game Portal involving 14 participants, who differed in terms of their gaming expertise. By comparing optimum solutions to puzzles against observed player performance, we illustrate how the method can indicate particular problems with how learning is structured within a game. We argue that the method can highlight where major breakdowns occur and yield design insights that can improve the player experience with puzzle games.

Item Type: Conference or Workshop Item
Copyright Holders: 2017 The Authors
ISBN: 1-4503-4898-X, 978-1-4503-4898-0
Project Funding Details:
Funded Project NameProject IDFunding Body
Keywords: Games; Learning Curves; Breakdowns; Player Experience, Evaluation Methods; Games User Research
Academic Unit/School: Learning and Teaching Innovation (LTI) > Institute of Educational Technology (IET)
Learning and Teaching Innovation (LTI)
Research Group: Health and Wellbeing PRA (Priority Research Area)
Item ID: 50719
Depositing User: Ioanna Iacovides
Date Deposited: 29 Aug 2017 15:10
Last Modified: 09 Dec 2018 08:21
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU