The Open UniversitySkip to content

Facing the challenge in evaluating technology use in mobile environments

McAndrew, Patrick; Taylor, Josie and Clow, Doug (2010). Facing the challenge in evaluating technology use in mobile environments. Open Learning: The Journal of Open and Distance Learning, 25(3) pp. 233–249.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (2MB)
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


The process of developing innovative mobile approaches to informal and formal learning is challenging, not least in needing to satisfy stakeholders with diverse interests in the technology, the pedagogy and the overall system. Some approaches to evaluation may focus on examining the nature and quality of learning that occurs, while other methods may take a user-centred approach to understand interactions with the systems. In this paper we highlight a methodology that attempts to address these two analytical issues in parallel, and to communicate the results to stakeholders. The methodology is grounded in cultural historical activity theory and is compatible with other views emerging that such evaluation can have multiple levels. The method applies task analysis to examine the conflicts that emerge when learners are interacting with technological systems in an informal learning setting. Results from a trial involving first-aiders are used to illustrate the techniques as they were applied as part of a European project that developed a collaborative mobile learning environment. The method has been repeated in other studies and is suggested to provide a valuable tool to reflect on understanding and enable the sharing of

Item Type: Journal Item
Copyright Holders: 2010 The Open University
ISSN: 0268-0513
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetEuropean Union
Keywords: mobile learning; activity theory; trials; task model
Academic Unit/School: Learning and Teaching Innovation (LTI) > Institute of Educational Technology (IET)
Learning and Teaching Innovation (LTI)
Research Group: Centre for Research in Education and Educational Technology (CREET)
Centre for Research in Computing (CRC)
Item ID: 23820
Depositing User: Patrick McAndrew
Date Deposited: 10 Nov 2010 10:43
Last Modified: 07 Dec 2018 18:11
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU