Where is the evidence? A call to action for learning analytics

Ferguson, Rebecca and Clow, Doug (2017). Where is the evidence? A call to action for learning analytics. In: LAK '17 Proceedings of the Seventh International Learning Analytics & Knowledge Conference, ACM International Conference Proceeding Series, ACM, New York, USA, pp. 56–65.

DOI: https://doi.org/10.1145/3027385.3027396

URL: http://dl.acm.org/citation.cfm?id=3027396

Abstract

Where is the evidence for learning analytics? In particular, where is the evidence that it improves learning in practice? Can we rely on it? Currently, there are vigorous debates about the quality of research evidence in medicine and psychology, with particular issues around statistical good practice, the 'file drawer effect', and ways in which incentives for stakeholders in the research process reward the quantity of research produced rather than the quality. In this paper, we present the Learning Analytics Community Exchange (LACE) project's Evidence Hub, an effort to relate research evidence in learning analytics to four propositions about learning analytics: whether they support learning, support teaching, are deployed widely, and are used ethically. Surprisingly little evidence in this strong, specific sense was found, and very little was negative (7%, N=123), suggesting that learning analytics is not immune from the pressures in other areas. We explore the evidence in one particular area in detail (whether learning analytics improve teaching and learners support in the university sector), and set out some of the weaknesses of the evidence available. We conclude that there is considerable scope for improving the evidence base for learning analytics, and set out some suggestions of ways for various stakeholders to achieve this.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI

About

• Item ORO ID
• 48992
• Item Type
• Conference or Workshop Item
• ISBN
• 1-4503-4870-X, 978-1-4503-4870-6
• Project Funding Details

• Funded Project Name	Project ID	Funding Body
  Learning Analytics Community Exchange (H-13-001-DC)	619424	European Union FP7

• Keywords
• Access; Ethics; Evidence; Evidence Hub; Generalisability; Learning Analytics Cycle; Reliability; Validity
• Academic Unit or School
• Institute of Educational Technology (IET)
• Copyright Holders
• © 2017 The Author(s)
• Depositing User
• Rebecca Ferguson