The Open UniversitySkip to content

Understanding the Role of Time on Task in Formative Assessment: The Case of Mathematics Learning

Tempelaar, Dirk T.; Rienties, Bart and Giesbers, Bas (2015). Understanding the Role of Time on Task in Formative Assessment: The Case of Mathematics Learning. In: Ras, Eric and Joosten-ten Brinke, Desiree eds. Computer Assisted Assessment. Research into E-Assessment. Communications in Computer and Information Science, 571. Heidelberg: Springer, pp. 120–133.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Mastery data derived from formative assessments constitute a rich data set in the development of student performance prediction models. The dominance of formative assessment mastery data over use intensity data such as time on task or number of clicks was the outcome of previous research by the authors in a dispositional learning analytics context. Practical implications of these findings are far reaching, contradicting current practices of developing (learning analytics based) student performance prediction models based on intensity data as central predictor variables. In this empirical follow-up study using data of 2011 students, we search for an explanation for time on task data being dominated by mastery data. We do so by investigating more general models, allowing for nonlinear, even non-monotonic, relationships between time on task and performance measures. Clustering students into subsamples, with different time on task characteristics, suggests heterogeneity of the sample to be an important cause of the nonlinear relationships with performance measures. Time on task data appear to be more sensitive to the effects of heterogeneity than mastery data, providing a further argument to prioritize formative assessment mastery data as predictor variables in the design of prediction models directed at the generation of learning feedback.

Item Type: Book Section
Copyright Holders: 2015 Springer International Publishing
ISBN: 3-319-27703-0, 978-3-319-27703-5
ISSN: 1865-0929
Extra Information: Proceedings of the 18th International Conference, CAA 2015, Zeist, The Netherlands, June 22–23, 2015.
Keywords: formative assessment; computer assisted assessment; dispositional learning analytics; blended learning; e-tutorials; student profiles
Academic Unit/School: Learning and Teaching Innovation (LTI) > Institute of Educational Technology (IET)
Learning and Teaching Innovation (LTI)
Item ID: 45050
Depositing User: Bart Rienties
Date Deposited: 05 Jan 2016 09:14
Last Modified: 07 Dec 2018 10:37
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU