Understanding the Role of Time on Task in Formative Assessment: The Case of Mathematics Learning

Tempelaar, Dirk T.; Rienties, Bart and Giesbers, Bas (2015). Understanding the Role of Time on Task in Formative Assessment: The Case of Mathematics Learning. In: Ras, Eric and Joosten-ten Brinke, Desiree eds. Computer Assisted Assessment. Research into E-Assessment. Communications in Computer and Information Science, 571. Heidelberg: Springer, pp. 120–133.

DOI: https://doi.org/10.1007/978-3-319-27704-2_12

Abstract

Mastery data derived from formative assessments constitute a rich data set in the development of student performance prediction models. The dominance of formative assessment mastery data over use intensity data such as time on task or number of clicks was the outcome of previous research by the authors in a dispositional learning analytics context. Practical implications of these findings are far reaching, contradicting current practices of developing (learning analytics based) student performance prediction models based on intensity data as central predictor variables. In this empirical follow-up study using data of 2011 students, we search for an explanation for time on task data being dominated by mastery data. We do so by investigating more general models, allowing for nonlinear, even non-monotonic, relationships between time on task and performance measures. Clustering students into subsamples, with different time on task characteristics, suggests heterogeneity of the sample to be an important cause of the nonlinear relationships with performance measures. Time on task data appear to be more sensitive to the effects of heterogeneity than mastery data, providing a further argument to prioritize formative assessment mastery data as predictor variables in the design of prediction models directed at the generation of learning feedback.

Viewing alternatives

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

  • Item ORO ID
  • 45050
  • Item Type
  • Book Section
  • ISBN
  • 3-319-27703-0, 978-3-319-27703-5
  • ISSN
  • 1865-0929
  • Extra Information
  • Proceedings of the 18th International Conference, CAA 2015, Zeist, The Netherlands, June 22–23, 2015.
  • Keywords
  • formative assessment; computer assisted assessment; dispositional learning analytics; blended learning; e-tutorials; student profiles
  • Academic Unit or School
  • Institute of Educational Technology (IET)
  • Copyright Holders
  • © 2015 Springer International Publishing
  • Depositing User
  • Bart Rienties

Recommendations