The Open UniversitySkip to content
 

Why Predictions of At-Risk Students Are Not 100% Accurate? Showing Patterns in False Positive and False Negative Predictions

Hlosta, Martin; Zdrahal, Zdenek; Bayer, Vaclav and Herodotou, Christothea (2020). Why Predictions of At-Risk Students Are Not 100% Accurate? Showing Patterns in False Positive and False Negative Predictions. In: Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK20), 23-27 Mar 2020, Frankfurt am Main, Germany.

Google Scholar: Look up in Google Scholar

Abstract

Predictive modelling with the focus on identification of students at risk of failing has become one of the most prevalent topics in the Learning Analytics and Educational Data Mining. Most of the published work is focused on training the machine learning model that achieves the highest prediction performance, as measured by several metrics. Nevertheless, limited work focuses on the behaviour of the model and in particular, analysis of the errors the models make during predictions. This poster presents preliminary results that fill this gap by providing a methodology for finding the patterns of errors both for False Positives and False Negatives. We show results from the task of predicting students at risk of not submitting their first assignments on 48 first-year STEM courses, separately for False Positives and False Negatives. The erroneous predictions that are not possible to be explained will inform subsequent qualitative analysis i.e., interviews with students.

Item Type: Conference or Workshop Item
Keywords: Predictive Modelling; At-risk students; Error analysis; Higher Education
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Institute of Educational Technology (IET)
Item ID: 69150
Depositing User: Vaclav Bayer
Date Deposited: 12 Feb 2020 13:13
Last Modified: 12 Feb 2020 13:28
URI: http://oro.open.ac.uk/id/eprint/69150
Share this page:

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU