The Open UniversitySkip to content

Are we meeting a deadline? classification goal achievement in time in the presence of imbalanced data

Hlosta, Martin; Zdrahal, Zdenek and Zendulka, Jaroslav (2018). Are we meeting a deadline? classification goal achievement in time in the presence of imbalanced data. Knowledge-Based Systems, 160 pp. 278–295.

Full text available as:
PDF (Submitted Version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (761kB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This paper addresses the problem of a finite set of entities which are required to achieve a goal within a predefined deadline. For example, a group of students is supposed to submit a homework by a specified cutoff. Further, we are interested in predicting which entities will achieve the goal within the deadline. The predictive models are built based only on the data from that population. The predictions are computed at various time instants by taking into account updated data about the entities. The first contribution of the paper is a formal description of the problem. The important characteristic of the proposed method for model building is the use of the properties of entities that have already achieved the goal. We call such an approach “Self-Learning”. Since typically only a few entities have achieved the goal at the beginning and their number gradually grows, the problem is inherently imbalanced. To mitigate the curse of imbalance, we improved the Self-Learning method by tackling information loss and by several sampling techniques. The original Self-Learning and the modifications have been evaluated in a case study for predicting submission of the first assessment in distance higher education courses. The results show that the proposed improvements outperform the specified two base-line models and the original Self-Learner, and also that the best results are achieved if domain-driven techniques are utilised to tackle the imbalance problem. We also showed that these improvements are statistically significant using Wilcoxon signed rank test.

Item Type: Journal Item
Copyright Holders: 2018 Elsevier B.V.
ISSN: 0950-7051
Keywords: classification; imbalanced data; learning analytics; educational data mining
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 56292
Depositing User: Kay Dave
Date Deposited: 28 Aug 2018 09:24
Last Modified: 29 Jun 2020 18:22
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU