Evaluating an Automated Analysis using Machine Learning and Natural Language Processing Approaches to Classify Computer Science Students' Reflective Writing

Alrashidi, H.; Almujally, N.; Kadhum, M.; Ullmann, T. and Joy, M. (2022). Evaluating an Automated Analysis using Machine Learning and Natural Language Processing Approaches to Classify Computer Science Students' Reflective Writing. In: Pervasive Computing and Social Networking. Lecture Notes in Networks and Systems, vol 475 (Ranganathan, G.; Bestak, R. and Fernando, X. eds.), pp. 463–477.

DOI: https://doi.org/10.1007/978-981-19-2840-6_36

Abstract

Reflection writing is a common practice in higher education. However, manual analysis of written reflections is time-consuming. This study presents an automated analysis of reflective writing to analyze reflective writing in CS education based on conceptual Reflective Writing Framework (RWF) and application of natural language processing and machine learning algorithm. This paper investigates two groups of features extraction (n-grams and PoS n-grams) and random forest (RF) algorithm that utilize such features to detect the presence or absence of the seven indicators (description of an experience, understandings, feelings, reasoning, perspective, new learning, and future action). The automated analysis of reflective writing is evaluated based on 74 CS student essays (1113 sentences) that are from the final year project reports in CS’s students. Results showed the seven indicators can be reliably distinguished by their features and these indicators can be used in an automated reflective writing analysis for determining the level of students’ reflective writing. Finally, we consider the implications of how the conceptualization of refection quality and providing individualized learning support to students in order to help them develop reflective skills.

Viewing alternatives

Look up in Google Scholar

Download history

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

  • Item ORO ID
  • 82477
  • Item Type
  • Conference or Workshop Item
  • Keywords
  • Reflection Assessment; Machine Learning; Natural Language Processing; Reflective Writing; Refection; Computer Science education
  • Academic Unit or School
  • Institute of Educational Technology (IET)
  • Depositing User
  • Thomas Ullmann
CORE (COnnecting REpositories)

Recommendations