Parameters driving effectiveness of automated essay scoring with LSA

Wild, Fridolin; Stahl, Christina; Stermsek, Gerald and Neumann, Gustaf (2005). Parameters driving effectiveness of automated essay scoring with LSA. In: Proceedings of the 9th Conference on Computer Assisted Assessment (CAA), 5-6 Jul 2005, Loughborough, Loughborough University.

URL: https://repository.lboro.ac.uk/articles/Parameters...

Abstract

Automated essay scoring with latent semantic analysis (LSA) has recently been subject to increasing interest. Although previous authors have achieved grade ranges similar to those awarded by humans, it is still not clear which and how parameters improve or decrease the effectiveness of LSA. This pa-per presents an analysis of the effects of these parameters, such as text pre-processing, weighting, singular value dimensionality and type of similarity measure, and benchmarks this effectiveness by comparing machine-assigned with human-assigned scores in a real-world case. We show that each of the identified factors significantly influences the quality of automated essay scoring and that the factors are not independent of each other.

Viewing alternatives

Item Actions

Export

You can export this page using these formats

About

• Item ORO ID
• 73125
• Item Type
• Conference or Workshop Item
• Keywords
• Intelligent tutoring; essay ecoring, Latent Semantic Analysis; LSA
• Academic Unit or School
• Institute of Educational Technology (IET)
• Research Group
• Performance Augmentation Lab (PAL)
• Copyright Holders
• © 2005 Loughborough University
• Depositing User
• Fridolin Wild