The Open UniversitySkip to content
 

Progress and Challenges for Automated Scoring and Feedback Systems for Large-Scale Assessments

Whitelock, Denise and Bektik, Duygu (2018). Progress and Challenges for Automated Scoring and Feedback Systems for Large-Scale Assessments. In: Voogt, J.; Knezek, G.; Christensen, R. and Lai, K. W. eds. Second Handbook of Information Technology in Primary and Secondary Education. Springer International Handbooks of Education.

URL: https://link.springer.com/referenceworkentry/10.10...
DOI (Digital Object Identifier) Link: https://doi.org/10.1007/978-3-319-53803-7_39-1
Google Scholar: Look up in Google Scholar

Abstract

Large-scale assessment refers to tests that are administered to large numbers of students and are used at local, state, and national levels to measure the progress of schools with respect to educational standards. In order to have accurate and fair measurements, large-scale assessment systems need to include all available students, which means a high volume of students, with large numbers of exams to be marked. The amount of marking that is required is extensive; thus marking exams at this scale requires a lot of work, which means a high volume of exam scripts need to be marked by tens of thousands of examiners appointed by the exam boards. The need for large-scale assessments and the high cost of manual marking and limited “turn around” time have led to developments, over some years, of automated assessment and marking. This chapter reviews the history and development of automated assessment systems. It includes findings from empirical research as well as highlights the theoretical considerations that emerge from such developments. In addition, the practical aspects of developing such assessments are explored with examples primarily from the UK and USA, including the systems and tools available, the current capabilities of natural language processing (NLP) approaches, and their limitations, ethical concerns, and future potential.

Item Type: Book Section
ISBN: 3-319-53803-9, 978-3-319-53803-7
Academic Unit/School: Faculty of Wellbeing, Education and Language Studies (WELS)
Research Group: OpenTEL
Item ID: 53424
Depositing User: Duygu Bektik
Date Deposited: 13 Feb 2018 12:25
Last Modified: 08 Mar 2019 15:23
URI: http://oro.open.ac.uk/id/eprint/53424
Share this page:

Metrics

Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU