The Open UniversitySkip to content
 

Measuring the academic skills of university students: evaluation of a diagnostic procedure

Erling, Elizabeth J. and Richardson, John T. E. (2010). Measuring the academic skills of university students: evaluation of a diagnostic procedure. Assessing Writing, 15(3) pp. 177–193.

DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1016/j.asw.2010.08.002
Google Scholar: Look up in Google Scholar

Abstract

Measuring the Academic Skills of University Students is a procedure developed in the 1990s at the University of Sydney's Language Centre to identify students in need of academic writing development by assessing examples of their written work against five criteria. This paper reviews the literature relating to the development of the procedure with a focus on studies exploring its reliability and validity. It then describes a study in which teams of language experts and subject experts used the procedure to rate assignments produced by students taking three distance-learning courses. This study provides further insight into the psychometric properties of the procedure: the overall ratings had satisfactory internal consistency and test–retest reliability and were highly correlated with the marks awarded to the assignments analyzed. However, the ratings were also highly correlated with each other and yielded just one principal component, suggesting that even skilled assessors were unable to differentiate between different aspects of academic writing. We therefore conclude that the procedure is a reliable and valid means of identifying students who need writing skills development but that it should not be relied on to identify their particular areas of weakness.

Item Type: Journal Article
Copyright Holders: 2010 Elsevier Ltd
ISSN: 1075-2935
Keywords: academic language skills; academic literacy; academic writing; distance education; measuring the academic skills of university students; university students
Academic Unit/Department: Education and Language Studies > Education
Institute of Educational Technology
Interdisciplinary Research Centre: Centre for Research in Education and Educational Technology (CREET)
Item ID: 23297
Depositing User: Elizabeth Erling
Date Deposited: 04 Oct 2010 13:29
Last Modified: 25 Oct 2012 14:48
URI: http://oro.open.ac.uk/id/eprint/23297
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk