The Open UniversitySkip to content

Measuring the academic skills of university students: evaluation of a diagnostic procedure

Erling, Elizabeth J. and Richardson, John T. E. (2010). Measuring the academic skills of university students: evaluation of a diagnostic procedure. Assessing Writing, 15(3) pp. 177–193.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Measuring the Academic Skills of University Students is a procedure developed in the 1990s at the University of Sydney's Language Centre to identify students in need of academic writing development by assessing examples of their written work against five criteria. This paper reviews the literature relating to the development of the procedure with a focus on studies exploring its reliability and validity. It then describes a study in which teams of language experts and subject experts used the procedure to rate assignments produced by students taking three distance-learning courses. This study provides further insight into the psychometric properties of the procedure: the overall ratings had satisfactory internal consistency and test–retest reliability and were highly correlated with the marks awarded to the assignments analyzed. However, the ratings were also highly correlated with each other and yielded just one principal component, suggesting that even skilled assessors were unable to differentiate between different aspects of academic writing. We therefore conclude that the procedure is a reliable and valid means of identifying students who need writing skills development but that it should not be relied on to identify their particular areas of weakness.

Item Type: Journal Item
Copyright Holders: 2010 Elsevier Ltd
ISSN: 1075-2935
Keywords: academic language skills; academic literacy; academic writing; distance education; measuring the academic skills of university students; university students
Academic Unit/School: Faculty of Wellbeing, Education and Language Studies (WELS) > Education, Childhood, Youth and Sport
Faculty of Wellbeing, Education and Language Studies (WELS)
Institute of Educational Technology (IET)
Research Group: Centre for Research in Education and Educational Technology (CREET)
Education Futures
Innovation, Knowledge & Development research centre (IKD)
Item ID: 23297
Depositing User: Elizabeth Erling
Date Deposited: 04 Oct 2010 13:29
Last Modified: 13 Dec 2019 08:56
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU