Measuring the academic skills of university students: evaluation of a diagnostic procedure

Erling, Elizabeth J. and Richardson, John T. E. (2010). Measuring the academic skills of university students: evaluation of a diagnostic procedure. Assessing Writing, 15(3) pp. 177–193.

DOI: https://doi.org/10.1016/j.asw.2010.08.002

Abstract

Measuring the Academic Skills of University Students is a procedure developed in the 1990s at the University of Sydney's Language Centre to identify students in need of academic writing development by assessing examples of their written work against five criteria. This paper reviews the literature relating to the development of the procedure with a focus on studies exploring its reliability and validity. It then describes a study in which teams of language experts and subject experts used the procedure to rate assignments produced by students taking three distance-learning courses. This study provides further insight into the psychometric properties of the procedure: the overall ratings had satisfactory internal consistency and test–retest reliability and were highly correlated with the marks awarded to the assignments analyzed. However, the ratings were also highly correlated with each other and yielded just one principal component, suggesting that even skilled assessors were unable to differentiate between different aspects of academic writing. We therefore conclude that the procedure is a reliable and valid means of identifying students who need writing skills development but that it should not be relied on to identify their particular areas of weakness.

Viewing alternatives

Look up in Google Scholar

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions
No digital document available to download for this item

Item Actions

Export

About

CORE (COnnecting REpositories)

Recommendations