Jordan, Sally; Jordan, Helen and Jordan, Richard
(2011).
Same but different, but is it fair? An analysis of the use of variants of interactive computer-marked questions.
In: 2011 International Computer Assisted Assesment Conference, 5th-6th July 2011, Southampton.
Full text available as:
Abstract
Different variants of interactive computer-marked questions are used to reduce opportunities for plagiarism, and tools have been developed to indicate when variants are of significantly different difficulty. The paper includes an example of the tools in use and identifies factors that have been found to lead to variants of different difficulty. An investigation into the impact on students’ overall scores is then described, with the conclusion that, for most modules, the effect is very small (typically ±0.5%). Factors leading to a larger effect include: a larger number of individual questions with significantly different variant difficulty; a smaller number of interactive computer-marked questions; and a higher weighting of the e-assessment component. Monitoring the behaviour of variants can lead to improvements in the quality of individual questions, better assessment design and enhanced insight into students’ misunderstandings.
Actions (login may be required)