Establishing a physics concept inventory using computer marked free-response questions

Parker, Mark; Hedgeland, Holly; Jordan, Sally and Braithwaite, N St.J (2022). Establishing a physics concept inventory using computer marked free-response questions. European Journal of Science and Mathematics Education, 11(2) pp. 360–375.

DOI: https://doi.org/10.30935/scimath/12680

Abstract

The study covers the development and testing of the alternative mechanics survey (AMS), a modified force concept inventory (FCI), which used automatically marked free-response questions. Data were collected over a period of three academic years from 611 participants who were taking physics classes at high school and university level. A total of 8,091 question responses were gathered to develop and test the AMS. The AMS questions were tested for reliability using classical test theory (CTT). The AMS computer marking rules were tested for
reliability using inter-rater reliability (IRR). Findings from the CTT and IRR studies demonstrated that the AMS questions and marking rules were overall reliable. Therefore, the AMS was established as a physics concept inventory which uses automatically-marked, free-response
questions. The approach used to develop and test the AMS could be used in further attempts to develop concept inventories which make use of automatically-marked, free-response questions.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI