The Open UniversitySkip to content
 

On the probability of making Type I errors

Pollard, P. and Richardson, J. T. (1987). On the probability of making Type I errors. Psychological Bulletin, 102(1) pp. 159–163.

Google Scholar: Look up in Google Scholar

Abstract

A statistical test leads to a Type I error whenever it leads to the rejection of a null hypothesis that is in fact true. The probability of making a Type I error can be characterized in the following three ways: the conditional prior probability (the probability of making a Type I error whenever a true null hypothesis is tested), the overall prior probability (the probability of making a Type I error across all experiments), and the conditional posterior probability (the probability of having made a Type I error in situations in which the null hypothesis is rejected). In this article, we show (a) that the alpha level can be equated with the first of these and (b) that it provides an upper bound for the second but (c) that it does not provide an estimate of the third, although it is commonly assumed to do so. We trace the source of this erroneous assumption first to statistical texts used by psychologists, which are generally ambiguous about which of the three interpretations is intended at any point in their discussions of Type I errors and which typically confound the conditional prior and posterior probabilities. Underlying this, however, is a more general fallacy in reasoning about probabilities, and we suggest that this may be the result of erroneous inferences about probabilistic conditional statements. Finally, we consider the possibility of estimating the (posterior) probability of a Type I error in situations in which the null hypothesis is rejected and, hence, the proportion of statistically significant results that may be Type I errors. © 1987 American Psychological Association.

Item Type: Journal Item
ISSN: 0033-2909
Academic Unit/School: Learning and Teaching Innovation (LTI) > Institute of Educational Technology (IET)
Learning and Teaching Innovation (LTI)
Research Group: Centre for Research in Education and Educational Technology (CREET)
Related URLs:
Item ID: 49906
Depositing User: John T. E. Richardson
Date Deposited: 29 Jun 2017 14:31
Last Modified: 07 Dec 2018 10:53
URI: http://oro.open.ac.uk/id/eprint/49906
Share this page:

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU