The Open UniversitySkip to content

When often becomes always, and sometimes becomes never: miscomprehension in surveys

Hardy, Ben and Ford, Lucy (2012). When often becomes always, and sometimes becomes never: miscomprehension in surveys. In: Academy of Management Annual Meeting 2012, 3-7 Aug 2012, Boston, MA, US.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (62kB)
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Much of social science involves soliciting the opinions of others, often through the use of surveys. There are a number of different survey formats but a commonly used approach is to provide a stimulus question which is coupled to a limited number of response options. This approach has several benefits. First, the structured format presents the stimulus to each respondent in the same format, reducing inconsistency of stimulus presentation. Second, the standardized format of responses facilitates processing of responses. Third, surveys in this format act as a transduction point where the verbal stimulus of the question is converted to a numerical response through the allocation of ordinal values.

This paper examines miscomprehension and variance in interpretation of survey item through two empirical studies. We find considerable evidence that, whilst respondents understand survey items, they do not all do so in the same way. This variance in comprehension cannot readily be detected statistically, and yet is a significant threat to construct validity, casting doubt on whether the instruments are tapping into the same construct for all respondents.

Item Type: Conference or Workshop Item
Copyright Holders: 2012 Academy of Managment
Academic Unit/School: Faculty of Business and Law (FBL)
Related URLs:
Item ID: 31891
Depositing User: Ben Hardy
Date Deposited: 31 May 2012 15:40
Last Modified: 12 May 2018 19:16
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU