The Open UniversitySkip to content

Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers

Calikli, Gul; Bener, Ayse; Aytac, Turgay and Bozcan, Ovunc (2013). Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers. In: Empirical Software Engineering and Measurement, 2013 ACM / IEEE International Symposium on, IEEE, pp. 363–372.

Full text available as:
PDF (Version of Record) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (603kB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


The goal of software metrics is the identification and measurement of the essential parameters that affect software development. Metrics can be used to improve software quality and productivity. Existing metrics in the literature are mostly product or process related. However, thought processes of people have a significant impact on software quality as software is designed, implemented and tested by people. Therefore, in defining new metrics, we need to take into account human cognitive aspects. Our research aims to address this need through the proposal of a new metric scheme to quantify a specific human cognitive aspect, namely "confirmation bias". In our previous research, in order to quantify confirmation bias, we defined a methodology to measure confirmation biases of people. In this research, we propose a metric suite that would be used by practitioners during daily decision making. Our proposed metric set consists of six metrics with a theoretical basis in cognitive psychology and measurement theory. Empirical sample of these metrics are collected from two software companies that are specialized in two different domains in order to demonstrate their feasibility. We suggest ways in which practitioners may use these metrics to improve software development process.

Item Type: Conference or Workshop Item
Copyright Holders: 2013 IEEE
ISBN: 0-7695-5056-8, 978-0-7695-5056-5
ISSN: 1938-6451
Keywords: decision making; program testing; software metrics; software quality; software psychology; confirmation bias; metrics
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 45345
Depositing User: Gul Calikli
Date Deposited: 18 Feb 2016 11:36
Last Modified: 11 Jun 2020 21:57
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU