The Open UniversitySkip to content

The effectiveness of t-way test data generation

Ellims, Mike; Ince, Darrel and Petre, Marian (2008). The effectiveness of t-way test data generation. In: Computer Safety, Reliability, and Security: 27th International Conference, SAFECOMP 2008, Newcastle upon Tyne, UK, 22-25 Sep 2008, Berlin.

Full text available as:
Full text not publicly available (Version of Record)
Due to publisher licensing restrictions, this file is not available for public download
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This paper reports the results of a study comparing the effectiveness of automatically generated tests constructed using random and t-way combinatorial techniques on safety related industrial code using mutation adequacy criteria. A reference point is provided by hand generated test vectors constructed during development to establish minimum acceptance criteria. The study shows that 2-way testing is not adequate measured by mutants kill rate compared with hand generated test set of similar size, but that higher factor t-way test sets can perform at least as well. To reduce the computation overhead of testing large numbers of vectors over large numbers of mutants a staged optimising approach to applying t-way tests is proposed and evaluated which shows improvements in execution time and final test set size.

Item Type: Conference or Workshop Item
Copyright Holders: 2008 Springer-Verlag
ISSN: 0302-9743
Extra Information: In Lecture Notes in Computer Science, vol.5219/2008, pp.16-29
Keywords: Software testing; random testing; automated test generation; unit test; combinatorial design; pairwise testing; t-way testing; mutation
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 24640
Depositing User: Catherine McNulty
Date Deposited: 11 Nov 2010 09:09
Last Modified: 07 Dec 2018 20:04
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU