Ellims, Mike; Ince, Darrel and Petre, Marian
The effectiveness of t-way test data generation.
In: Computer Safety, Reliability, and Security: 27th International Conference, SAFECOMP 2008, Newcastle upon Tyne, UK, 22-25 September 2008, Berlin.
Full text available as:
Due to copyright restrictions, this file is not available for public download
This paper reports the results of a study comparing the effectiveness of automatically generated tests constructed using random and t-way combinatorial techniques on safety related industrial code using mutation adequacy criteria. A reference point is provided by hand generated test vectors constructed during development to establish minimum acceptance criteria. The study shows that 2-way testing is not adequate measured by mutants kill rate compared with hand generated test set of similar size, but that higher factor t-way test sets can perform at least as well. To reduce the computation overhead of testing large numbers of vectors over large numbers of mutants a staged optimising approach to applying t-way tests is proposed and evaluated which shows improvements in execution time and final test set size.
Actions (login may be required)