The Open UniversitySkip to content

Towards a software evolution benchmark

Demeyer, Serge; Mens, Tom and Wermelinger, Michel (2001). Towards a software evolution benchmark. In: IWPSE '01 Proceedings of the 4th International Workshop on Principles of Software Evolution, ACM, pp. 174–177.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (28kB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


Case-studies are extremely popular in rapidly evolving research disciplines such as software engineering because they allow for a quick but fair assessment of new techniques. Unfortunately, a proper experimental set-up is rarely the case: all too often case-studies are based on a single small toy-example chosen to favour the technique under study. Such lack of scientific rigor prevents fair evaluation and has disastrous consequences for the credibility of our field. In this paper, we propose to use a representative set of cases as a benchmark for comparing various techniques dealing with software evolution. We hope that this proposal will launch a consensus building process that eventually must lead to a scientifically sound validation method for researchers investigating reverse- and reengineering techniques.

Item Type: Conference or Workshop Item
Copyright Holders: 2001 ACM
ISBN: 1-58113-508-4, 978-1-58113-508-4
Keywords: software evolution; empirical survey; case studies; benchmark
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 41194
Depositing User: Michel Wermelinger
Date Deposited: 29 Oct 2014 15:42
Last Modified: 07 Dec 2018 16:31
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU