Towards a software evolution benchmark

Demeyer, Serge; Mens, Tom and Wermelinger, Michel (2001). Towards a software evolution benchmark. In: IWPSE '01 Proceedings of the 4th International Workshop on Principles of Software Evolution, ACM, pp. 174–177.

DOI: https://doi.org/10.1145/602461.602502

Abstract

Case-studies are extremely popular in rapidly evolving research disciplines such as software engineering because they allow for a quick but fair assessment of new techniques. Unfortunately, a proper experimental set-up is rarely the case: all too often case-studies are based on a single small toy-example chosen to favour the technique under study. Such lack of scientific rigor prevents fair evaluation and has disastrous consequences for the credibility of our field. In this paper, we propose to use a representative set of cases as a benchmark for comparing various techniques dealing with software evolution. We hope that this proposal will launch a consensus building process that eventually must lead to a scientifically sound validation method for researchers investigating reverse- and reengineering techniques.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI

About

• Item ORO ID
• 41194
• Item Type
• Conference or Workshop Item
• ISBN
• 1-58113-508-4, 978-1-58113-508-4
• Keywords
• software evolution; empirical survey; case studies; benchmark
• Academic Unit or School
• Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
  Faculty of Science, Technology, Engineering and Mathematics (STEM)
• Research Group
• Centre for Research in Computing (CRC)
• Copyright Holders
• © 2001 ACM
• Depositing User
• Michel Wermelinger