The Open UniversitySkip to content

Function in Engineering: Benchmarking Representations and Models

Summers, Joshua D.; Eckert, Claudia and Goel, Ashok (2017). Function in Engineering: Benchmarking Representations and Models. Artificial Intelligence for Engineering Design, Analysis and Manufacturing, 31(4) pp. 401–412.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (720kB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


This paper presents the requirements and needs for establishing a benchmarking protocol that considers representation characteristics, supported cognitive criteria, and enabled reasoning activities for the systematic comparison of function modeling representations. Problem types are defined as reverse engineering, familiar products, novel products, and single-component systems. As different modelling approaches share elements, a comparison of modelling approaches on multiple levels was also undertaken. It is recommended that researchers and developers of function modeling representations collaborate to define a canonically acceptable set of benchmark tests and evaluations so that clear benefits and weaknesses for the disparate collection of approaches can be compared. This paper is written as a call to action for the research community to begin establishing a benchmarking standard protocol for function modeling comparison purposes. This protocol should be refined with input from developers of the competing approaches in an academically open environment. At the same time the benchmarking criteria identified should also serve as a guide for validating a modelling approach or analyzing its failure.

Item Type: Journal Item
ISSN: 1469-1760
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Engineering and Innovation
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Design and Innovation
International Development & Inclusive Innovation
Item ID: 50442
Depositing User: Claudia Eckert
Date Deposited: 11 Aug 2017 13:19
Last Modified: 02 May 2019 11:38
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU