The Open UniversitySkip to content

What can the language of musicians tell us about music interaction design?

Wilkie, Katie; Holland, Simon and Mulholland, Paul (2010). What can the language of musicians tell us about music interaction design? Computer Music Journal, 34(4) pp. 34–48.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB) | Preview
DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


It is difficult to create good interaction designs for music software or to substantially improve existing designs. One reason is that music involves diverse and complex concepts, entities, relationships, processes, terminologies, and notations. An open challenge for interaction designers is to find systematic ways of channeling the tacit, specialized knowledge of musicians into designs for intuitive user interfaces that can capably support musically skilled users, without excluding those with less technical musical knowledge. One promising new approach to this challenge involves the application of research from the theory of image schemas and conceptual metaphors This theory has already been applied with some success to analyzing musical concepts, mathematical concepts, general-purpose user-interface design, and sound-generation interaction designs involving simple musical parameters such as tempo, volume, and pitch. We propose that by identifying the conceptual metaphors and image schemas used by musical experts when analyzing an excerpt of music, and then assessing the extent to which these conceptual metaphors are supported by existing music-interaction designs, it is possible to identify areas where the designs do not match musicians’ understanding of the domain concepts. This process provides a principled basis for identifying points at which designs could be improved to better support musicians’ understanding and tasks, and for the provisional identification of possible improvements. We present the results of an analysis of dialogue between three musicians as they discuss an excerpt of music. A methodology for the systematic identification of image schemas and conceptual metaphors is detailed. We report on the use of the results of the dialogue analysis to illuminate the designs of two contrasting examples of music software. Areas in which the designs might be made more intuitive are identified, and corresponding suggestions for improvements are outlined.
The present research appears to be the first to investigate the potential of conceptual metaphor theory for investigating and improving music-interaction designs that deal with complex musical concepts, such as harmonic progressions, modulation, and voice leading.

Item Type: Journal Item
Copyright Holders: 2010 Massachusetts Institute of Technology
ISSN: 1531-5169
Keywords: human computer interaction; music; computer music; music computing; interaction design; conceptual metaphor; embodiment
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Research Group: Centre for Research in Computing (CRC)
Related URLs:
Item ID: 27387
Depositing User: Simon Holland
Date Deposited: 27 Jan 2011 15:39
Last Modified: 07 Dec 2018 12:49
Share this page:


Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU