The Open UniversitySkip to content

Song walker harmony space: embodied interaction design for complex musical skills

Bouwer, Anders; Holland, Simon and Dalgleish, Mat (2013). Song walker harmony space: embodied interaction design for complex musical skills. In: Holland, Simon; Wilkie, Katie; Mulholland, Paul and Seago, Allan eds. Music and Human-Computer Interaction. Cultural Computing. London: Springer, pp. 207–221.

Full text available as:
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (3MB) | Preview
Google Scholar: Look up in Google Scholar


Tonal harmony is widely considered to be the most technical and complex part of music theory. Consequently harmonic skills can be hard to acquire. Furthermore, experience of the flexible manipulation of harmony in real time generally requires the ability to play an instrument. Even for those with instrumental skills, it can be difficult to gain clear insight into harmonic abstractions. The above state of affairs gives rise to substantial barriers not only for beginners but also for many experienced musicians. To address these problems, Harmony Space (Holland et al. 2009) is an interactive digital music system designed to give insight into a wide range of musical tasks in tonal harmony, ranging from performance and composition to analysis. Harmony Space employs a principled set of spatial mappings to offer fluid, precise, intuitive control of harmony. These mappings give rise to sensory-motor and music-theoretic affordances that are hard to obtain in any other way. As a result, harmonic abstractions are rendered amenable to concrete, visible control by simple spatial manipulation. In the language of conceptual metaphor theory, many relationships in tonal harmony become accessible to rapid, universal, low-level, robust human inference mechanisms using image schemata such as containment, contact, centre-periphery, and source-path-goal. This process is more rapid, and imposes far less cognitive load, than slow, abstract symbolic reasoning. Using the above principles, several versions of Harmony Space have been de-signed to exploit specific interaction styles for different purposes. We note some key variants, such as the desktop version (Holland 1994), the camera tracked version (Holland et al. 2009), while focusing principally on the most recent version, Song Walker (Holland et al. 2011), which employs whole body interaction. Preliminary results from a study of the Song Walker system are outlined, in which both beginners and expert musicians undertook a range of musical tasks involving the performance, composition and analysis of music. Finally, we offer a discussion of the limitations of the current system, and outline directions for future work

Item Type: Book Section
Copyright Holders: 2013 Springer
ISBN: 1-4471-2989-X, 978-1-4471-2989-9
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Item ID: 35073
Depositing User: Simon Holland
Date Deposited: 31 Oct 2012 10:48
Last Modified: 05 Mar 2019 08:18
Share this page:

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU