The Sound of Paintings: Using Citizen Curation to Explore the Cross-Modal Personalization of Museum Experiences

Mulholland, Paul; Stoneman, Adam; Barker, Naomi; Maguire, Mark; Carvalho, Jason; Daga, Enrico and Warren, Paul (2023). The Sound of Paintings: Using Citizen Curation to Explore the Cross-Modal Personalization of Museum Experiences. In: UMAP '23 Adjunct: Adjunct Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization, ACM, pp. 408–418.

DOI: https://doi.org/10.1145/3563359.3596662

Abstract

This paper describes the use of Citizen Curation to explore ways in which cross-modal experiences can be used and created by museum visitors. Citizen Curation can be defined as individuals and groups from outside the museum profession engaging in curatorial activities to communicate their own ideas and stories. Previous work has explored how Citizen Curation can be used to broaden the range of voices reflected in the museum, thereby widening its appeal and relevance to new audiences. Recent research suggests that cross-modal experiences, combining visual art with music, can enhance the cultural experience as the visitor simultaneously draws on both what they see and hear. Citizen Curation provides a potential method through which visitors can create and share cross-modal experiences for each other, combining visual art and music. In this paper, we introduce the Deep Viewpoints web ap- plication that has previously been used for the Citizen Curation of looking at visual art. We then describe how the application was extended to support two further contexts (i) a musicologist curating experiences that link music to visual art in a museum collection, and (ii) visitors to a museum exhibition experiencing and creating cross-modal experiences. Finally, we reflect on different ways in which technology could be used to support cross-modal museum experiences.

Viewing alternatives

Download history

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About