Sense-O-Nary: Exploring Children's Crossmodal Metaphors Through Playful Crossmodal Interactions

2024. Tegan Roberts-Morgan, Brooke Morris, Elaine Czech, Suhan Neema, Abigale Stangl, Kyle Keane, Matthew Horton, Janet Read & Oussama Metatla
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference.

Abstract

Metaphors enrich language by allowing us to express complex ideas through familiar concepts, enhancing both understanding and creativity in communication. Crossmodal metaphors are metaphors where one sensory modality is understood in terms of another (e.g, a sharp smell). Crossmodality is an integral part of how we make sense of and create meaning about the world. However, there is a lack of research on how children generate crossmodal metaphors and the interpretation of such metaphors. We present Sense-O-Nary, a game we designed to explore how children react when asked to create crossmodal metaphors in a novel environment. Children are presented with one sensory input and then asked to describe it using a different sense, for another team to guess what the original sensory input is. We engaged children (n=65, aged 8-10) to play this crossmodal metaphor generation game. We qualitatively analysed children’s exchange of crossmodal metaphors to define a set of crossmodal association strategies and then use this to categorise the metaphors they created. We discuss how engaging with crossmodal metaphors can enhance children’s linguistic development and how our findings can inform the design of interactions that involve multiple senses.

Read the full paper here ›