Image from the article: Work-in-progress musical scores created by two workshop participants (left); completed musical scores superimposed on the latent terrain (middle); workshop participants demonstrating their scores on the prototyped musical instrument (right).
Day/time: 13/11/2025 11am-12pm
Location: G2/Teams
Agenda
- Shuoyang’s presentation and Q&A (20’ presentation, 10’ Q&A)
- Round of updates (all, 25’)
Summary
Shuoyang presented his latest article from the Frontiers journal:
- Zheng SJ, Xambó Sedó A and Bryan-Kinns N (2025) Exploring gestural affordances in audio latent space navigation. Front. Comput. Sci. 7:1575202. doi: 10.3389/fcomp.2025.1575202
Abstract: The latent space of generative AI models affords unique creative possibilities and broad design space for AI-enhanced digital music instruments. While interface designs for latent space navigation typically rely on sound-producing gestures that involve bodily motions and movements, the underlying subjective perception of these gestures remains underexplored. To understand how musicians perceive sound-producing gestures and tailor performance techniques in audio latent space, we present a user study workshop with an AI-enhanced digital music instrument with a tablet interface. Eighteen musicians were recruited to test out open-ended gestures and tasked to create musical scores. We report how they use sound-producing gestures in the latent space and develop performance techniques. We contribute findings from an embodied music cognition perspective of how subjective perception of gestures shapes musicians’ technique development in audio latent space navigation. We discuss the implications of new gestural affordances discovered by participants in our workshop, aiming to elucidate new opportunities for digital musical instruments with audio latent space navigation.