Human-Sound Interaction: Towards a Human-Centred Sonic Interaction Design approach

Donato, Balandino Di; Dewey, Christopher; Michailidis, Tychonas

Abstract

In this paper, we explore human-centered interaction design aspects that determine the realisation and appreciation of musical works (installations, composition and performance), interfaces for sound design and musical expression, augmented instruments, sonic aspects of virtual environments and interactive audiovisual performances. In this first work, with the human at the centre of the design, we started sketching modes of interaction with sound that could result direct, engaging, natural and embodied in a collaborative, interactive, inclusive and diverse music environment. We define this as Human-Sound Interaction (HSI). To facilitate the exploration of HSIs, we prototyped SoundSculpt, a cross-modal audio, holographic projection and mid-air haptic feedback system. During an informal half-day workshop, we observed that HSIs through SoundSculpt have the potential to foster new ways of interaction with sound and to make them accessible to diverse musicians, sound artists and audience.

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: MOCO '20: 7th International Conference on Movement and Computing
• Start Date: Jul 15, 2020
• End Date: Jul 17, 2020
• Acceptance Date: May 22, 2020
• Online Publication Date: Jul 15, 2020
• Publication Date: Jul 15, 2020
• Deposit Date: Aug 9, 2021
• Publisher: Association for Computing Machinery (ACM)
• Book Title: MOCO '20: Proceedings of the 7th International Conference on Movement and Computing
• ISBN: 978-1-4503-7505-4
• DOI: https://doi.org/10.1145/3401956.3404233
• Keywords: Sonic Interaction Design, Interactive Machine Learning, Gestural Interaction
• Public URL: http://researchrepository.napier.ac.uk/Output/2791903
• Publisher URL: https://dl.acm.org/doi/10.1145/3401956.3404233