Augoustinos Tsiros
The Effectiveness of Two Audiovisual Mappings to Control a Concatenative Synthesiser
Tsiros, Augoustinos; Lepl�tre, Gr�gory
Authors
Gr�gory Lepl�tre
Contributors
Tapio Lokki
Editor
Jukka P�tynen
Editor
Vesa V�lim�ki
Editor
Abstract
This paper presents the results of an investigation into audio visual (AV) correspondences conducted as part of the development of Morpheme, a painting interface to control a corpus-based concatenative sound synthesiser. Our goal was to measure the effects of the corpora on the effectiveness of the AV mappings used by Morpheme to synthesise sounds from images. Two mapping strategies and four corpora were empirically evaluated by 110 participants. To test the effectiveness of the mappings, sounds were generated using Morpheme from images designed to exhibit specific properties. The sounds were then played to the participants of the study and for each sound, they were presented with three images: the image used to synthesise the sound and two similar distractor images. Participants were asked to identify the correct source image and rate their level of confidence. The results show that the audio corpus used to synthesise the audio stimuli had a significant effect on the subjects' ability to identify the correct image while the mapping didn't. No effect of musical/sound training was observed.
Citation
Tsiros, A., & Leplâtre, G. (2017, July). The Effectiveness of Two Audiovisual Mappings to Control a Concatenative Synthesiser. Presented at Sound and Music Computing 2017
Presentation Conference Type | Conference Paper (Published) |
---|---|
Conference Name | Sound and Music Computing 2017 |
Start Date | Jul 5, 2017 |
End Date | Jul 8, 2017 |
Acceptance Date | Apr 28, 2017 |
Publication Date | Jul 5, 2017 |
Deposit Date | Mar 21, 2018 |
Publicly Available Date | Mar 22, 2018 |
Pages | 320-327 |
Series ISSN | 2518-3672 |
Book Title | Proceedings of the 14th Sound and Music Computing Conference 2017 |
ISBN | 9789526037295 |
Keywords | Audio visual; Morpheme; music; sound synthesiser. |
Public URL | http://researchrepository.napier.ac.uk/Output/1129825 |
Contract Date | Mar 21, 2018 |
Files
The Effectiveness of Two Audiovisual Mappings to Control a Concatenative Synthesiser
(357 Kb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/3.0/
Copyright Statement
Copyright: © 2017 First author et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License 3.0 Unported, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and sourceare credited.
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search