Sketching concatenative synthesis: audiovisual Isomorphism in reduced modes.

Abstract

This paper presents a prototype allowing the control of a
concatenative synthesis algorithm using a 2D sketching
interface. The design of the system is underpinned by a
preliminary discussion in which isomorphisms between
auditory and visual phenomena are identified. We support
that certain qualities of sound and graphics are inherently
cross-modal. Following this reasoning, a mapping
strategy between low-level auditory and visual features
was developed. The mapping enables the selection of
audio units based on five feature data streams that derive
from the statistical analysis of the sketch

Citation

Tsiros, A., LePlâtre, G., & Smyth, M. (2012). Sketching concatenative synthesis: audiovisual Isomorphism in reduced modes. In 9th Sound and Music Computing Conference (409-507)

• Conference Name: 9th Sound and Music Computing Conference
• Start Date: Jul 11, 2012
• End Date: Jul 14, 2012
• Publication Date: 2012
• Deposit Date: Nov 2, 2012
• Publicly Available Date: Dec 31, 2012
• Peer Reviewed: Peer Reviewed
• Volume: 9
• Pages: 409-507
• Book Title: 9th Sound and Music Computing Conference
• Keywords: Concatenative synthesis algorithm; isomorphisms; 2D sketching interface
• Public URL: http://researchrepository.napier.ac.uk/id/eprint/5707
• Publisher URL: http://inplayground.files.wordpress.com/2012/09/sketching-concatenative-synthesis.pdf