The digital Foley: what Foley artists say about using audio synthesis

Di Donato, Balandino; McGregor, Iain

Abstract

Foley is a sound production technique where organicity and authenticity in sound creation are key to fostering creativity. Audio synthesis, Artificial Intelligence (AI) and Interaction Design (IXD) have been explored by the community to investigate their efficiency and versatility. This paper explores audio synthesis's current and potential use in Foley art practice. We opened an online survey answered by 56 Foley artists with a median of 10 years of experience from different industries (video games, and the remaining in advertisement, animation, radio audiobooks, live sound, music, podcast, documentary, audio drama, theatre, opera, VR, and research). Results from a thematic analysis reported that artists desired controllers for synthesising Foley with a focus on organic control, performance, and innovative ideas. Dissuading factors included the essence of Foley, sound synthesis complexity, and real object authenticity. Some Foley artists saw sound synthesis as complementary. The strengths of sound synthesis tools included creativity, speed, cost-effectiveness, and customisability. Suggestions to improve tools encompassed increased interactivity, teamwork, and continued exploration. Participants had diverse views on a potential combined Foley and synthesis tool, emphasising physical modelling, interaction design, and preserving craftsmanship.

Citation

Di Donato, B., & McGregor, I. (2024, April). The digital Foley: what Foley artists say about using audio synthesis. Presented at 2024 AES 6th International Conference on Audio for Games, Tokyo, Japan

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 2024 AES 6th International Conference on Audio for Games
• Start Date: Apr 27, 2024
• End Date: Apr 29, 2024
• Acceptance Date: Dec 17, 2023
• Online Publication Date: Apr 27, 2024
• Publication Date: 2024
• Deposit Date: Nov 20, 2023
• Publisher: Audio Engineering Society
• Peer Reviewed: Peer Reviewed
• Book Title: Proceedings of the 2024 AES 6th International Conference on Audio for Games
• Keywords: Foley, audio synthesis, Interaction Design, Artificial Intelligence, AI, IXD
• Public URL: http://researchrepository.napier.ac.uk/Output/3391220
• Publisher URL: https://www.aes.org/e-lib/browse.cfm?elib=22410