Dr. Mandar Gogate M.Gogate@napier.ac.uk
Principal Research Fellow
Solving the cocktail party problem using Multi-modal Hearing Assistive Technology Prototype
Gogate, Mandar; Dashtipour, Kia; Hussain, Amir
Authors
Dr Kia Dashtipour K.Dashtipour@napier.ac.uk
Lecturer
Prof Amir Hussain A.Hussain@napier.ac.uk
Professor
Abstract
Hearing loss is a major global health problem, affecting over 1.5 billion people. According to estimations by the World Health Organization, 83% of those who could benefit from hearing assistive devices do not use them. The limited adoption of hearing aids can be attributed to the suboptimal performance in acoustically challenging environments, such as cocktail parties, where there are multiple competing speakers and noise sources leading to poor speech intelligibility for hearing impaired listeners. This work presents a first-of-its-kind real-time, multi-modal speech enhancement system that can effectively enhance speech in challenging real noisy environments. The system exploits both audio and visual cues to isolate the target speaker's voice from interfering background noises. The system is developed using deep neural networks and is integrated with the Open Master Hearing Aid (openMHA) platform. The integrated prototype was evaluated in a cocktail party setting to isolate the target speaker's voice from interfering speakers, music, and other non-speech noise sources and was able to significantly improve the speech intelligibility of hearing impaired listeners. This work has the potential to improve the quality of life for hearing impaired listeners by facilitating effective communication in cocktail party environments.
Citation
Gogate, M., Dashtipour, K., & Hussain, A. (2023, December). Solving the cocktail party problem using Multi-modal Hearing Assistive Technology Prototype. Presented at Acoustics 2023, Sydney, Australia
Presentation Conference Type | Conference Abstract |
---|---|
Conference Name | Acoustics 2023 |
Start Date | Dec 4, 2023 |
End Date | Dec 8, 2023 |
Online Publication Date | Oct 1, 2023 |
Publication Date | 2023 |
Deposit Date | May 21, 2024 |
Journal | The Journal of the Acoustical Society of America |
Print ISSN | 0001-4966 |
Publisher | Acoustical Society of America |
Peer Reviewed | Peer Reviewed |
Volume | 154 |
Issue | 4, suppl |
Pages | A36 |
DOI | https://doi.org/10.1121/10.0022719 |
You might also like
Synchronization of Monostatic Radar Using a Time-Delayed Chaos-Based FM Waveform
(2022)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search