Moving Healthcare AI Support Systems for Visually Detectable Diseases to Constrained Devices

Watt, Tess; Chrysoulas, Christos; Barclay, Peter J.; El Boudani, Brahim; Kalliatakis, Grigorios

Abstract

Image classification usually requires connectivity and access to the cloud, which is often limited in many parts of the world, including hard-to-reach rural areas. Tiny machine learning (tinyML) aims to solve this problem by hosting artificial intelligence (AI) assistants on constrained devices, eliminating connectivity issues by processing data within the device itself, without Internet or cloud access. This study explores the use of tinyML to provide healthcare support with low-spec devices in low-connectivity environments, focusing on the diagnosis of skin diseases and the ethical use of AI assistants in a healthcare setting. To investigate this, images of skin lesions were used to train a model for classifying visually detectable diseases (VDDs). The model weights were then offloaded to a Raspberry Pi with a webcam attached, to be used for the classification of skin lesions without Internet access. It was found that the developed prototype achieved a test accuracy of 78% when trained on the HAM10000 dataset, and a test accuracy of 85% when trained on the ISIC 2020 Challenge dataset.

Citation

Watt, T., Chrysoulas, C., Barclay, P. J., El Boudani, B., & Kalliatakis, G. (2024). Moving Healthcare AI Support Systems for Visually Detectable Diseases to Constrained Devices. Applied Sciences, 14(24), Article 11474. https://doi.org/10.3390/app142411474

• Journal Article Type: Article
• Acceptance Date: Dec 4, 2024
• Online Publication Date: Dec 10, 2024
• Publication Date: 2024
• Deposit Date: Dec 17, 2024
• Publicly Available Date: Dec 17, 2024
• Journal: Applied Sciences
• Electronic ISSN: 2076-3417
• Publisher: MDPI
• Peer Reviewed: Peer Reviewed
• Volume: 14
• Issue: 24
• Article Number: 11474
• DOI: https://doi.org/10.3390/app142411474
• Keywords: tinyML; computing offloading; artificial intelligence; machine learning; computer vision; image classification