RF sensing enabled tracking of human facial expressions using machine learning algorithms

Hameed, Hira; Elsayed, Mostafa; Kaur, Jaspreet; Usman, Muhammad; Tang, Chong; Ghadban, Nour; Kernec, Julien Le; Hussain, Amir; Imran, Muhammad; Abbasi, Qammer H.

Abstract

Automatic analysis of facial expressions has emerged as a prominent research area in the past decade. Facial expressions serve as crucial indicators for understanding human behavior, enabling the identification and assessment of positive and negative emotions. Moreover, facial expressions provide insights into various aspects of mental activities, social connections, and physiological information. Currently, most facial expression detection systems rely on cameras and wearable devices. However, these methods have drawbacks, including privacy concerns, issues with poor lighting and line of sight blockage, difficulties in training with longer video sequences, computational complexities, and disruptions to daily routines. To address these challenges, this study proposes a novel and privacy-preserving human behavior recognition system that utilizes Frequency Modulated Continuous Wave (FMCW) radar combined with Machine Learning (ML) techniques for classifying facial expressions. Specifically, the study focuses on five common facial expressions: Happy, Sad, Fear, Surprise, and Neutral. The recorded data is obtained in the form of a Micro-Doppler signal, and state-of-the-art ML models such as Super Learner, Linear Discriminant Analysis, Random Forest, K-Nearest Neighbor, Long Short-Term Memory, and Logistic Regression are employed to extract relevant features. These extracted features from the radar data are then fed into ML models for classification. The results show a highly promising classification accuracy of 91%. The future applications of the proposed work will lead to advancements in technology, healthcare, security, and communication, thereby improving overall human well-being and societal functioning.

Citation

Hameed, H., Elsayed, M., Kaur, J., Usman, M., Tang, C., Ghadban, N., Kernec, J. L., Hussain, A., Imran, M., & Abbasi, Q. H. (2024). RF sensing enabled tracking of human facial expressions using machine learning algorithms. Scientific Reports, 14(1), Article 27800. https://doi.org/10.1038/s41598-024-75909-w

• Journal Article Type: Article
• Acceptance Date: Oct 9, 2024
• Online Publication Date: Nov 13, 2024
• Publication Date: 2024
• Deposit Date: Nov 18, 2024
• Publicly Available Date: Nov 18, 2024
• Journal: Scientific Reports
• Electronic ISSN: 2045-2322
• Publisher: Nature Publishing Group
• Peer Reviewed: Peer Reviewed
• Volume: 14
• Issue: 1
• Article Number: 27800
• DOI: https://doi.org/10.1038/s41598-024-75909-w