A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment

Liu, Qi; Wu, Xueyan; Jiang, Yinghang; Liu, Xiaodong; Zhang, Yonghong; Xu, Xiaolong; Qi, Lianyong

Abstract

Stroke is one of the leading causes of death and disability in the world. The rehabilitation of Patients' limb functions has great medical value, for example, the therapy of functional electrical stimulation (FES) systems, but suffers from effective rehabilitation evaluation. In this paper, six gestures of upper limb rehabilitation were monitored and collected using microelectromechanical systems sensors, where data stability was guaranteed using data preprocessing methods, that is, deweighting, interpolation, and feature extraction. A fully connected neural network has been proposed investigating the effects of different hidden layers, and determining its activation functions and optimizers. Experiments have depicted that a three‐hidden‐layer model with a softmax function and an adaptive gradient descent optimizer can reach an average gesture recognition rate of 97.19%. A stop mechanism has been used via recognition of dangerous gesture to ensure the safety of the system, and the lightweight cryptography has been used via hash to ensure the security of the system. Comparison to the classification models, for example, k‐nearest neighbor, logistic regression, and other random gradient descent algorithms, was conducted to verify the outperformance in recognition of upper limb gesture data. This study also provides an approach to creating health profiles based on large‐scale rehabilitation data and therefore consequent diagnosis of the effects of FES rehabilitation.

Citation

Liu, Q., Wu, X., Jiang, Y., Liu, X., Zhang, Y., Xu, X., & Qi, L. (2021). A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment. International Journal of Intelligent Systems, 36(5), 2387-2411. https://doi.org/10.1002/int.22383

• Journal Article Type: Article
• Acceptance Date: Jan 30, 2021
• Online Publication Date: Feb 16, 2021
• Publication Date: 2021-05
• Deposit Date: Mar 4, 2021
• Publicly Available Date: Feb 17, 2022
• Journal: International Journal of Intelligent Systems
• Print ISSN: 0884-8173
• Electronic ISSN: 1098-111X
• Publisher: Wiley
• Peer Reviewed: Peer Reviewed
• Volume: 36
• Issue: 5
• Pages: 2387-2411
• DOI: https://doi.org/10.1002/int.22383
• Keywords: fully connected neural network; functional electrical stimulation; gesture recognition; multisensor fusion; security and safety; upper limb rehabilitation
• Public URL: http://researchrepository.napier.ac.uk/Output/2749385
• Publisher URL: https://onlinelibrary.wiley.com/doi/full/10.1002/int.22383?af=R