A novel sEMG-based dynamic hand gesture recognition approach via residual attention network

Liu, Yanhong; Li, Xingyu; Yu, Hongnian; Yang, Lei

Abstract

With the emergence of more and more lightweight, convenient and cheap surface electromyography signal (sEMG) snsors, gesture recognition based on sEMG sensors has attracted much attention of researchers. In this study, combined with the sEMG sensor, a novel dynamic hand gesture recognition approach is proposed for effective and accurate dynamic gesture prediction. Here, a portable sEMG sensor (Myo wristband) is adopted to acquire the multi-channel sEMG signals of dynamic hand gestures and the continuous wavelet transformation (CWT) is proposed for data preprocessing to acquire the time-frequency maps. Due to the success of powerful contextual feature representation capability of deep convolutional neural networks (DCNNs), a deep residual attention network is proposed for accurate prediction of time-frequency maps. To effectively extract the key spatial and channel features from multi-channel sEMG signals, a residual attention network is proposed to act as the backbone network for effective feature representation. Besides, In the proposed recognition network, a multi-scale feature enhancement (MFE) module and an attention fusion block (AFB) are proposed, which respectively improve the multi-scale expression ability of the network and effectively realize multi-scale feature enhancement, respectively. Experimental results show that the proposed recognition network could achieve a superior detection ability compared with other state-of-the-art recognition models. The source code and dataset are available at https://github.com/lyangucas92/Ges_Net.

Citation

Liu, Y., Li, X., Yu, H., & Yang, L. (2024). A novel sEMG-based dynamic hand gesture recognition approach via residual attention network. Multimedia Tools and Applications, 83, 9329–9349. https://doi.org/10.1007/s11042-023-15748-5

• Journal Article Type: Article
• Acceptance Date: Apr 25, 2023
• Online Publication Date: Jun 17, 2023
• Publication Date: 2024
• Deposit Date: Jul 13, 2023
• Journal: Multimedia Tools and Applications
• Print ISSN: 1380-7501
• Electronic ISSN: 1573-7721
• Publisher: Springer
• Peer Reviewed: Peer Reviewed
• Volume: 83
• Pages: 9329–9349
• DOI: https://doi.org/10.1007/s11042-023-15748-5
• Keywords: Hand gesture recognition, Wearable sensor, Residual network, Feature attention, Feature fusion
• Public URL: http://researchrepository.napier.ac.uk/Output/3144287