1
|
Zhou Z, Tao Q, Su N, Liu J, Chen Q, Li B. Lower Limb Motion Recognition Based on sEMG and CNN-TL Fusion Model. SENSORS (BASEL, SWITZERLAND) 2024; 24:7087. [PMID: 39517984 PMCID: PMC11548092 DOI: 10.3390/s24217087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Revised: 10/22/2024] [Accepted: 10/30/2024] [Indexed: 11/16/2024]
Abstract
To enhance the classification accuracy of lower limb movements, a fusion recognition model integrating a surface electromyography (sEMG)-based convolutional neural network, transformer encoder, and long short-term memory network (CNN-Transformer-LSTM, CNN-TL) was proposed in this study. By combining these advanced techniques, significant improvements in movement classification were achieved. Firstly, sEMG data were collected from 20 subjects as they performed four distinct gait movements: walking upstairs, walking downstairs, walking on a level surface, and squatting. Subsequently, the gathered sEMG data underwent preprocessing, with features extracted from both the time domain and frequency domain. These features were then used as inputs for the machine learning recognition model. Finally, based on the preprocessed sEMG data, the CNN-TL lower limb action recognition model was constructed. The performance of CNN-TL was then compared with that of the CNN, LSTM, and SVM models. The results demonstrated that the accuracy of the CNN-TL model in lower limb action recognition was 3.76%, 5.92%, and 14.92% higher than that of the CNN-LSTM, CNN, and SVM models, respectively, thereby proving its superior classification performance. An effective scheme for improving lower limb motor function in rehabilitation and assistance devices was thus provided.
Collapse
Affiliation(s)
- Zhiwei Zhou
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
| | - Qing Tao
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
| | - Na Su
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
- The First Affiliated Hospital, Xinjiang Medical University, Urumqi 830017, China
| | - Jingxuan Liu
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
| | - Qingzheng Chen
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
| | - Bowen Li
- College of Intelligent Manufacturing Modern Industry, Xinjiang University, Urumqi 830017, China; (Z.Z.); (N.S.); (J.L.); (Q.C.); (B.L.)
| |
Collapse
|
2
|
Ahkami B, Ahmed K, Thesleff A, Hargrove L, Ortiz-Catalan M. Electromyography-Based Control of Lower Limb Prostheses: A Systematic Review. IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS 2023; 5:547-562. [PMID: 37655190 PMCID: PMC10470657 DOI: 10.1109/tmrb.2023.3282325] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Most amputations occur in lower limbs and despite improvements in prosthetic technology, no commercially available prosthetic leg uses electromyography (EMG) information as an input for control. Efforts to integrate EMG signals as part of the control strategy have increased in the last decade. In this systematic review, we summarize the research in the field of lower limb prosthetic control using EMG. Four different online databases were searched until June 2022: Web of Science, Scopus, PubMed, and Science Direct. We included articles that reported systems for controlling a prosthetic leg (with an ankle and/or knee actuator) by decoding gait intent using EMG signals alone or in combination with other sensors. A total of 1,331 papers were initially assessed and 121 were finally included in this systematic review. The literature showed that despite the burgeoning interest in research, controlling a leg prosthesis using EMG signals remains challenging. Specifically, regarding EMG signal quality and stability, electrode placement, prosthetic hardware, and control algorithms, all of which need to be more robust for everyday use. In the studies that were investigated, large variations were found between the control methodologies, type of research participant, recording protocols, assessments, and prosthetic hardware.
Collapse
Affiliation(s)
- Bahareh Ahkami
- Center for Bionics and Pain Research, 43130 Mölndal, Sweden, and also with the Department of Electrical Engineering, Chalmers University of Technology, 41296 Gothenburg, Sweden
| | - Kirstin Ahmed
- Center for Bionics and Pain Research, 43130 Mölndal, Sweden, and also with the Department of Electrical Engineering, Chalmers University of Technology, 41296 Gothenburg, Sweden
| | - Alexander Thesleff
- Center for Bionics and Pain Research, 43130 Mölndal, Sweden, also with the Department of Electrical Engineering, Chalmers University of Technology, 41296 Gothenburg, Sweden, and also with Integrum AB, 43153 Molndal, Sweden
| | - Levi Hargrove
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL 60611 USA, and also with the Regenstein Foundation Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL 60611 USA
| | - Max Ortiz-Catalan
- Center for Bionics and Pain Research, 43130 Mölndal, Sweden, also with the Department of Electrical Engineering, Chalmers University of Technology, 41296 Gothenburg, Sweden, also with the Operational Area 3, Sahlgrenska University Hospital, 41345 Gothenburg, Sweden, and also with Bionics Institute, Melbourne, VIC 3002, Australia
| |
Collapse
|
3
|
Wei C, Wang H, Hu F, Zhou B, Feng N, Lu Y, Tang H, Jia X. Single-channel surface electromyography signal classification with variational mode decomposition and entropy feature for lower limb movements recognition. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103487] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
4
|
Binary Particle Swarm Optimization-Based Feature Selection for Predicting the Class of the Knee Angle from EMG Signals in Lower Limb Movements. NEUROPHYSIOLOGY+ 2022. [DOI: 10.1007/s11062-022-09922-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
5
|
|
6
|
Qin P, Shi X. Evaluation of Feature Extraction and Classification for Lower Limb Motion Based on sEMG Signal. ENTROPY 2020; 22:e22080852. [PMID: 33286623 PMCID: PMC7517453 DOI: 10.3390/e22080852] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Revised: 07/29/2020] [Accepted: 07/30/2020] [Indexed: 12/12/2022]
Abstract
The real-time and accuracy of motion classification plays an essential role for the elderly or frail people in daily activities. This study aims to determine the optimal feature extraction and classification method for the activities of daily living (ADL). In the experiment, we collected surface electromyography (sEMG) signals from thigh semitendinosus, lateral thigh muscle, and calf gastrocnemius of the lower limbs to classify horizontal walking, crossing obstacles, standing up, going down the stairs, and going up the stairs. Firstly, we analyzed 11 feature extraction methods, including time domain, frequency domain, time-frequency domain, and entropy. Additionally, a feature evaluation method was proposed, and the separability of 11 feature extraction algorithms was calculated. Then, combined with 11 feature algorithms, the classification accuracy and time of 55 classification methods were calculated. The results showed that the Gaussian Kernel Linear Discriminant Analysis (GK-LDA) with WAMP had the highest classification accuracy rate (96%), and the calculation time was below 80 ms. In this paper, the quantitative comparative analysis of feature extraction and classification methods was a benefit to the application for the wearable sEMG sensor system in ADL.
Collapse
Affiliation(s)
| | - Xin Shi
- Correspondence: (P.Q.); (X.S.)
| |
Collapse
|
7
|
Continuous angular position estimation of human ankle during unconstrained locomotion. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101968] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
8
|
A Smart Terrain Identification Technique Based on Electromyography, Ground Reaction Force, and Machine Learning for Lower Limb Rehabilitation. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10082638] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Automatic terrain classification in lower limb rehabilitation systems has gained worldwide attention. In this field, a simple system architecture and high classification accuracy are two desired attributes. In this article, a smart neuromuscular–mechanical fusion and machine learning-based terrain classification technique utilizing only two electromyography (EMG) sensors and two ground reaction force (GRF) sensors is reported for classifying three different terrains (downhill, level, and uphill). The EMG and GRF signals from ten healthy subjects were collected, preprocessed and segmented to obtain the EMG and GRF profiles in each stride, based on which twenty-one statistical features, including 9 GRF features and 12 EMG features, were extracted. A support vector machine (SVM) machine learning model is established and trained by the extracted EMG features, GRF features and the fusion of them, respectively. Several methods or statistical metrics were used to evaluate the goodness of the proposed technique, including a paired-t-test and Kruskal–Wallis test for correlation analysis of the selected features and ten-fold cross-validation accuracy, confusion matrix, sensitivity and specificity for the performance of the SVM model. The results show that the extracted features are highly correlated with the terrain changes and the fusion of the EMG and GRF features produces the highest accuracy of 96.8%. The presented technique allows simple system construction to achieve the precise detection of outcomes, potentially advancing the development of terrain classification techniques for rehabilitation.
Collapse
|
9
|
|
10
|
Gupta R, Agarwal R. Single channel EMG-based continuous terrain identification with simple classifier for lower limb prosthesis. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.07.002] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|