1
|
Huang Y, Yang B, Wong TWL, Ng SSM, Hu X. Personalized robots for long-term telerehabilitation after stroke: a perspective on technological readiness and clinical translation. FRONTIERS IN REHABILITATION SCIENCES 2024; 4:1329927. [PMID: 38259875 PMCID: PMC10800453 DOI: 10.3389/fresc.2023.1329927] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 12/21/2023] [Indexed: 01/24/2024]
Abstract
Stroke rehabilitation, which demands consistent, intensive, and adaptable intervention in the long term, faced significant challenges due to the COVID-19 pandemic. During this time, telerehabilitation emerged as a noteworthy complement to traditional rehabilitation services, offering the convenience of at-home care delivery and overcoming geographical and resource limitations. Self-help rehabilitation robots deliver repetitive and intensive physical assistance, thereby alleviating the labor burden. However, robots have rarely demonstrated long-term readiness for poststroke telerehabilitation services. The transition from research trials to general clinical services presents several challenges that may undermine the rehabilitative gains observed in these studies. This perspective discusses the technological readiness of personal use robots in the context of telerehabilitation and identifies the potential challenges for their clinical translation. The goal is to leverage technology to seamlessly integrate it into standard clinical workflows, ultimately enhancing the outcomes of stroke rehabilitation.
Collapse
Affiliation(s)
- Yanhuan Huang
- Department of Biomedical Engineering, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
| | - Bibo Yang
- Department of Biomedical Engineering, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
| | - Thomson Wai-Lung Wong
- Department of Rehabilitation Sciences, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
| | - Shamay S. M. Ng
- Department of Rehabilitation Sciences, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
| | - Xiaoling Hu
- Department of Biomedical Engineering, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China
| |
Collapse
|
2
|
Ghislieri M, Cerone GL, Knaflitz M, Agostini V. Long short-term memory (LSTM) recurrent neural network for muscle activity detection. J Neuroeng Rehabil 2021; 18:153. [PMID: 34674720 PMCID: PMC8532313 DOI: 10.1186/s12984-021-00945-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 10/13/2021] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND The accurate temporal analysis of muscle activation is of great interest in many research areas, spanning from neurorobotic systems to the assessment of altered locomotion patterns in orthopedic and neurological patients and the monitoring of their motor rehabilitation. The performance of the existing muscle activity detectors is strongly affected by both the SNR of the surface electromyography (sEMG) signals and the set of features used to detect the activation intervals. This work aims at introducing and validating a powerful approach to detect muscle activation intervals from sEMG signals, based on long short-term memory (LSTM) recurrent neural networks. METHODS First, the applicability of the proposed LSTM-based muscle activity detector (LSTM-MAD) is studied through simulated sEMG signals, comparing the LSTM-MAD performance against other two widely used approaches, i.e., the standard approach based on Teager-Kaiser Energy Operator (TKEO) and the traditional approach, used in clinical gait analysis, based on a double-threshold statistical detector (Stat). Second, the effect of the Signal-to-Noise Ratio (SNR) on the performance of the LSTM-MAD is assessed considering simulated signals with nine different SNR values. Finally, the newly introduced approach is validated on real sEMG signals, acquired during both physiological and pathological gait. Electromyography recordings from a total of 20 subjects (8 healthy individuals, 6 orthopedic patients, and 6 neurological patients) were included in the analysis. RESULTS The proposed algorithm overcomes the main limitations of the other tested approaches and it works directly on sEMG signals, without the need for background-noise and SNR estimation (as in Stat). Results demonstrate that LSTM-MAD outperforms the other approaches, revealing higher values of F1-score (F1-score > 0.91) and Jaccard similarity index (Jaccard > 0.85), and lower values of onset/offset bias (average absolute bias < 6 ms), both on simulated and real sEMG signals. Moreover, the advantages of using the LSTM-MAD algorithm are particularly evident for signals featuring a low to medium SNR. CONCLUSIONS The presented approach LSTM-MAD revealed excellent performances against TKEO and Stat. The validation carried out both on simulated and real signals, considering normal as well as pathological motor function during locomotion, demonstrated that it can be considered a powerful tool in the accurate and effective recognition/distinction of muscle activity from background noise in sEMG signals.
Collapse
Affiliation(s)
- Marco Ghislieri
- Department of Electronics and Telecommunications, Politecnico Di Torino, 10129, Turin, Italy.
- PoliToBIOMed Lab, Politecnico di Torino, 10129, Turin, Italy.
| | - Giacinto Luigi Cerone
- PoliToBIOMed Lab, Politecnico di Torino, 10129, Turin, Italy
- Laboratory for Engineering of the Neuromuscular System (LISiN), Departement of Electronics and Telecommunications, Politecnico di Torino, 10129, Turin, Italy
| | - Marco Knaflitz
- Department of Electronics and Telecommunications, Politecnico Di Torino, 10129, Turin, Italy
- PoliToBIOMed Lab, Politecnico di Torino, 10129, Turin, Italy
| | - Valentina Agostini
- Department of Electronics and Telecommunications, Politecnico Di Torino, 10129, Turin, Italy
- PoliToBIOMed Lab, Politecnico di Torino, 10129, Turin, Italy
| |
Collapse
|
3
|
Tang W, Zhang X, Sun Y, Yao B, Chen X, Chen X, Gao X. Quantitative Assessment of Traumatic Upper-Limb Peripheral Nerve Injuries Using Surface Electromyography. Front Bioeng Biotechnol 2020; 8:795. [PMID: 32766224 PMCID: PMC7379167 DOI: 10.3389/fbioe.2020.00795] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Accepted: 06/22/2020] [Indexed: 11/13/2022] Open
Abstract
Background There is a great demand for convenient and quantitative assessment of upper-limb traumatic peripheral nerve injuries (PNIs) beyond their clinical routine. This would contribute to improved PNI management and rehabilitation. Objective The aim of this study was to develop a novel surface EMG examination method for quantitatively evaluating traumatic upper-limb PNIs. Methods Experiments were conducted to collect surface EMG data from forearm muscles on both sides of seven male subjects during their performance of eight designated hand and wrist motion tasks. All participants were clinically diagnosed as unilateral traumatic upper-limb PNIs on the ulnar nerve, median nerve, or radial nerve. Ten healthy control participants were also enrolled in the study. A novel framework consisting of two modules was also proposed for data analysis. One module was first used to identify whether a PNI occurs on a tested forearm using a machine learning algorithm by extracting and classifying features from surface EMG data. The second module was then used to quantitatively evaluate the degree of injury on three individual nerves on the examined arm. Results The evaluation scores yielded by the proposed method were highly consistent with the clinical assessment decisions for three nerves of all 34 examined arms (7 × 2 + 10 × 2), with a sensitivity of 81.82%, specificity of 98.90%, and significate linear correlation (p < 0.05) in quantitative decision points between the proposed method and the routine clinical approach. Conclusion This study offers a useful tool for PNI assessment and helps to promote extensive clinical applications of surface EMG.
Collapse
Affiliation(s)
- Weidi Tang
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Xu Zhang
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Yong Sun
- Institute of Criminal Sciences, Hefei Public Security Bureau, Hefei, China
| | - Bo Yao
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin, China
| | - Xiang Chen
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Xun Chen
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Xiaoping Gao
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
4
|
Lu Z, Tong KY, Zhang X, Li S, Zhou P. Myoelectric Pattern Recognition for Controlling a Robotic Hand: A Feasibility Study in Stroke. IEEE Trans Biomed Eng 2018; 66:365-372. [PMID: 29993410 DOI: 10.1109/tbme.2018.2840848] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Myoelectric pattern recognition has been successfully applied as a human-machine interface to control robotic devices such as prostheses and exoskeletons, significantly improving the dexterity of myoelectric control. This study investigates the feasibility of applying myoelectric pattern recognition for controlling a robotic hand in stroke patients. METHODS Myoelectric pattern recognition of six hand motion patterns was performed using forearm electromyogram signals in paretic side of eight stroke subjects. Both the random cross validation (RCV) and the chronological handout validation (CHV) were applied to assess the offline myoelectric pattern recognition performance. Experiments on real-time myoelectric pattern recognition control of an exoskeleton robotic hand were also performed. RESULTS An average classification accuracy of 84.1% (the mean value from two different classifiers) and individual subject differences were observed in the offline myoelectric pattern recognition analysis using the RCV, while the accuracy decreased to 65.7% when the CHV was used. The stroke subjects achieved an average accuracy of 61.3 ± 20.9% for controlling the robotic hand. However, our study did not reveal a clear correlation between the real-time control accuracy and the offline myoelectric pattern recognition performance, or any specific characteristics of the stroke subjects. CONCLUSION The findings suggest that it is feasible to apply myoelectric pattern recognition to control the robotic hand in some but not all of the stroke patients. Each stroke subject should be individually online tested for the feasibility of applying myoelectric pattern recognition control for robot-assisted rehabilitation.
Collapse
|
5
|
Lu Z, Chen X, Zhang X, Tong KY, Zhou P. Real-Time Control of an Exoskeleton Hand Robot with Myoelectric Pattern Recognition. Int J Neural Syst 2017; 27:1750009. [DOI: 10.1142/s0129065717500095] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Robot-assisted training provides an effective approach to neurological injury rehabilitation. To meet the challenge of hand rehabilitation after neurological injuries, this study presents an advanced myoelectric pattern recognition scheme for real-time intention-driven control of a hand exoskeleton. The developed scheme detects and recognizes user’s intention of six different hand motions using four channels of surface electromyography (EMG) signals acquired from the forearm and hand muscles, and then drives the exoskeleton to assist the user accomplish the intended motion. The system was tested with eight neurologically intact subjects and two individuals with spinal cord injury (SCI). The overall control accuracy was [Formula: see text] for the neurologically intact subjects and [Formula: see text] for the SCI subjects. The total lag of the system was approximately 250[Formula: see text]ms including data acquisition, transmission and processing. One SCI subject also participated in training sessions in his second and third visits. Both the control accuracy and efficiency tended to improve. These results show great potential for applying the advanced myoelectric pattern recognition control of the wearable robotic hand system toward improving hand function after neurological injuries.
Collapse
Affiliation(s)
- Zhiyuan Lu
- Department of Physical Medicine and Rehabilitation, University of Texas Health Science Center at Houston, 7000 Fannin St., Houston, TX, USA
- TIRR Memorial Hermann Research Center, 1333B Moursund St., Houston, TX, USA
| | - Xiang Chen
- Biomedical Engineering Program, University of Science and Technology of China, Hefei, P. R. China
| | - Xu Zhang
- Biomedical Engineering Program, University of Science and Technology of China, Hefei, P. R. China
| | - Kay-Yu Tong
- Division of Biomedical Engineering, Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, P. R. China
| | - Ping Zhou
- Department of Physical Medicine and Rehabilitation, University of Texas Health Science Center at Houston, 7000 Fannin St., Houston, TX, USA
- TIRR Memorial Hermann Research Center, 1333B Moursund St., Houston, TX, USA
- Guangdong Work Injury Rehabilitation Center, 68 Qide Rd., Guangzhou, P. R. China
| |
Collapse
|
6
|
Li X, Chen S, Zhang H, Samuel OW, Wang H, Fang P, Zhang X, Li G. Towards reducing the impacts of unwanted movements on identification of motion intentions. J Electromyogr Kinesiol 2016; 28:90-8. [PMID: 27093136 DOI: 10.1016/j.jelekin.2016.03.005] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2015] [Revised: 02/18/2016] [Accepted: 03/14/2016] [Indexed: 11/16/2022] Open
Abstract
Surface electromyogram (sEMG) has been extensively used as a control signal in prosthesis devices. However, it is still a great challenge to make multifunctional myoelectric prostheses clinically available due to a number of critical issues associated with existing EMG based control strategy. One such issue would be the effect of unwanted movements (UMs) that are inadvertently done by users on the performance of movement classification in EMG pattern recognition based algorithms. Since UMs are not considered in training a classifier, they would decay the performance of a trained classifier in identifying the target movements (TMs), which would cause some undesired actions in control of multifunctional prostheses. In this study, the impact of UMs was systemically investigated in both able-bodied subjects and transradial amputees. Our results showed that the UMs would be unevenly classified into all classes of the TMs. To reduce the impact of the UMs on the performance of a classifier, a new training strategy that would categorize all possible UMs into a new movement class was proposed and a metric called Reject Ratio that is a measure of how many UMs is rejected by a trained classifier was adopted. The results showed that the average Reject Ratio across all the participants was greater than 91%, meanwhile the average classification accuracy of TMs was above 99% when UMs occurred. This suggests that the proposed training strategy could greatly reduce the impact of UMs on the performance of the trained classifier in identifying the TMs and may enhance the robustness of myoelectric control in clinical applications.
Collapse
Affiliation(s)
- Xiangxin Li
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Shixiong Chen
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Haoshi Zhang
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Oluwarotimi Williams Samuel
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Hui Wang
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Peng Fang
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China
| | - Xiufeng Zhang
- National Research Center for Rehabilitation Technical Aids, Beijing, China
| | - Guanglin Li
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Chinese Academy of Sciences (CAS), Shenzhen, Guangdong 518055, China; Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, CAS, Shenzhen, Guangdong 518055, China.
| |
Collapse
|
7
|
Complexity Analysis of Surface EMG for Overcoming ECG Interference toward Proportional Myoelectric Control. ENTROPY 2016. [DOI: 10.3390/e18040106] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
8
|
Liu J, Liu Q. Use of the integrated profile for voluntary muscle activity detection using EMG signals with spurious background spikes: A study with incomplete spinal cord injury. Biomed Signal Process Control 2016. [DOI: 10.1016/j.bspc.2015.09.004] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
9
|
Liu J. Adaptive myoelectric pattern recognition toward improved multifunctional prosthesis control. Med Eng Phys 2015; 37:424-30. [PMID: 25749182 DOI: 10.1016/j.medengphy.2015.02.005] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2014] [Revised: 02/04/2015] [Accepted: 02/16/2015] [Indexed: 10/23/2022]
Abstract
The non-stationary property of electromyography (EMG) signals in real life settings usually hinders the clinical application of the myoelectric pattern recognition for prosthesis control. The classical EMG pattern recognition approach consists of two separate steps: training and testing, without considering the changes between training and testing data induced by electrode shift, fatigue, impedance changes and psychological factors, and often results in performance degradation. The aim of this study was to develop an adaptive myoelectric pattern recognition system, aiming to retrain the classifier online with the testing data without supervision, providing a self-correction mechanism for suppressing misclassifications. This paper presents an adaptive unsupervised classifier based on support vector machine (SVM) to improve the classification performance. Experimental data from 15 healthy subjects were used to evaluate performance. Preliminary study on intra-session and inter-session EMG data was conducted to verify the performance of the unsupervised adaptive SVM classifier. The unsupervised adaptive SVM classifier outperformed the conventional SVM by 3.3% and 8.0% for the combination of time-domain and autoregressive features in the intra-session and inter-session tests, respectively. The proposed approach is capable of incorporating the useful information in testing data to the classification model by taking into account the overtime changes in the testing data with respect to the training data to retrain the original classifier, therefore providing a self-correction mechanism for suppressing misclassifications.
Collapse
Affiliation(s)
- Jie Liu
- Sensory Motor Performance Program, Rehabilitation Institute of Chicago, 345 E. Superior St, Suite 1406, Chicago, IL 60611, USA.
| |
Collapse
|
10
|
Zhang X, Zhou P. Myoelectric pattern identification of stroke survivors using multivariate empirical mode decomposition. JOURNAL OF HEALTHCARE ENGINEERING 2015; 5:261-73. [PMID: 25193367 DOI: 10.1260/2040-2295.5.3.261] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
This study presents a novel feature extraction method for myoelectric pattern recognition using a multivariate extension of empirical mode decomposition (EMD), namely multivariate EMD (MEMD). The method processes multiple surface electromyogram (EMG) channels simultaneously rather than in a channel-by-channel manner. From mode-aligned intrinsic mode functions (IMFs, representing signal components over multiple scales) derived from the MEMD analysis, normalized amplitude distributions of the same-mode/scale IMFs across different channels were calculated as features, which serve to reveal the underlying relationship in the aligned intrinsic scales across multiple muscles. The proposed method was assessed for identification of 18 different functional movement patterns via 27-channel surface EMG signals recorded from the paretic forearm muscles of 12 subjects with hemiparetic stroke. With a linear discriminant classifier, the proposed MEMD based feature set resulted in an average error rate of 4.61 ± 4.70% for classification of all the different movements, significantly lower than that of the conventional time-domain feature set (7.14 ± 6.15%, p < 0.05). The results indicate that the MEMD based feature extraction of multi-channel surface EMG data provides a promising approach to modeling of muscle couplings and identification of different myoelectric patterns.
Collapse
Affiliation(s)
- Xu Zhang
- Biomedical Engineering Program, University of Science and Technology of China, Hefei, Anhui, China
| | - Ping Zhou
- Biomedical Engineering Program, University of Science and Technology of China, Hefei, Anhui, China Department of Physical Medicine and Rehabilitation, University of Texas Health Science Center at Houston, and TIRR Memorial Hermann Research Center, Houston, Texas, USA
| |
Collapse
|
11
|
Liu J, Ying D, Zhou P. Wiener filtering of surface EMG with a priori SNR estimation toward myoelectric control for neurological injury patients. Med Eng Phys 2014; 36:1711-5. [PMID: 25443536 DOI: 10.1016/j.medengphy.2014.09.008] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2014] [Revised: 09/02/2014] [Accepted: 09/07/2014] [Indexed: 11/16/2022]
Abstract
Voluntary surface electromyogram (EMG) signals from neurological injury patients are often corrupted by involuntary background interference or spikes, imposing difficulties for myoelectric control. We present a novel framework to suppress involuntary background spikes during voluntary surface EMG recordings. The framework applies a Wiener filter to restore voluntary surface EMG signals based on tracking a priori signal to noise ratio (SNR) by using the decision-directed method. Semi-synthetic surface EMG signals contaminated by different levels of involuntary background spikes were constructed from a database of surface EMG recordings in a group of spinal cord injury subjects. After the processing, the onset detection of voluntary muscle activity was significantly improved against involuntary background spikes. The magnitude of voluntary surface EMG signals can also be reliably estimated for myoelectric control purpose. Compared with the previous sample entropy analysis for suppressing involuntary background spikes, the proposed framework is characterized by quick and simple implementation, making it more suitable for application in a myoelectric control system toward neurological injury rehabilitation.
Collapse
Affiliation(s)
- Jie Liu
- Sensory Motor Performance Program, Rehabilitation Institute of Chicago, USA
| | - Dongwen Ying
- Institute of Acoustics, Chinese Academy of Sciences, Beijing, China
| | - Ping Zhou
- Biomedical Engineering Program, University of Science and Technology of China, Hefei, China; Department of Physical Medicine & Rehabilitation, University of Texas Health Science Center and TIRR Memorial Hermann Research Center, Houston, USA.
| |
Collapse
|