1
|
Wu D, Tian P, Zhang S, Wang Q, Yu K, Wang Y, Gao Z, Huang L, Li X, Zhai X, Tian M, Huang C, Zhang H, Zhang J. A Surface Electromyography (sEMG) System Applied for Grip Force Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:3818. [PMID: 38931601 PMCID: PMC11207591 DOI: 10.3390/s24123818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2024] [Revised: 05/31/2024] [Accepted: 06/07/2024] [Indexed: 06/28/2024]
Abstract
Muscles play an indispensable role in human life. Surface electromyography (sEMG), as a non-invasive method, is crucial for monitoring muscle status. It is characterized by its real-time, portable nature and is extensively utilized in sports and rehabilitation sciences. This study proposed a wireless acquisition system based on multi-channel sEMG for objective monitoring of grip force. The system consists of an sEMG acquisition module containing four-channel discrete terminals and a host computer receiver module, using Bluetooth wireless transmission. The system is portable, wearable, low-cost, and easy to operate. Leveraging the system, an experiment for grip force prediction was designed, employing the bald eagle search (BES) algorithm to enhance the Random Forest (RF) algorithm. This approach established a grip force prediction model based on dual-channel sEMG signals. As tested, the performance of acquisition terminal proceeded as follows: the gain was up to 1125 times, and the common mode rejection ratio (CMRR) remained high in the sEMG signal band range (96.94 dB (100 Hz), 84.12 dB (500 Hz)), while the performance of the grip force prediction algorithm had an R2 of 0.9215, an MAE of 1.0637, and an MSE of 1.7479. The proposed system demonstrates excellent performance in real-time signal acquisition and grip force prediction, proving to be an effective muscle status monitoring tool for rehabilitation, training, disease condition surveillance and scientific fitness applications.
Collapse
Affiliation(s)
- Dantong Wu
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Peng Tian
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shuai Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Qihang Wang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Kang Yu
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
| | - Yunfeng Wang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhixing Gao
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lin Huang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xiangyu Li
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xingchen Zhai
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Meng Tian
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chengjun Huang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Haiying Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jun Zhang
- Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China; (D.W.); (P.T.); (S.Z.); (Q.W.); (K.Y.); (Y.W.); (Z.G.); (L.H.); (X.L.); (X.Z.); (M.T.); (C.H.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
2
|
Sheng W, Gao T, Liang K, Wang Y. Bilateral Elimination Rule-Based Finite Class Bayesian Inference System for Circular and Linear Walking Prediction. Biomimetics (Basel) 2024; 9:266. [PMID: 38786476 PMCID: PMC11118229 DOI: 10.3390/biomimetics9050266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Revised: 04/25/2024] [Accepted: 04/26/2024] [Indexed: 05/25/2024] Open
Abstract
OBJECTIVE The prediction of upcoming circular walking during linear walking is important for the usability and safety of the interaction between a lower limb assistive device and the wearer. This study aims to build a bilateral elimination rule-based finite class Bayesian inference system (BER-FC-BesIS) with the ability to predict the transition between circular walking and linear walking using inertial measurement units. METHODS Bilateral motion data of the human body were used to improve the recognition and prediction accuracy of BER-FC-BesIS. RESULTS The mean predicted time of BER-FC-BesIS in predicting the left and right lower limbs' upcoming steady walking activities is 119.32 ± 9.71 ms and 113.75 ± 11.83 ms, respectively. The mean time differences between the predicted time and the real time of BER-FC-BesIS in the left and right lower limbs' prediction are 14.22 ± 3.74 ms and 13.59 ± 4.92 ms, respectively. The prediction accuracy of BER-FC-BesIS is 93.98%. CONCLUSION Upcoming steady walking activities (e.g., linear walking and circular walking) can be accurately predicted by BER-FC-BesIS innovatively. SIGNIFICANCE This study could be helpful and instructional to improve the lower limb assistive devices' capabilities of walking activity prediction with emphasis on non-linear walking activities in daily living.
Collapse
Affiliation(s)
- Wentao Sheng
- School of Mechanical Engineering, Jiangsu University of Technology (JSUT), Changzhou 213001, China;
| | - Tianyu Gao
- School of Intelligent Manufacturing, Nanjing University of Science and Technology (NJUST), Nanjing 210094, China;
| | - Keyao Liang
- School of Mechatronics Engineering, Harbin Institute of Technology (HIT), Harbin 150001, China
| | - Yumo Wang
- School of Intelligent Manufacturing, Nanjing University of Science and Technology (NJUST), Nanjing 210094, China;
| |
Collapse
|
3
|
Anastasiev A, Kadone H, Marushima A, Watanabe H, Zaboronok A, Watanabe S, Matsumura A, Suzuki K, Matsumaru Y, Ishikawa E. Empirical Myoelectric Feature Extraction and Pattern Recognition in Hemiplegic Distal Movement Decoding. Bioengineering (Basel) 2023; 10:866. [PMID: 37508895 PMCID: PMC10376258 DOI: 10.3390/bioengineering10070866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 07/10/2023] [Accepted: 07/18/2023] [Indexed: 07/30/2023] Open
Abstract
In myoelectrical pattern recognition (PR), the feature extraction methods for stroke-oriented applications are challenging and remain discordant due to a lack of hemiplegic data and limited knowledge of skeletomuscular function. Additionally, technical and clinical barriers create the need for robust, subject-independent feature generation while using supervised learning (SL). To the best of our knowledge, we are the first study to investigate the brute-force analysis of individual and combinational feature vectors for acute stroke gesture recognition using surface electromyography (EMG) of 19 patients. Moreover, post-brute-force singular vectors were concatenated via a Fibonacci-like spiral net ranking as a novel, broadly applicable concept for feature selection. This semi-brute-force navigated amalgamation in linkage (SNAiL) of EMG features revealed an explicit classification rate performance advantage of 10-17% compared to canonical feature sets, which can drastically extend PR capabilities in biosignal processing.
Collapse
Affiliation(s)
- Alexey Anastasiev
- Department of Neurosurgery, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Hideki Kadone
- Center for Cybernics Research, Institute of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Aiki Marushima
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| | - Hiroki Watanabe
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| | - Alexander Zaboronok
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| | - Shinya Watanabe
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| | - Akira Matsumura
- Ibaraki Prefectural University of Health Sciences, 4669-2 Amicho, Inashiki 300-0394, Ibaraki, Japan
| | - Kenji Suzuki
- Center for Cybernics Research, Artificial Intelligence Laboratory, Faculty of Engineering Information and Systems, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8573, Ibaraki, Japan
| | - Yuji Matsumaru
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| | - Eiichi Ishikawa
- Department of Neurosurgery, Institute of Medicine, University of Tsukuba, Tennodai 1-1-1, Tsukuba 305-8575, Ibaraki, Japan
| |
Collapse
|
4
|
Feng J, Yang MJ, Kyeong S, Kim Y, Jo S, Park HS, Kim J. Hand Grasp Motion Intention Recognition Based on High-Density Electromyography in Chronic Stroke Patients. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083148 DOI: 10.1109/embc40787.2023.10340346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Stroke is a debilitating condition that leads to a loss of motor function, inability to perform daily life activities, and ultimately worsening quality of life. Robot-based rehabilitation is a more effective method than conventional rehabilitation but needs to accurately recognize the patient's intention so that the robot can assist the patient's voluntary motion. This study focuses on recognizing hand grasp motion intention using high-density electromyography (HD-EMG) in patients with chronic stroke. The study was conducted with three chronic stroke patients and involved recording HD-EMG signals from the muscles involved in hand grasp motions. The adaptive onset detection algorithm was used to accurately identify the start of hand grasp motions accurately, and a convolutional neural network (CNN) was trained to classify the HD-EMG signals into one of four grasping motions. The average true positive and false positive rates of the grasp onset detection on three subjects were 91.6% and 9.8%, respectively, and the trained CNN classified the grasping motion with an average accuracy of 76.3%. The results showed that using HD-EMG can provide accurate hand grasp motion intention recognition in chronic stroke patients, highlighting the potential for effective robot-based rehabilitation.
Collapse
|
5
|
de Miguel-Fernández J, Lobo-Prat J, Prinsen E, Font-Llagunes JM, Marchal-Crespo L. Control strategies used in lower limb exoskeletons for gait rehabilitation after brain injury: a systematic review and analysis of clinical effectiveness. J Neuroeng Rehabil 2023; 20:23. [PMID: 36805777 PMCID: PMC9938998 DOI: 10.1186/s12984-023-01144-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 01/07/2023] [Indexed: 02/21/2023] Open
Abstract
BACKGROUND In the past decade, there has been substantial progress in the development of robotic controllers that specify how lower-limb exoskeletons should interact with brain-injured patients. However, it is still an open question which exoskeleton control strategies can more effectively stimulate motor function recovery. In this review, we aim to complement previous literature surveys on the topic of exoskeleton control for gait rehabilitation by: (1) providing an updated structured framework of current control strategies, (2) analyzing the methodology of clinical validations used in the robotic interventions, and (3) reporting the potential relation between control strategies and clinical outcomes. METHODS Four databases were searched using database-specific search terms from January 2000 to September 2020. We identified 1648 articles, of which 159 were included and evaluated in full-text. We included studies that clinically evaluated the effectiveness of the exoskeleton on impaired participants, and which clearly explained or referenced the implemented control strategy. RESULTS (1) We found that assistive control (100% of exoskeletons) that followed rule-based algorithms (72%) based on ground reaction force thresholds (63%) in conjunction with trajectory-tracking control (97%) were the most implemented control strategies. Only 14% of the exoskeletons implemented adaptive control strategies. (2) Regarding the clinical validations used in the robotic interventions, we found high variability on the experimental protocols and outcome metrics selected. (3) With high grade of evidence and a moderate number of participants (N = 19), assistive control strategies that implemented a combination of trajectory-tracking and compliant control showed the highest clinical effectiveness for acute stroke. However, they also required the longest training time. With high grade of evidence and low number of participants (N = 8), assistive control strategies that followed a threshold-based algorithm with EMG as gait detection metric and control signal provided the highest improvements with the lowest training intensities for subacute stroke. Finally, with high grade of evidence and a moderate number of participants (N = 19), assistive control strategies that implemented adaptive oscillator algorithms together with trajectory-tracking control resulted in the highest improvements with reduced training intensities for individuals with chronic stroke. CONCLUSIONS Despite the efforts to develop novel and more effective controllers for exoskeleton-based gait neurorehabilitation, the current level of evidence on the effectiveness of the different control strategies on clinical outcomes is still low. There is a clear lack of standardization in the experimental protocols leading to high levels of heterogeneity. Standardized comparisons among control strategies analyzing the relation between control parameters and biomechanical metrics will fill this gap to better guide future technical developments. It is still an open question whether controllers that provide an on-line adaptation of the control parameters based on key biomechanical descriptors associated to the patients' specific pathology outperform current control strategies.
Collapse
Affiliation(s)
- Jesús de Miguel-Fernández
- Biomechanical Engineering Lab, Department of Mechanical Engineering and Research Centre for Biomedical Engineering, Universitat Politècnica de Catalunya, Diagonal 647, 08028 Barcelona, Spain
- Institut de Recerca Sant Joan de Déu, Santa Rosa 39-57, 08950 Esplugues de Llobregat, Spain
| | | | - Erik Prinsen
- Roessingh Research and Development, Roessinghsbleekweg 33b, 7522AH Enschede, Netherlands
| | - Josep M. Font-Llagunes
- Biomechanical Engineering Lab, Department of Mechanical Engineering and Research Centre for Biomedical Engineering, Universitat Politècnica de Catalunya, Diagonal 647, 08028 Barcelona, Spain
- Institut de Recerca Sant Joan de Déu, Santa Rosa 39-57, 08950 Esplugues de Llobregat, Spain
| | - Laura Marchal-Crespo
- Cognitive Robotics Department, Delft University of Technology, Mekelweg 2, 2628 Delft, Netherlands
- Motor Learning and Neurorehabilitation Lab, ARTORG Center for Biomedical Engineering Research, University of Bern, Freiburgstrasse 3, 3010 Bern, Switzerland
- Department of Rehabilitation Medicine, Erasmus MC University Medical Center, Doctor Molewaterplein 40, 3015 GD Rotterdam, The Netherlands
| |
Collapse
|
6
|
Xu Q, Xue S, Gao F, Wu Q, Zhang Q. Evaluation method of motor unit number index based on optimal muscle strength combination. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:3854-3872. [PMID: 36899608 DOI: 10.3934/mbe.2023181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Repeatability is an important attribute of motor unit number index (MUNIX) technology. This paper proposes an optimal contraction force combination for MUNIX calculation in an effort to improve the repeatability of this technology. In this study, the surface electromyography (EMG) signals of the biceps brachii muscle of eight healthy subjects were initially recorded with high-density surface electrodes, and the contraction strength was the maximum voluntary contraction force of nine progressive levels. Then, by traversing and comparing the repeatability of MUNIX under various combinations of contraction force, the optimal combination of muscle strength is determined. Finally, calculate MUNIX using the high-density optimal muscle strength weighted average method. The correlation coefficient and the coefficient of variation are utilized to assess repeatability. The results show that when the muscle strength combination is 10, 20, 50 and 70% of the maximum voluntary contraction force, the repeatability of MUNIX is greatest, and the correlation between MUNIX calculated using this combination of muscle strength and conventional methods is high (PCC > 0.99), the repeatability of the MUNIX method improved by 11.5-23.8%. The results indicate that the repeatability of MUNIX differs for various combinations of muscle strength and that MUNIX, which is measured with a smaller number and lower-level contractility, has greater repeatability.
Collapse
Affiliation(s)
- Qun Xu
- School of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Suqi Xue
- School of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Farong Gao
- School of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Qiuxuan Wu
- School of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Qizhong Zhang
- School of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou 310018, China
| |
Collapse
|
7
|
Chen W, Lyu M, Ding X, Wang J, Zhang J. Electromyography-controlled lower extremity exoskeleton to provide wearers flexibility in walking. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
8
|
Anastasiev A, Kadone H, Marushima A, Watanabe H, Zaboronok A, Watanabe S, Matsumura A, Suzuki K, Matsumaru Y, Ishikawa E. Supervised Myoelectrical Hand Gesture Recognition in Post-Acute Stroke Patients with Upper Limb Paresis on Affected and Non-Affected Sides. SENSORS (BASEL, SWITZERLAND) 2022; 22:8733. [PMID: 36433330 PMCID: PMC9692557 DOI: 10.3390/s22228733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 10/31/2022] [Accepted: 11/02/2022] [Indexed: 06/16/2023]
Abstract
In clinical practice, acute post-stroke paresis of the extremities fundamentally complicates timely rehabilitation of motor functions; however, recently, residual and distorted musculoskeletal signals have been used to initiate feedback-driven solutions for establishing motor rehabilitation. Here, we investigate the possibilities of basic hand gesture recognition in acute stroke patients with hand paresis using a novel, acute stroke, four-component multidomain feature set (ASF-4) with feature vector weight additions (ASF-14NP, ASF-24P) and supervised learning algorithms trained only by surface electromyography (sEMG). A total of 19 (65.9 ± 12.4 years old; 12 men, seven women) acute stroke survivors (12.4 ± 6.3 days since onset) with hand paresis (Brunnstrom stage 4 ± 1/4 ± 1, SIAS 3 ± 1/3 ± 2, FMA-UE 40 ± 20) performed 10 repetitive hand movements reflecting basic activities of daily living (ADLs): rest, fist, pinch, wrist flexion, wrist extension, finger spread, and thumb up. Signals were recorded using an eight-channel, portable sEMG device with electrode placement on the forearms and thenar areas of both limbs (four sensors on each extremity). Using data preprocessing, semi-automatic segmentation, and a set of extracted feature vectors, support vector machine (SVM), linear discriminant analysis (LDA), and k-nearest neighbors (k-NN) classifiers for statistical comparison and validity (paired t-tests, p-value < 0.05), we were able to discriminate myoelectrical patterns for each gesture on both paretic and non-paretic sides. Despite any post-stroke conditions, the evaluated total accuracy rate by the 10-fold cross-validation using SVM among four-, five-, six-, and seven-gesture models were 96.62%, 94.20%, 94.45%, and 95.57% for non-paretic and 90.37%, 88.48%, 88.60%, and 89.75% for paretic limbs, respectively. LDA had competitive results using PCA whereas k-NN was a less efficient classifier in gesture prediction. Thus, we demonstrate partial efficacy of the combination of sEMG and supervised learning for upper-limb rehabilitation procedures for early acute stroke motor recovery and various treatment applications.
Collapse
Affiliation(s)
- Alexey Anastasiev
- Department of Neurosurgery, Graduate School of Comprehensive Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Hideki Kadone
- Center for Cybernics Research, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8573, Ibaraki, Japan
| | - Aiki Marushima
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Hiroki Watanabe
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Alexander Zaboronok
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Shinya Watanabe
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Akira Matsumura
- Ibaraki Prefectural University of Health Sciences, 4669-2 Amicho, Inashiki 300-0394, Ibaraki, Japan
| | - Kenji Suzuki
- Center for Cybernics Research, Artificial Intelligence Laboratory, Faculty of Engineering Information and Systems, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8573, Ibaraki, Japan
| | - Yuji Matsumaru
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| | - Eiichi Ishikawa
- Department of Neurosurgery, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennodai, Tsukuba 305-8575, Ibaraki, Japan
| |
Collapse
|
9
|
A multi-Kalman filter-based approach for decoding arm kinematics from EMG recordings. Biomed Eng Online 2022; 21:60. [PMID: 36057581 PMCID: PMC9440508 DOI: 10.1186/s12938-022-01030-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 08/08/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Remarkable work has been recently introduced to enhance the usage of Electromyography (EMG) signals in operating prosthetic arms. Despite the rapid advancements in this field, providing a reliable, naturalistic myoelectric prosthesis remains a significant challenge. Other challenges include the limited number of allowed movements, lack of simultaneous, continuous control and the high computational power that could be needed for accurate decoding. In this study, we propose an EMG-based multi-Kalman filter approach to decode arm kinematics; specifically, the elbow angle (θ), wrist joint horizontal (X) and vertical (Y) positions in a continuous and simultaneous manner. RESULTS Ten subjects were examined from which we recorded arm kinematics and EMG signals of the biceps, triceps, lateral and anterior deltoid muscles corresponding to a randomized set of movements. The performance of the proposed decoder is assessed using the correlation coefficient (CC) and the normalized root-mean-square error (NRMSE) computed between the actual and the decoded kinematic. Results demonstrate that when training and testing the decoder using same-subject data, an average CC of 0.68 ± 0.1, 0.67 ± 0.12 and 0.64 ± 0.11, and average NRMSE of 0.21 ± 0.06, 0.18 ± 0.03 and 0.24 ± 0.07 were achieved for θ, X, and Y, respectively. When training the decoder using the data of one subject and decoding the data of other subjects, an average CC of 0.61 ± 0.19, 0.61 ± 0.16 and 0.48 ± 0.17, and an average NRMSE of 0.23 ± 0.07, 0.2 ± 0.05 and 0.38 ± 0.15 were achieved for θ, X, and Y, respectively. CONCLUSIONS These results suggest the efficacy of the proposed approach and indicates the possibility of obtaining a subject-independent decoder.
Collapse
|
10
|
Improved swarm-wavelet based extreme learning machine for myoelectric pattern recognition. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103737] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
11
|
Meier TB, Brecheisen AR, Gandomi KY, Carvalho PA, Meier GR, Clancy EA, Fischer GS, Nycz CJ. Individuals with moderate to severe hand impairments may struggle to use EMG control for assistive devices. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:2864-2869. [PMID: 36085874 DOI: 10.1109/embc48229.2022.9871351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Neurological trauma, such as stroke, traumatic brain injury (TBI), spinal cord injury, and cerebral palsy can cause mild to severe upper limb impairments. Hand impairment makes it difficult for individuals to complete activities of daily living, especially bimanual tasks. A robotic hand orthosis or hand exoskeleton can be used to restore partial function of an intact but impaired hand. It is common for upper extremity prostheses and orthoses to use electromyography (EMG) sensing as a method for the user to control their device. However some individuals with an intact but impaired hand may struggle to use a myoelectrically controlled device due to potentially confounding muscle activity. This study was conducted to evaluate the application of conventional EMG control techniques as a robotic orthosis/exoskeleton user input method for individuals with mild to severe hand impairments. Nine impaired subjects and ten healthy subjects were asked to perform repeated contractions of muscles in their forearm and then onset analysis and feature classification were used to determine the accuracy of the employed EMG techniques. The average accuracy for contraction identification across employed EMG techniques was 95.4% ± 4.9 for the healthy subjects and 73.9% ± 13.1 for the impaired subjects with a range of 47.0% ± 19.1 - 91.6% ± 8.5. These preliminary results suggest that the conventional EMG control technologies employed in this paper may be difficult for some impaired individuals to use due to their unreliable muscle control.
Collapse
|
12
|
Seo NJ, Barry A, Ghassemi M, Triandafilou KM, Stoykov ME, Vidakovic L, Roth E, Kamper DG. Use of an EMG-Controlled Game as a Therapeutic Tool to Retrain Hand Muscle Activation Patterns Following Stroke: A Pilot Study. J Neurol Phys Ther 2022; 46:198-205. [PMID: 35320135 PMCID: PMC9232857 DOI: 10.1097/npt.0000000000000398] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
BACKGROUND/PURPOSE To determine the feasibility of training with electromyographically (EMG) controlled games to improve control of muscle activation patterns in stroke survivors. METHODS Twenty chronic stroke survivors (>6 months) with moderate hand impairment were randomized to train either unilaterally (paretic only) or bilaterally over 9 one-hour training sessions. EMG signals from the unilateral or bilateral limbs controlled a cursor location on a computer screen for gameplay. The EMG muscle activation vector was projected onto the plane defined by the first 2 principal components of the activation workspace for the nonparetic hand. These principal components formed the x- and y-axes of the computer screen. RESULTS The recruitment goal (n = 20) was met over 9 months, with no screen failure, no attrition, and 97.8% adherence rate. After training, both groups significantly decreased the time to move the cursor to a novel sequence of targets (P = 0.006) by reducing normalized path length of the cursor movement (P = 0.005), and improved the Wolf Motor Function Test (WMFT) quality score (P = 0.01). No significant group difference was observed. No significant change was seen in the WMFT time or Box and Block Test. DISCUSSION/CONCLUSIONS Stroke survivors could successfully use the EMG-controlled games to train control of muscle activation patterns. While the nonparetic limb EMG was used in this study to create target EMG patterns, the system supports various means for creating target patterns per user desires. Future studies will employ training with the EMG-controlled games in conjunction with functional task practice for a longer intervention duration to improve overall hand function.Video Abstract available for more insights from the authors (see the Video, Supplemental Digital Content 1, available at: http://links.lww.com/JNPT/A379).
Collapse
Affiliation(s)
- Na Jin Seo
- Departments of Rehabilitation Sciences and Health Science and Research, Medical University of South Carolina, Charleston, and Ralph H. Johnson VA Medical Center, Charleston, South Carolina (N.J.S.); Shirley Ryan AbilityLab, Chicago, Illinois (A.B., K.M.T., M.E.S., L.V. E.R.); Joint Department of Biomedical Engineering, North Carolina State University/University of North Carolina at Chapel Hill, Raleigh, Chapel Hill (M.G., D.G.K); and Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, Chicago, Illinois (M.E.S., L.V., E.R.)
| | | | | | | | | | | | | | | |
Collapse
|
13
|
Song X, van de Ven SS, Chen S, Kang P, Gao Q, Jia J, Shull PB. Proposal of a Wearable Multimodal Sensing-Based Serious Games Approach for Hand Movement Training After Stroke. Front Physiol 2022; 13:811950. [PMID: 35721546 PMCID: PMC9204487 DOI: 10.3389/fphys.2022.811950] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 05/11/2022] [Indexed: 11/25/2022] Open
Abstract
Stroke often leads to hand motor dysfunction, and effective rehabilitation requires keeping patients engaged and motivated. Among the existing automated rehabilitation approaches, data glove-based systems are not easy to wear for patients due to spasticity, and single sensor-based approaches generally provided prohibitively limited information. We thus propose a wearable multimodal serious games approach for hand movement training after stroke. A force myography (FMG), electromyography (EMG), and inertial measurement unit (IMU)-based multi-sensor fusion model was proposed for hand movement classification, which was worn on the user’s affected arm. Two movement recognition-based serious games were developed for hand movement and cognition training. Ten stroke patients with mild to moderate motor impairments (Brunnstrom Stage for Hand II-VI) performed experiments while playing interactive serious games requiring 12 activities-of-daily-living (ADLs) hand movements taken from the Fugl Meyer Assessment. Feasibility was evaluated by movement classification accuracy and qualitative patient questionnaires. The offline classification accuracy using combined FMG-EMG-IMU was 81.0% for the 12 movements, which was significantly higher than any single sensing modality; only EMG, only FMG, and only IMU were 69.6, 63.2, and 47.8%, respectively. Patients reported that they were more enthusiastic about hand movement training while playing the serious games as compared to conventional methods and strongly agreed that they subjectively felt that the proposed training could be beneficial for improving upper limb motor function. These results showed that multimodal-sensor fusion improved hand gesture classification accuracy for stroke patients and demonstrated the potential of this proposed approach to be used as upper limb movement training after stroke.
Collapse
Affiliation(s)
- Xinyu Song
- The State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Shirdi Shankara van de Ven
- The State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Shugeng Chen
- The Department of Rehabilitation Medicine, The National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Peiqi Kang
- The State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Qinghua Gao
- The State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Jie Jia
- The Department of Rehabilitation Medicine, The National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Peter B Shull
- The State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
14
|
Xu J, Meeker C, Chen A, Winterbottom L, Fraser M, Park S, Weber LM, Miya M, Nilsen D, Stein J, Ciocarlie M. Adaptive Semi-Supervised Intent Inferral to Control a Powered Hand Orthosis for Stroke. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION : ICRA : [PROCEEDINGS]. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION 2022; 2022:8097-8103. [PMID: 37181542 PMCID: PMC10181849 DOI: 10.1109/icra46639.2022.9811932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
In order to provide therapy in a functional context, controls for wearable robotic orthoses need to be robust and intuitive. We have previously introduced an intuitive, user-driven, EMG-based method to operate a robotic hand orthosis, but the process of training a control that is robust to concept drift (changes in the input signal) places a substantial burden on the user. In this paper, we explore semi-supervised learning as a paradigm for controlling a powered hand orthosis for stroke subjects. To the best of our knowledge, this is the first use of semi-supervised learning for an orthotic application. Specifically, we propose a disagreement-based semi-supervision algorithm for handling intrasession concept drift based on multimodal ipsilateral sensing. We evaluate the performance of our algorithm on data collected from five stroke subjects. Our results show that the proposed algorithm helps the device adapt to intrasession drift using unlabeled data and reduces the training burden placed on the user. We also validate the feasibility of our proposed algorithm with a functional task; in these experiments, two subjects successfully completed multiple instances of a pick-and-handover task.
Collapse
Affiliation(s)
- Jingxi Xu
- Department of Computer Science, Columbia University, New York, NY 10027, USA
| | - Cassie Meeker
- Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA
| | - Ava Chen
- Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA
| | - Lauren Winterbottom
- Department of Rehabilitation and Regenerative Medicine, Columbia University, New York, NY 10032, USA
| | - Michaela Fraser
- Department of Rehabilitation and Regenerative Medicine, Columbia University, New York, NY 10032, USA
| | - Sangwoo Park
- Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA
| | - Lynne M Weber
- Department of Rehabilitation and Regenerative Medicine, Columbia University, New York, NY 10032, USA
| | - Mitchell Miya
- Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA
| | - Dawn Nilsen
- Department of Rehabilitation and Regenerative Medicine, Columbia University, New York, NY 10032, USA
- Co-Principal Investigators
| | - Joel Stein
- Department of Rehabilitation and Regenerative Medicine, Columbia University, New York, NY 10032, USA
- Co-Principal Investigators
| | - Matei Ciocarlie
- Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA
- Co-Principal Investigators
| |
Collapse
|
15
|
Chen X, Lohlein S, Nassour J, Ehrlich SK, Berberich N, Cheng G. Visually-guided Grip Selection for Soft-Hand Exoskeleton. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4713-4716. [PMID: 34892264 DOI: 10.1109/embc46164.2021.9629982] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This paper presents a visually-guided grip selection based on the combination of object recognition and tactile feedback of a soft-hand exoskeleton intended for hand rehabilitation. A pre-trained neural network is used to recognize the object in front of the hand exoskeleton, which is then mapped to a suitable grip type. With the object cue, it actively assists users in performing different grip movements without calibration. In a pilot experiment, one healthy user completed four different grasp-and-move tasks repeatedly. All trials were completed within 25 seconds and only one out of 20 trials failed. This shows that automated movement training can be achieved by visual guidance even without biomedical sensors. In particular, in the private setting at home without clinical supervision, it is a powerful tool for repetitive training of daily-living activities.
Collapse
|
16
|
Prediction of Myoelectric Biomarkers in Post-Stroke Gait. SENSORS 2021; 21:s21165334. [PMID: 34450776 PMCID: PMC8399186 DOI: 10.3390/s21165334] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/05/2021] [Accepted: 08/05/2021] [Indexed: 12/17/2022]
Abstract
Electromyography (EMG) is sensitive to neuromuscular changes resulting from ischemic stroke and is considered a potential predictive tool of post-stroke gait and rehabilitation management. This study aimed to evaluate the potential myoelectric biomarkers for the classification of stroke-impaired muscular activity of the stroke patient group and the muscular activity of the control healthy adult group. We also proposed an EMG-based gait monitoring system consisting of a portable EMG device, cloud-based data processing, data analytics, and a health advisor service. This system was investigated with 48 stroke patients (mean age 70.6 years, 65% male) admitted into the emergency unit of a hospital and 75 healthy elderly volunteers (mean age 76.3 years, 32% male). EMG was recorded during walking using the portable device at two muscle positions: the bicep femoris muscle and the lateral gastrocnemius muscle of both lower limbs. The statistical result showed that the mean power frequency (MNF), median power frequency (MDF), peak power frequency (PKF), and mean power (MNP) of the stroke group differed significantly from those of the healthy control group. In the machine learning analysis, the neural network model showed the highest classification performance (precision: 88%, specificity: 89%, accuracy: 80%) using the training dataset and highest classification performance (precision: 72%, specificity: 74%, accuracy: 65%) using the testing dataset. This study will be helpful to understand stroke-impaired gait changes and decide post-stroke rehabilitation.
Collapse
|
17
|
Zhou H, Zhang Q, Zhang M, Shahnewaz S, Wei S, Ruan J, Zhang X, Zhang L. Toward Hand Pattern Recognition in Assistive and Rehabilitation Robotics Using EMG and Kinematics. Front Neurorobot 2021; 15:659876. [PMID: 34054455 PMCID: PMC8155590 DOI: 10.3389/fnbot.2021.659876] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Accepted: 04/09/2021] [Indexed: 11/13/2022] Open
Abstract
Wearable hand robots are becoming an attractive means in the facilitating of assistance with daily living and hand rehabilitation exercises for patients after stroke. Pattern recognition is a crucial step toward the development of wearable hand robots. Electromyography (EMG) is a commonly used biological signal for hand pattern recognition. However, the EMG based pattern recognition performance in assistive and rehabilitation robotics post stroke remains unsatisfactory. Moreover, low cost kinematic sensors such as Leap Motion is recently used for pattern recognition in various applications. This study proposes feature fusion and decision fusion method that combines EMG features and kinematic features for hand pattern recognition toward application in upper limb assistive and rehabilitation robotics. Ten normal subjects and five post stroke patients participating in the experiments were tested with eight hand patterns of daily activities while EMG and kinematics were recorded simultaneously. Results showed that average hand pattern recognition accuracy for post stroke patients was 83% for EMG features only, 84.71% for kinematic features only, 96.43% for feature fusion of EMG and kinematics, 91.18% for decision fusion of EMG and kinematics. The feature fusion and decision fusion was robust as three different levels of noise was given to the classifiers resulting in small decrease of classification accuracy. Different channel combination comparisons showed the fusion classifiers would be robust despite failure of specific EMG channels which means that the system has promising potential in the field of assistive and rehabilitation robotics. Future work will be conducted with real-time pattern classification on stroke survivors.
Collapse
Affiliation(s)
- Hui Zhou
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Qianqian Zhang
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Mengjun Zhang
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Sameer Shahnewaz
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Shaocong Wei
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Jingzhi Ruan
- School of Automation, Nanjing University of Science and Technology, Nanjing, China
| | - Xinyan Zhang
- Affiliated Nanjing Brain Hospital, Nanjing Medical University, Nanjing, China
| | - Lingling Zhang
- Affiliated Nanjing Brain Hospital, Nanjing Medical University, Nanjing, China
| |
Collapse
|
18
|
Jiang S, Kang P, Song X, Lo B, Shull P. Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey. IEEE Rev Biomed Eng 2021; 15:85-102. [PMID: 33961564 DOI: 10.1109/rbme.2021.3078190] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Hands are vital in a wide range of fundamental daily activities, and neurological diseases that impede hand function can significantly affect quality of life. Wearable hand gesture interfaces hold promise to restore and assist hand function and to enhance human-human and human-computer communication. The purpose of this review is to synthesize current novel sensing interfaces and algorithms for hand gesture recognition, and the scope of applications covers rehabilitation, prosthesis control, sign language recognition, and human-computer interaction. Results showed that electrical, dynamic, acoustical/vibratory, and optical sensing were the primary input modalities in gesture recognition interfaces. Two categories of algorithms were identified: 1) classification algorithms for predefined, fixed hand poses and 2) regression algorithms for continuous finger and wrist joint angles. Conventional machine learning algorithms, including linear discriminant analysis, support vector machines, random forests, and non-negative matrix factorization, have been widely used for a variety of gesture recognition applications, and deep learning algorithms have more recently been applied to further facilitate the complex relationship between sensor signals and multi-articulated hand postures. Future research should focus on increasing recognition accuracy with larger hand gesture datasets, improving reliability and robustness for daily use outside of the laboratory, and developing softer, less obtrusive interfaces.
Collapse
|
19
|
Decoding of Ankle Joint Movements in Stroke Patients Using Surface Electromyography. SENSORS 2021; 21:s21051575. [PMID: 33668229 PMCID: PMC7956677 DOI: 10.3390/s21051575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 02/18/2021] [Accepted: 02/19/2021] [Indexed: 01/29/2023]
Abstract
Stroke is a cerebrovascular disease (CVD), which results in hemiplegia, paralysis, or death. Conventionally, a stroke patient requires prolonged sessions with physical therapists for the recovery of motor function. Various home-based rehabilitative devices are also available for upper limbs and require minimal or no assistance from a physiotherapist. However, there is no clinically proven device available for functional recovery of a lower limb. In this study, we explored the potential use of surface electromyography (sEMG) as a controlling mechanism for the development of a home-based lower limb rehabilitative device for stroke patients. In this experiment, three channels of sEMG were used to record data from 11 stroke patients while performing ankle joint movements. The movements were then decoded from the sEMG data and their correlation with the level of motor impairment was investigated. The impairment level was quantified using the Fugl-Meyer Assessment (FMA) scale. During the analysis, Hudgins time-domain features were extracted and classified using linear discriminant analysis (LDA) and artificial neural network (ANN). On average, 63.86% ± 4.3% and 67.1% ± 7.9% of the movements were accurately classified in an offline analysis by LDA and ANN, respectively. We found that in both classifiers, some motions outperformed others (p < 0.001 for LDA and p = 0.014 for ANN). The Spearman correlation (ρ) was calculated between the FMA scores and classification accuracies. The results indicate that there is a moderately positive correlation (ρ = 0.75 for LDA and ρ = 0.55 for ANN) between the two of them. The findings of this study suggest that a home-based EMG system can be developed to provide customized therapy for the improvement of functional lower limb motion in stroke patients.
Collapse
|
20
|
Yurkewich A, Kozak IJ, Ivanovic A, Rossos D, Wang RH, Hebert D, Mihailidis A. Myoelectric untethered robotic glove enhances hand function and performance on daily living tasks after stroke. J Rehabil Assist Technol Eng 2020; 7:2055668320964050. [PMID: 33403121 PMCID: PMC7745545 DOI: 10.1177/2055668320964050] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Accepted: 09/02/2020] [Indexed: 02/06/2023] Open
Abstract
Introduction Wearable robots controlled using electromyography could motivate greater use of the affected upper extremity after stroke and enable bimanual activities of daily living to be completed independently. Methods We have developed a myoelectric untethered robotic glove (My-HERO) that provides five-finger extension and grip assistance. Results The myoelectric controller detected the grip and release intents of the 9 participants after stroke with 84.7% accuracy. While using My-HERO, all 9 participants performed better on the Fugl-Meyer Assessment-Hand (8.4 point increase, scale out of 14, p < 0.01) and the Chedoke Arm and Hand Activity Inventory (8.2 point increase, scale out of 91, p < 0.01). Established criteria for clinically meaningful important differences were surpassed for both the hand function and daily living task assessments. The majority of participants provided satisfaction and usability questionnaire scores above 70%. Seven participants desired to use My-HERO in the clinic and at home during their therapy and daily routines. Conclusions People with hand impairment after stroke value that myoelectric untethered robotic gloves enhance their motion and bimanual task performance and motivate them to use their muscles during engaging activities of daily living. They desire to use these gloves daily to enable greater independence and investigate the effects on neuromuscular recovery.
Collapse
Affiliation(s)
- Aaron Yurkewich
- Toronto Rehabilitation Institute-KITE, University Health Network, Toronto, Canada.,Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Canada.,Bioengineering, Imperial College London, London, UK
| | - Illya J Kozak
- Toronto Rehabilitation Institute-KITE, University Health Network, Toronto, Canada
| | - Andrei Ivanovic
- Faculty of Applied Science and Engineering, University of Toronto, Toronto, Canada
| | - Daniel Rossos
- Faculty of Applied Science and Engineering, University of Toronto, Toronto, Canada
| | - Rosalie H Wang
- Toronto Rehabilitation Institute-KITE, University Health Network, Toronto, Canada.,Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| | - Debbie Hebert
- Toronto Rehabilitation Institute-KITE, University Health Network, Toronto, Canada.,Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| | - Alex Mihailidis
- Toronto Rehabilitation Institute-KITE, University Health Network, Toronto, Canada.,Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| |
Collapse
|
21
|
Jochumsen M, Niazi IK, Zia ur Rehman M, Amjad I, Shafique M, Gilani SO, Waris A. Decoding Attempted Hand Movements in Stroke Patients Using Surface Electromyography. SENSORS 2020; 20:s20236763. [PMID: 33256073 PMCID: PMC7730601 DOI: 10.3390/s20236763] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 11/17/2020] [Accepted: 11/25/2020] [Indexed: 11/16/2022]
Abstract
Brain- and muscle-triggered exoskeletons have been proposed as a means for motor training after a stroke. With the possibility of performing different movement types with an exoskeleton, it is possible to introduce task variability in training. It is difficult to decode different movement types simultaneously from brain activity, but it may be possible from residual muscle activity that many patients have or quickly regain. This study investigates whether nine different motion classes of the hand and forearm could be decoded from forearm EMG in 15 stroke patients. This study also evaluates the test-retest reliability of a classical, but simple, classifier (linear discriminant analysis) and advanced, but more computationally intensive, classifiers (autoencoders and convolutional neural networks). Moreover, the association between the level of motor impairment and classification accuracy was tested. Three channels of surface EMG were recorded during the following motion classes: Hand Close, Hand Open, Wrist Extension, Wrist Flexion, Supination, Pronation, Lateral Grasp, Pinch Grasp, and Rest. Six repetitions of each motion class were performed on two different days. Hudgins time-domain features were extracted and classified using linear discriminant analysis and autoencoders, and raw EMG was classified with convolutional neural networks. On average, 79 ± 12% and 80 ± 12% (autoencoders) of the movements were correctly classified for days 1 and 2, respectively, with an intraclass correlation coefficient of 0.88. No association was found between the level of motor impairment and classification accuracy (Spearman correlation: 0.24). It was shown that nine motion classes could be decoded from residual EMG, with autoencoders being the best classification approach, and that the results were reliable across days; this may have implications for the development of EMG-controlled exoskeletons for training in the patient’s home.
Collapse
Affiliation(s)
- Mads Jochumsen
- Department of Health Science and Technology, Aalborg University, 9220 Aalborg Øst, Denmark;
- Correspondence:
| | - Imran Khan Niazi
- Department of Health Science and Technology, Aalborg University, 9220 Aalborg Øst, Denmark;
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand;
- Health and Rehabilitation Research Institute, AUT University, Auckland 1010, New Zealand
| | - Muhammad Zia ur Rehman
- Faculty of Rehabilitation and Allied Sciences & Faculty of Engineering and Applied Sciences, Riphah International University, Islamabad 44000, Pakistan; (M.Z.u.R.); (M.S.)
| | - Imran Amjad
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand;
- Faculty of Rehabilitation and Allied Sciences & Faculty of Engineering and Applied Sciences, Riphah International University, Islamabad 44000, Pakistan; (M.Z.u.R.); (M.S.)
| | - Muhammad Shafique
- Faculty of Rehabilitation and Allied Sciences & Faculty of Engineering and Applied Sciences, Riphah International University, Islamabad 44000, Pakistan; (M.Z.u.R.); (M.S.)
| | - Syed Omer Gilani
- Department of Biomedical Engineering & Sciences, School of Mechanical & Manufacturing Engineering, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (S.O.G.); (A.W.)
| | - Asim Waris
- Department of Biomedical Engineering & Sciences, School of Mechanical & Manufacturing Engineering, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (S.O.G.); (A.W.)
| |
Collapse
|
22
|
Generalized Finger Motion Classification Model Based on Motor Unit Voting. Motor Control 2020; 25:100-116. [PMID: 33207316 DOI: 10.1123/mc.2020-0041] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 09/02/2020] [Accepted: 09/13/2020] [Indexed: 01/12/2023]
Abstract
Surface electromyogram-based finger motion classification has shown its potential for prosthetic control. However, most current finger motion classification models are subject-specific, requiring calibration when applied to new subjects. Generalized subject-nonspecific models are essential for real-world applications. In this study, the authors developed a subject-nonspecific model based on motor unit (MU) voting. A high-density surface electromyogram was first decomposed into individual MUs. The features extracted from each MU were then fed into a random forest classifier to obtain the finger label (primary prediction). The final prediction was selected by voting for all primary predictions provided by the decomposed MUs. Experiments conducted on 14 subjects demonstrated that our method significantly outperformed traditional methods in the context of subject-nonspecific finger motion classification models.
Collapse
|
23
|
Comparison of Particle Filter to Established Filtering Methods in Electromyography Biofeedback. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101949] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
24
|
|
25
|
Yurkewich A, Kozak IJ, Hebert D, Wang RH, Mihailidis A. Hand Extension Robot Orthosis (HERO) Grip Glove: enabling independence amongst persons with severe hand impairments after stroke. J Neuroeng Rehabil 2020; 17:33. [PMID: 32102668 PMCID: PMC7045638 DOI: 10.1186/s12984-020-00659-5] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Accepted: 02/13/2020] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND The Hand Extension Robot Orthosis (HERO) Grip Glove was iteratively designed to meet requests from therapists and persons after a stroke who have severe hand impairment to create a device that extends all five fingers, enhances grip strength and is portable, lightweight, easy to put on, comfortable and affordable. METHODS Eleven persons who have minimal or no active finger extension (Chedoke McMaster Stage of Hand 1-4) post-stroke were recruited to evaluate how well they could perform activities of daily living and finger function assessments with and without wearing the HERO Grip Glove. RESULTS The 11 participants showed statistically significant improvements (p < 0.01), while wearing the HERO Grip Glove, in the water bottle grasp and manipulation task (increase of 2.3 points, SD 1.2, scored using the Chedoke Hand and Arm Inventory scale from 1 to 7) and in index finger extension (increase of 147o, SD 44) and range of motion (increase of 145o, SD 36). The HERO Grip Glove provided 12.7 N (SD 8.9 N) of grip force and 11.0 N (SD 4.8) of pinch force to their affected hands, which enabled those without grip strength to grasp and manipulate blocks, a fork and a water bottle, as well as write with a pen. The participants were 'more or less satisfied' with the HERO Grip Glove as an assistive device (average of 3.3 out of 5 on the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 Scale). The highest satisfaction scores were given for safety and security (4.6) and ease of use (3.8) and the lowest satisfaction scores were given for ease of donning (2.3), which required under 5 min with assistance. The most common requests were for greater grip strength and a smaller glove size for small hands. CONCLUSIONS The HERO Grip Glove is a safe and effective tool for enabling persons with a stroke that have severe hand impairment to incorporate their affected hand into activities of daily living, which may motivate greater use of the affected upper extremity in daily life to stimulate neuromuscular recovery.
Collapse
Affiliation(s)
- Aaron Yurkewich
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Canada.
- University Health Network - Toronto Rehabilitation Institute - KITE, Toronto, Canada.
- Bioengineering, Imperial College London, London, UK.
| | - Illya J Kozak
- University Health Network - Toronto Rehabilitation Institute - KITE, Toronto, Canada
| | - Debbie Hebert
- University Health Network - Toronto Rehabilitation Institute - KITE, Toronto, Canada
- Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| | - Rosalie H Wang
- University Health Network - Toronto Rehabilitation Institute - KITE, Toronto, Canada
- Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| | - Alex Mihailidis
- University Health Network - Toronto Rehabilitation Institute - KITE, Toronto, Canada
- Occupational Science and Occupational Therapy, University of Toronto, Toronto, Canada
| |
Collapse
|
26
|
Flexible Approach for Classifying EMG Signals for Rehabilitation Applications. NEUROPHYSIOLOGY+ 2020. [DOI: 10.1007/s11062-020-09851-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
27
|
Bos RA, Nizamis K, Koopman BFJM, Herder JL, Sartori M, Plettenburg DH. A Case Study With Symbihand: An sEMG-Controlled Electrohydraulic Hand Orthosis for Individuals With Duchenne Muscular Dystrophy. IEEE Trans Neural Syst Rehabil Eng 2019; 28:258-266. [PMID: 31825868 DOI: 10.1109/tnsre.2019.2952470] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
With recent improvements in healthcare, individuals with Duchenne muscular dystrophy (DMD) have prolonged life expectancy, and it is therefore vital to preserve their independence. Hand function plays a central role in maintaining independence in daily living. This requires sufficient grip force and the ability to modulate it with no substantially added effort. Individuals with DMD have low residual grip force and its modulation is challenging and fatiguing. To assist their hand function, we developed a novel dynamic hand orthosis called SymbiHand, where the user's hand motor intention is decoded by means of surface electromyography, enabling the control of an electrohydraulic pump for actuation. Mechanical work is transported using hydraulic transmission and flexible structures to redirect interaction forces, enhancing comfort by minimizing shear forces. This paper outlines SymbiHand's design and control, and a case study with an individual with DMD. Results show that SymbiHand increased the participant's maximum grasping force from 2.4 to 8 N. During a grasping force-tracking task, muscular activation was decreased by more than 40% without compromising task performance. These results suggest that SymbiHand has the potential to decrease muscular activation and increase grasping force for individuals with DMD, adding to the hand a total mass of no more than 241 g. Changes in mass distributions and an active thumb support are necessary for improved usability, in addition to larger-scale studies for generalizing its assistive potential.
Collapse
|
28
|
Maceira-Elvira P, Popa T, Schmid AC, Hummel FC. Wearable technology in stroke rehabilitation: towards improved diagnosis and treatment of upper-limb motor impairment. J Neuroeng Rehabil 2019; 16:142. [PMID: 31744553 PMCID: PMC6862815 DOI: 10.1186/s12984-019-0612-y] [Citation(s) in RCA: 90] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 10/24/2019] [Indexed: 01/19/2023] Open
Abstract
Stroke is one of the main causes of long-term disability worldwide, placing a large burden on individuals and society. Rehabilitation after stroke consists of an iterative process involving assessments and specialized training, aspects often constrained by limited resources of healthcare centers. Wearable technology has the potential to objectively assess and monitor patients inside and outside clinical environments, enabling a more detailed evaluation of the impairment and allowing the individualization of rehabilitation therapies. The present review aims to provide an overview of wearable sensors used in stroke rehabilitation research, with a particular focus on the upper extremity. We summarize results obtained by current research using a variety of wearable sensors and use them to critically discuss challenges and opportunities in the ongoing effort towards reliable and accessible tools for stroke rehabilitation. Finally, suggestions concerning data acquisition and processing to guide future studies performed by clinicians and engineers alike are provided.
Collapse
Affiliation(s)
- Pablo Maceira-Elvira
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL), 9, Chemin des Mines, 1202, Geneva, Switzerland
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL Valais), Clinique Romande de Réadaptation, 1951, Sion, Switzerland
| | - Traian Popa
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL), 9, Chemin des Mines, 1202, Geneva, Switzerland
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL Valais), Clinique Romande de Réadaptation, 1951, Sion, Switzerland
| | - Anne-Christine Schmid
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL), 9, Chemin des Mines, 1202, Geneva, Switzerland
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL Valais), Clinique Romande de Réadaptation, 1951, Sion, Switzerland
| | - Friedhelm C Hummel
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL), 9, Chemin des Mines, 1202, Geneva, Switzerland.
- Defitech Chair in Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL Valais), Clinique Romande de Réadaptation, 1951, Sion, Switzerland.
- Clinical Neuroscience, University of Geneva Medical School, 1202, Geneva, Switzerland.
| |
Collapse
|
29
|
Intuitive neuromyoelectric control of a dexterous bionic arm using a modified Kalman filter. J Neurosci Methods 2019; 330:108462. [PMID: 31711883 DOI: 10.1016/j.jneumeth.2019.108462] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2019] [Revised: 09/27/2019] [Accepted: 10/07/2019] [Indexed: 11/24/2022]
Abstract
BACKGROUND Multi-articulate prostheses are capable of performing dexterous hand movements. However, clinically available control strategies fail to provide users with intuitive, independent and proportional control over multiple degrees of freedom (DOFs) in real-time. NEW METHOD We detail the use of a modified Kalman filter (MKF) to provide intuitive, independent and proportional control over six-DOF prostheses such as the DEKA "LUKE" arm. Input features include neural firing rates recorded from Utah Slanted Electrode Arrays and mean absolute value of intramuscular electromyographic (EMG) recordings. Ad-hoc modifications include thresholds and non-unity gains on the output of a Kalman filter. RESULTS We demonstrate that both neural and EMG data can be combined effectively. We also highlight that modifications can be optimized to significantly improve performance relative to an unmodified Kalman filter. Thresholds significantly reduced unintended movement and promoted more independent control of the different DOFs. Gains were significantly greater than one and served to ease movement initiation. Optimal modifications can be determined quickly offline and translate to functional improvements online. Using a portable take-home system, participants performed various activities of daily living. COMPARISON WITH EXISTING METHODS In contrast to pattern recognition, the MKF allows users to continuously modulate their force output, which is critical for fine dexterity. The MKF is also computationally efficient and can be trained in less than five minutes. CONCLUSIONS The MKF can be used to explore the functional and psychological benefits associated with long-term, at-home control of dexterous prosthetic hands.
Collapse
|
30
|
van Ommeren AL, Sawaryn B, Prange-Lasonder GB, Buurke JH, Rietman JS, Veltink PH. Detection of the Intention to Grasp During Reaching in Stroke Using Inertial Sensing. IEEE Trans Neural Syst Rehabil Eng 2019; 27:2128-2134. [DOI: 10.1109/tnsre.2019.2939202] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
31
|
Lyu M, Chen WH, Ding X, Wang J, Pei Z, Zhang B. Development of an EMG-Controlled Knee Exoskeleton to Assist Home Rehabilitation in a Game Context. Front Neurorobot 2019; 13:67. [PMID: 31507400 PMCID: PMC6718718 DOI: 10.3389/fnbot.2019.00067] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Accepted: 08/06/2019] [Indexed: 12/13/2022] Open
Abstract
As a leading cause of loss of functional movement, stroke often makes it difficult for patients to walk. Interventions to aid motor recovery in stroke patients should be carried out as a matter of urgency. However, muscle activity in the knee is usually too weak to generate overt movements, which poses a challenge for early post-stroke rehabilitation training. Although electromyography (EMG)-controlled exoskeletons have the potential to solve this problem, most existing robotic devices in rehabilitation centers are expensive, technologically complex, and allow only low training intensity. To address these problems, we have developed an EMG-controlled knee exoskeleton for use at home to assist stroke patients in their rehabilitation. EMG signals of the subject are acquired by an easy-to-don EMG sensor and then processed by a Kalman filter to control the exoskeleton autonomously. A newly-designed game is introduced to improve rehabilitation by encouraging patients' involvement in the training process. Six healthy subjects took part in an initial test of this new training tool. The test showed that subjects could use their EMG signals to control the exoskeleton to assist them in playing the game. Subjects found the rehabilitation process interesting, and they improved their control performance through 20-block training, with game scores increasing from 41.3 ± 15.19 to 78.5 ± 25.2. The setup process was simplified compared to traditional studies and took only 72 s according to test on one healthy subject. The time lag of EMG signal processing, which is an important aspect for real-time control, was significantly reduced to about 64 ms by employing a Kalman filter, while the delay caused by the exoskeleton was about 110 ms. This easy-to-use rehabilitation tool has a greatly simplified training process and allows patients to undergo rehabilitation in a home environment without the need for a therapist to be present. It has the potential to improve the intensity of rehabilitation and the outcomes for stroke patients in the initial phase of rehabilitation.
Collapse
Affiliation(s)
- Mingxing Lyu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
- Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Wei-Hai Chen
- College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao, China
| | - Xilun Ding
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| | - Jianhua Wang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Zhongcai Pei
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Baochang Zhang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| |
Collapse
|
32
|
Liu J, Ren Y, Xu D, Kang SH, Zhang LQ. EMG-Based Real-Time Linear-Nonlinear Cascade Regression Decoding of Shoulder, Elbow, and Wrist Movements in Able-Bodied Persons and Stroke Survivors. IEEE Trans Biomed Eng 2019; 67:1272-1281. [PMID: 31425016 DOI: 10.1109/tbme.2019.2935182] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE This study aimed to decode shoulder, elbow and wrist dynamic movements continuously and simultaneously based on multi-channel surface electromyography signals, useful for electromyography controlled exoskeleton robots for upper-limb rehabilitation. METHODS Ten able-bodied subjects and ten stroke subjects were instructed to voluntarily move the shoulder, elbow and wrist joints back and forth in a horizontal plane with an exoskeleton robot. The shoulder, elbow and wrist movements and surface electromyography signals from six muscles crossing the joints were recorded. A set of three parallel linear-nonlinear cascade decoders was developed to continuously estimate the selected shoulder, elbow and wrist movements based on a generalized linear model using the anterior deltoid, posterior deltoid, biceps brachii, long head triceps brachii, flexor carpi radialis, and extensor carpi radialis muscle electromyography signals as the model inputs. RESULTS The decoder performed well for both healthy and stroke populations. As movement smoothness decreased, decoding performance decreased for the stroke population. CONCLUSION The proposed method is capable of simultaneously and continuously estimating multi-joint movements of the human arm in real-time by characterizing the nonlinear mappings between muscle activity and kinematic signals based on linear regression. SIGNIFICANCE This may prove useful in developing myoelectric controlled exoskeletons for motor rehabilitation of neurological disorders.
Collapse
|
33
|
Lu Z, Zhou P. Hands-Free Human-Computer Interface Based on Facial Myoelectric Pattern Recognition. Front Neurol 2019; 10:444. [PMID: 31114539 PMCID: PMC6503102 DOI: 10.3389/fneur.2019.00444] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2018] [Accepted: 04/11/2019] [Indexed: 11/13/2022] Open
Abstract
Patients with no or limited hand function usually have difficulty in using conventional input devices such as a mouse or a touch screen. Having the ability of manipulating electronic devices can give patients full access to the digital world, thereby increasing their independence and confidence, and enriching their lives. In this study, a hands-free human-computer interface was developed in order to help patients manipulate computers using facial movements. Five facial movement patterns were detected by four electromyography (EMG) sensors, and classified using myoelectric pattern recognition algorithms. Facial movement patterns were mapped to cursor actions including movements in different directions and click. A typing task and a drawing task were designed in order to assess the interaction performance of the interface in daily use. Ten able-bodied subjects participated in the experiment. In the typing task, the median path efficiency was 80.4%, and the median input rate was 5.9 letters per minute. In the drawing task, the median time to accomplish was 239.9 s. Moreover, all the subjects achieved high classification accuracy (median: 98.0%). The interface driven by facial EMG achieved high performance, and will be assessed on patients with limited hand functions in the future.
Collapse
Affiliation(s)
- Zhiyuan Lu
- Department of Physical Medicine and Rehabilitation, University of Texas Health Science Center at Houston, and TIRR Memorial Hermann Research Center, Houston, TX, United States
| | - Ping Zhou
- Department of Physical Medicine and Rehabilitation, University of Texas Health Science Center at Houston, and TIRR Memorial Hermann Research Center, Houston, TX, United States
| |
Collapse
|
34
|
Ghassemi M, Triandafilou K, Barry A, Stoykov ME, Roth E, Mussa-Ivaldi FA, Kamper DG, Ranganathan R. Development of an EMG-Controlled Serious Game for Rehabilitation. IEEE Trans Neural Syst Rehabil Eng 2019; 27:283-292. [PMID: 30668478 PMCID: PMC6611670 DOI: 10.1109/tnsre.2019.2894102] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
A majority of the seven million stroke survivors in the U.S. have hand impairments, adversely affecting performance of a variety of activities of daily living, because of the fundamental role of the hand in performing functional tasks. Disability in stroke survivors is largely attributable to damaged neuronal pathways, which result in inappropriate activation of muscles, a condition prevalent in distal upper extremity muscles following stroke. While conventional rehabilitation methods focus on the amplification of existing muscle activation, the effectiveness of therapy targeting the reorganization of pathological activation patterns is often unexplored. To encourage modulation of activation level and exploration of the activation workspace, we developed a novel platform for playing a serious game through electromyographic control. This system was evaluated by a group of neurologically intact subjects over multiple sessions held on different days. Subjects were assigned to one of two groups, training either with their non-dominant hand only (unilateral) or with both hands (bilateral). Both groups of subjects displayed improved performance in controlling the cursor with their non-dominant hand, with retention from one session to the next. The system holds promise for rehabilitation of control of muscle activation patterns.
Collapse
Affiliation(s)
- Mohammad Ghassemi
- Closed-Loop Engineering for Advanced Rehabilitation (CLEAR) core, Joint Department of Biomedical Engineering, University of North Carolina, Chapel Hill and North Carolina State University, Raleigh, NC 27695 USA ()
| | | | - Alex Barry
- Shirley Ryan AbilityLab, Chicago, IL 60611 USA ()
| | | | - Elliot Roth
- Shirley Ryan AbilityLab, Chicago, IL 60611 USA ()
| | - Ferdinando A. Mussa-Ivaldi
- Departments of Physiology and Biomedical Engineering of Northwestern University and the Shirley Ryan AbilityLab, Chicago, IL 60611 USA ()
| | - Derek G. Kamper
- CLEAR core, Joint Department of Biomedical Engineering, University of North Carolina, Chapel Hill, and North Carolina State University, Raleigh, NC 27695 USA ()
| | - Rajiv Ranganathan
- Department of Kinesiology, Michigan State University, East Lansing, MI 48824, USA ()
| |
Collapse
|
35
|
Bouteraa Y, Abdallah IB, Elmogy AM. Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-018-0966-6] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
36
|
Sarasola-Sanz A, Irastorza-Landa N, López-Larraz E, Shiman F, Spüler M, Birbaumer N, Ramos-Murguialday A. Design and effectiveness evaluation of mirror myoelectric interfaces: a novel method to restore movement in hemiplegic patients. Sci Rep 2018; 8:16688. [PMID: 30420779 PMCID: PMC6232088 DOI: 10.1038/s41598-018-34785-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Accepted: 10/22/2018] [Indexed: 12/29/2022] Open
Abstract
The motor impairment occurring after a stroke is characterized by pathological muscle activation patterns or synergies. However, while robot-aided myoelectric interfaces have been proposed for stroke rehabilitation, they do not address this issue, which might result in inefficient interventions. Here, we present a novel paradigm that relies on the correction of the pathological muscle activity as a way to elicit rehabilitation, even in patients with complete paralysis. Previous studies demonstrated that there are no substantial inter-limb differences in the muscle synergy organization of healthy individuals. We propose building a subject-specific model of muscle activity from the healthy limb and mirroring it to use it as a learning tool for the patient to reproduce the same healthy myoelectric patterns on the paretic limb during functional task training. Here, we aim at understanding how this myoelectric model, which translates muscle activity into continuous movements of a 7-degree of freedom upper limb exoskeleton, could transfer between sessions, arms and tasks. The experiments with 8 healthy individuals and 2 chronic stroke patients proved the feasibility and effectiveness of such myoelectric interface. We anticipate the proposed method to become an efficient strategy for the correction of maladaptive muscle activity and the rehabilitation of stroke patients.
Collapse
Affiliation(s)
- Andrea Sarasola-Sanz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany. .,International Max Planck Research School for Cognitive and Systems Neuroscience, Tübingen, Germany. .,Tecnalia, San Sebastián, Spain.
| | - Nerea Irastorza-Landa
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,International Max Planck Research School for Cognitive and Systems Neuroscience, Tübingen, Germany.,IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
| | - Eduardo López-Larraz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Farid Shiman
- Department of Neurology, Campus Mitte, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Martin Spüler
- Department of Computer Engineering, Wilhelm-Schickard-Institute, University of Tübingen, Tübingen, Germany
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Wyss Center, Geneve, Switzerland
| | - Ander Ramos-Murguialday
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.,Tecnalia, San Sebastián, Spain
| |
Collapse
|
37
|
EEG-Based Control for Upper and Lower Limb Exoskeletons and Prostheses: A Systematic Review. SENSORS 2018; 18:s18103342. [PMID: 30301238 PMCID: PMC6211123 DOI: 10.3390/s18103342] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2018] [Revised: 09/12/2018] [Accepted: 09/28/2018] [Indexed: 12/13/2022]
Abstract
Electroencephalography (EEG) signals have great impact on the development of assistive rehabilitation devices. These signals are used as a popular tool to investigate the functions and the behavior of the human motion in recent research. The study of EEG-based control of assistive devices is still in early stages. Although the EEG-based control of assistive devices has attracted a considerable level of attention over the last few years, few studies have been carried out to systematically review these studies, as a means of offering researchers and experts a comprehensive summary of the present, state-of-the-art EEG-based control techniques used for assistive technology. Therefore, this research has three main goals. The first aim is to systematically gather, summarize, evaluate and synthesize information regarding the accuracy and the value of previous research published in the literature between 2011 and 2018. The second goal is to extensively report on the holistic, experimental outcomes of this domain in relation to current research. It is systematically performed to provide a wealthy image and grounded evidence of the current state of research covering EEG-based control for assistive rehabilitation devices to all the experts and scientists. The third goal is to recognize the gap of knowledge that demands further investigation and to recommend directions for future research in this area.
Collapse
|
38
|
Irastorza-Landa N, Sarasola-Sanz A, Lopez-Larraz E, Bibian C, Shiman P, Birbaumer N, Ramos-Murguialday A. Design of continuous EMG classification approaches towards the control of a robotic exoskeleton in reaching movements. IEEE Int Conf Rehabil Robot 2018; 2017:128-133. [PMID: 28813806 DOI: 10.1109/icorr.2017.8009234] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Myoelectric control of rehabilitation devices engages active recruitment of muscles for motor task accomplishment, which has been proven to be essential in motor rehabilitation. Unfortunately, most electromyographic (EMG) activity-based controls are limited to one single degree-of-freedom (DoF), not permitting multi-joint functional tasks. On the other hand, discrete EMG-triggered approaches fail to provide continuous feedback about muscle recruitment during movement. For such purposes, myoelectric interfaces for continuous recognition of functional movements are necessary. Here we recorded EMG activity using 5 bipolar electrodes placed on the upper-arm in 8 healthy participants while they performed reaching movements in 8 different directions. A pseudo on-line system was developed to continuously predict movement intention and attempted arm direction. We evaluated two hierarchical classification approaches. Movement intention detection triggered different movement direction classifiers (4 or 8 classes) that were trained and tested over a 5-fold cross validation. We also investigated the effect of 3 different window lengths to extract EMG features on classification. We obtained classification accuracies above 70% for both hierarchical approaches. These results highlight the viability of classifying online 8 upper-arm different directions using surface EMG activity of 5 muscles and represent a first step towards an online EMG-based control for rehabilitation devices.
Collapse
|
39
|
Lu Z, Tong KY, Zhang X, Li S, Zhou P. Myoelectric Pattern Recognition for Controlling a Robotic Hand: A Feasibility Study in Stroke. IEEE Trans Biomed Eng 2018; 66:365-372. [PMID: 29993410 DOI: 10.1109/tbme.2018.2840848] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Myoelectric pattern recognition has been successfully applied as a human-machine interface to control robotic devices such as prostheses and exoskeletons, significantly improving the dexterity of myoelectric control. This study investigates the feasibility of applying myoelectric pattern recognition for controlling a robotic hand in stroke patients. METHODS Myoelectric pattern recognition of six hand motion patterns was performed using forearm electromyogram signals in paretic side of eight stroke subjects. Both the random cross validation (RCV) and the chronological handout validation (CHV) were applied to assess the offline myoelectric pattern recognition performance. Experiments on real-time myoelectric pattern recognition control of an exoskeleton robotic hand were also performed. RESULTS An average classification accuracy of 84.1% (the mean value from two different classifiers) and individual subject differences were observed in the offline myoelectric pattern recognition analysis using the RCV, while the accuracy decreased to 65.7% when the CHV was used. The stroke subjects achieved an average accuracy of 61.3 ± 20.9% for controlling the robotic hand. However, our study did not reveal a clear correlation between the real-time control accuracy and the offline myoelectric pattern recognition performance, or any specific characteristics of the stroke subjects. CONCLUSION The findings suggest that it is feasible to apply myoelectric pattern recognition to control the robotic hand in some but not all of the stroke patients. Each stroke subject should be individually online tested for the feasibility of applying myoelectric pattern recognition control for robot-assisted rehabilitation.
Collapse
|
40
|
Yang G, Deng J, Pang G, Zhang H, Li J, Deng B, Pang Z, Xu J, Jiang M, Liljeberg P, Xie H, Yang H. An IoT-Enabled Stroke Rehabilitation System Based on Smart Wearable Armband and Machine Learning. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2018; 6:2100510. [PMID: 29805919 PMCID: PMC5957264 DOI: 10.1109/jtehm.2018.2822681] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Revised: 02/12/2018] [Accepted: 03/16/2018] [Indexed: 11/16/2022]
Abstract
Surface electromyography signal plays an important role in hand function recovery training. In this paper, an IoT-enabled stroke rehabilitation system was introduced which was based on a smart wearable armband (SWA), machine learning (ML) algorithms, and a 3-D printed dexterous robot hand. User comfort is one of the key issues which should be addressed for wearable devices. The SWA was developed by integrating a low-power and tiny-sized IoT sensing device with textile electrodes, which can measure, pre-process, and wirelessly transmit bio-potential signals. By evenly distributing surface electrodes over user’s forearm, drawbacks of classification accuracy poor performance can be mitigated. A new method was put forward to find the optimal feature set. ML algorithms were leveraged to analyze and discriminate features of different hand movements, and their performances were appraised by classification complexity estimating algorithms and principal components analysis. According to the verification results, all nine gestures can be successfully identified with an average accuracy up to 96.20%. In addition, a 3-D printed five-finger robot hand was implemented for hand rehabilitation training purpose. Correspondingly, user’s hand movement intentions were extracted and converted into a series of commands which were used to drive motors assembled inside the dexterous robot hand. As a result, the dexterous robot hand can mimic the user’s gesture in a real-time manner, which shows the proposed system can be used as a training tool to facilitate rehabilitation process for the patients after stroke.
Collapse
Affiliation(s)
- Geng Yang
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Jia Deng
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Gaoyang Pang
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Hao Zhang
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Jiayi Li
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Bin Deng
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Zhibo Pang
- ABB Corporate Research721 78VästeråsSweden
| | - Juan Xu
- Department of GeriatricsThe 117th hospital of PLAHangzhou310013China
| | - Mingzhe Jiang
- Department of Future TechnologiesUniversity of Turku20500TurkuFinland
| | - Pasi Liljeberg
- Department of Future TechnologiesUniversity of Turku20500TurkuFinland
| | - Haibo Xie
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| | - Huayong Yang
- State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical EngineeringZhejiang UniversityHangzhou310058China
| |
Collapse
|
41
|
sEMG Signal Acquisition Strategy towards Hand FES Control. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:2350834. [PMID: 29732046 PMCID: PMC5872608 DOI: 10.1155/2018/2350834] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2017] [Revised: 12/01/2017] [Accepted: 12/27/2017] [Indexed: 12/23/2022]
Abstract
Due to damage of the nervous system, patients experience impediments in their daily life: severe fatigue, tremor or impaired hand dexterity, hemiparesis, or hemiplegia. Surface electromyography (sEMG) signal analysis is used to identify motion; however, standardization of electrode placement and classification of sEMG patterns are major challenges. This paper describes a technique used to acquire sEMG signals for five hand motion patterns from six able-bodied subjects using an array of recording and stimulation electrodes placed on the forearm and its effects over functional electrical stimulation (FES) and volitional sEMG combinations, in order to eventually control a sEMG-driven FES neuroprosthesis for upper limb rehabilitation. A two-part protocol was performed. First, personalized templates to place eight sEMG bipolar channels were designed; with these data, a universal template, called forearm electrode set (FELT), was built. Second, volitional and evoked movements were recorded during FES application. 95% classification accuracy was achieved using two sessions per movement. With the FELT, it was possible to perform FES and sEMG recordings simultaneously. Also, it was possible to extract the volitional and evoked sEMG from the raw signal, which is highly important for closed-loop FES control.
Collapse
|
42
|
Lyu M, Lambelet C, Woolley D, Zhang X, Chen W, Ding X, Gassert R, Wenderoth N. Training wrist extensor function and detecting unwanted movement strategies in an EMG-controlled visuomotor task. IEEE Int Conf Rehabil Robot 2018; 2017:1549-1555. [PMID: 28814040 DOI: 10.1109/icorr.2017.8009468] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Stroke patients often suffer from severe upper limb paresis. Rehabilitation treatment typically targets motor impairments as early as possible, however, muscular contractions, particularly in the wrist and fingers, are often too weak to produce overt movements, making the initial phase of rehabilitation training difficult. Here we propose a new training tool whereby electromyographic (EMG) activity is measured in the wrist extensors and serves as a proxy of voluntary corticomotor drive. We used the Myo armband to develop a proportional EMG controller which allowed volunteers to perform a simple visuomotor task by modulating wrist extensor activity. In this preliminary study six healthy participants practiced the task for one session (144 trials), which resulted in a significant reduction of the average trial time required to move and hold a cursor in different target zones (p < 0.001, ANOVA), indicating skill learning. Additionally, we implemented an EMG based classifier to distinguish between the desired movement strategy and unwanted alternatives. Validation of the classifier indicated that accuracy for detecting rest, wrist extension and unwanted strategies was 92.5 + 6.9% (M + SD) across all participants. When performing the motor task the classification algorithm flagged 4.3 + 3.5% of the trials as 'unwanted strategies', even in healthy subjects. We also report initial feedback from a survey submitted to two chronic stroke patients to inquire about feasibility and acceptance of the general setup by patients.
Collapse
|
43
|
Lee SW, Vermillion BC, Geed S, Dromerick AW, Kamper DG. Impact of Targeted Assistance of Multiarticular Finger Musculotendons on the Coordination of Finger Muscles During Isometric Force Production. IEEE Trans Neural Syst Rehabil Eng 2018; 26:619-628. [PMID: 29522406 PMCID: PMC5874132 DOI: 10.1109/tnsre.2018.2800052] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Neurological injuries often cause degraded motor control. While rehabilitation efforts typically focus on movement kinematics, abnormal muscle activation patterns are often the primary source of impairment. Muscle-based therapies are likely more effective than joint-based therapy. In this paper, we examined the feasibility of biomimetic input mimicking the action of human musculotendons in altering hand muscle coordination. Twelve healthy subjects produced a submaximal isometric dorsal fingertip force, while a custom actuator provided assistance mirroring the actions of either the extrinsic extensor or the intrinsic muscles of the index finger. The biomimetic inputs reduced the activation level of all task-related muscles, but the degree of change was different across the muscles, resulting in significant changes in their coordination (co-contraction ratios) and force-electromyography correlations. Each biomimetic assistance particularly increased the neural coupling between its targeted muscle and the antagonist muscle. Subjects appeared to fully take advantage of the assistance, as they provided minimal level of effort to achieve the task goal. The targeted biomimetic assistance may be used to retrain activation patterns post-stroke by effectively modulating connectivity between the muscles in the functional context and could be beneficial to restore hand function and reduce disability.
Collapse
|
44
|
Lendaro E, Ortiz-Catalan M. Classification of non-weight bearing lower limb movements: towards a potential treatment for phantom limb pain based on myoelectric pattern recognition. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:5457-5460. [PMID: 28269492 DOI: 10.1109/embc.2016.7591961] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Research in myoelectric pattern recognition (MPR) for the prediction of motor volition has primarily focused on the upper limbs. Recent studies in the lower limbs have mainly concentrated on prosthetic control, while MPR for lower limb rehabilitation purposes has received little attention. In this work we investigated the viability of a MPR system for the prediction of four degrees of freedom controlled in a near natural or physiologically appropriate fashion. We explored three different electrode configurations for acquiring electromyographic (EMG) signals: two targeted (bipolar and monopolar) and one untargeted (electrodes equally spaced axially). The targeted monopolar configuration yielded overall lower signal-to-noise ratios (SNR) but similar accuracy than those of the targeted bipolar configuration. The targeted bipolar and untargeted monopolar configurations were comparable in terms of SNR and offline accuracy when the same number of channels was used. However, the untargeted configuration tested with twice the channels yielded the best results in terms of accuracy. An advantage of the untargeted configuration is that it offers a simpler and more practical electrode placement. This work is the first step in our long-term goal of implementing a phantom limb pain (PLP) treatment for lower limb amputees based on MPR and augmented/virtual reality.
Collapse
|
45
|
Hesam-Shariati N, Trinh T, Thompson-Butel AG, Shiner CT, McNulty PA. A Longitudinal Electromyography Study of Complex Movements in Poststroke Therapy. 1: Heterogeneous Changes Despite Consistent Improvements in Clinical Assessments. Front Neurol 2017; 8:340. [PMID: 28804474 PMCID: PMC5532386 DOI: 10.3389/fneur.2017.00340] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Accepted: 06/29/2017] [Indexed: 12/29/2022] Open
Abstract
Poststroke weakness on the more-affected side may arise from reduced corticospinal drive, disuse muscle atrophy, spasticity, and abnormal coordination. This study investigated changes in muscle activation patterns to understand therapy-induced improvements in motor-function in chronic stroke compared to clinical assessments and to identify the effect of motor-function level on muscle activation changes. Electromyography (EMG) was recorded from five upper limb muscles on the more-affected side of 24 patients during early and late therapy sessions of an intensive 14-day program of Wii-based Movement Therapy (WMT) and for a subset of 13 patients at 6-month follow-up. Patients were classified according to residual voluntary motor capacity with low, moderate, or high motor-function levels. The area under the curve was calculated from EMG amplitude and movement duration. Clinical assessments of upper limb motor-function pre- and post-therapy included the Wolf Motor Function Test, Fugl-Meyer Assessment and Motor Activity Log Quality of Movement scale. Clinical assessments improved over time (p < 0.01) with an effect of motor-function level (p < 0.001). The pattern of EMG change by late therapy was complex and variable, with differences between patients with low compared to moderate or high motor-function levels. The area under the curve (p = 0.028) and peak amplitude (p = 0.043) during Wii-tennis backhand increased for patients with low motor-function, whereas EMG decreased for patients with moderate and high motor-function levels. The reductions included movement duration during Wii-golf (p = 0.048, moderate; p = 0.026, high) and Wii-tennis backhand (p = 0.046, moderate; p = 0.023, high) and forehand (p = 0.009, high) and the area under the curve during Wii-golf (p = 0.018, moderate) and Wii-baseball (p = 0.036, moderate). For the pooled data over time, there was an effect of motor-function (p = 0.016) and an interaction between time and motor-function (p = 0.009) for Wii-golf movement duration. Wii-baseball movement duration decreased as a function of time (p = 0.022). There was an effect on Wii-tennis forehand duration for time (p = 0.002), an interaction of time and motor-function (p = 0.005) and an effect of motor-function level on the area under the curve (p = 0.034) for Wii-golf. This study demonstrated different patterns of EMG changes according to residual voluntary motor-function levels, despite heterogeneity within each level that was not evident following clinical assessments alone. Thus, rehabilitation efficacy might be underestimated by analyses of pooled data.
Collapse
Affiliation(s)
- Negin Hesam-Shariati
- Neuroscience Research Australia, Sydney, NSW, Australia
- School of Medical Science, University of New South Wales, Sydney, NSW, Australia
| | - Terry Trinh
- Neuroscience Research Australia, Sydney, NSW, Australia
- School of Medical Science, University of New South Wales, Sydney, NSW, Australia
| | - Angelica G. Thompson-Butel
- Neuroscience Research Australia, Sydney, NSW, Australia
- School of Medical Science, University of New South Wales, Sydney, NSW, Australia
| | - Christine T. Shiner
- Neuroscience Research Australia, Sydney, NSW, Australia
- School of Medical Science, University of New South Wales, Sydney, NSW, Australia
| | - Penelope A. McNulty
- Neuroscience Research Australia, Sydney, NSW, Australia
- School of Medical Science, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
46
|
Sadarangani GP, Jiang X, Simpson LA, Eng JJ, Menon C. Force Myography for Monitoring Grasping in Individuals with Stroke with Mild to Moderate Upper-Extremity Impairments: A Preliminary Investigation in a Controlled Environment. Front Bioeng Biotechnol 2017; 5:42. [PMID: 28798912 PMCID: PMC5529400 DOI: 10.3389/fbioe.2017.00042] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2016] [Accepted: 07/03/2017] [Indexed: 11/24/2022] Open
Abstract
There is increasing research interest in technologies that can detect grasping, to encourage functional use of the hand as part of daily living, and thus promote upper-extremity motor recovery in individuals with stroke. Force myography (FMG) has been shown to be effective for providing biofeedback to improve fine motor function in structured rehabilitation settings, involving isolated repetitions of a single grasp type, elicited at a predictable time, without upper-extremity movements. The use of FMG, with machine learning techniques, to detect and distinguish between grasping and no grasping, continues to be an active area of research, in healthy individuals. The feasibility of classifying FMG for grasp detection in populations with upper-extremity impairments, in the presence of upper-extremity movements, as would be expected in daily living, has yet to be established. We explore the feasibility of FMG for this application by establishing and comparing (1) FMG-based grasp detection accuracy and (2) the amount of training data necessary for accurate grasp classification, in individuals with stroke and healthy individuals. FMG data were collected using a flexible forearm band, embedded with six force-sensitive resistors (FSRs). Eight participants with stroke, with mild to moderate upper-extremity impairments, and eight healthy participants performed 20 repetitions of three tasks that involved reaching, grasping, and moving an object in different planes of movement. A validation sensor was placed on the object to label data as corresponding to a grasp or no grasp. Grasp detection performance was evaluated using linear and non-linear classifiers. The effect of training set size on classification accuracy was also determined. FMG-based grasp detection demonstrated high accuracy of 92.2% (σ = 3.5%) for participants with stroke and 96.0% (σ = 1.6%) for healthy volunteers using a support vector machine (SVM). The use of a training set that was 50% the size of the testing set resulted in 91.7% (σ = 3.9%) accuracy for participants with stroke and 95.6% (σ = 1.6%) for healthy participants. These promising results indicate that FMG may be feasible for monitoring grasping, in the presence of upper-extremity movements, in individuals with stroke with mild to moderate upper-extremity impairments.
Collapse
Affiliation(s)
- Gautam P Sadarangani
- MENRVA Research Group, School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Xianta Jiang
- MENRVA Research Group, School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Lisa A Simpson
- Graduate Program in Rehabilitation Sciences, University of British Columbia, Vancouver, BC, Canada.,Rehabilitation Research Program, GF Strong Rehab Centre, Vancouver Coastal Health Research Institute, Vancouver, BC, Canada
| | - Janice J Eng
- Rehabilitation Research Program, GF Strong Rehab Centre, Vancouver Coastal Health Research Institute, Vancouver, BC, Canada.,Department of Physical Therapy, University of British Columbia, Vancouver, BC, Canada
| | - Carlo Menon
- MENRVA Research Group, School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
47
|
Electromyographic Bridge-a multi-movement volitional control method for functional electrical stimulation: prototype system design and experimental validation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:205-208. [PMID: 29059846 DOI: 10.1109/embc.2017.8036798] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The voluntary participation of the paralyzed patients is crucial for the functional electrical stimulation (FES) therapy. In this study, we developed a strategy called "EMG Bridge" (EMGB) for volitional control of multiple movements using FES technique. The surface electromyography (sEMG) signals of the agonist muscles were transformed to stimulation pulses with various pulse width and frequency to stimulate the target paralyzed muscles using MAV/NSS co-modulation (MNDC) algorithm we proposed recently. Motion pattern classification based on linear discriminant analysis (LDA) was included to recognize the motion status and mapping the sEMG detection channel to the corresponding stimulation channel. A prototype EMGB system was built for real-time control of four hand movements. The test results showed that the movements can be reproduced with a successful rate of 92.5±3.5%. The angle trajectory of wrist joint and metacarpal-phalangeal joint can be mimicked with a maximum cross-correlation coefficient > 0.84 and a latency less than 300 ms.
Collapse
|
48
|
Meeker C, Park S, Bishop L, Stein J, Ciocarlie M. EMG pattern classification to control a hand orthosis for functional grasp assistance after stroke. IEEE Int Conf Rehabil Robot 2017; 2017:1203-1210. [PMID: 28813985 DOI: 10.1109/icorr.2017.8009413] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Wearable orthoses can function both as assistive devices, which allow the user to live independently, and as rehabilitation devices, which allow the user to regain use of an impaired limb. To be fully wearable, such devices must have intuitive controls, and to improve quality of life, the device should enable the user to perform Activities of Daily Living. In this context, we explore the feasibility of using electromyography (EMG) signals to control a wearable exotendon device to enable pick and place tasks. We use an easy to don, commodity forearm EMG band with 8 sensors to create an EMG pattern classification control for an exotendon device. With this control, we are able to detect a user's intent to open, and can thus enable extension and pick and place tasks. In experiments with stroke survivors, we explore the accuracy of this control in both non-functional and functional tasks. Our results support the feasibility of developing wearable devices with intuitive controls which provide a functional context for rehabilitation.
Collapse
|
49
|
Ryser F, Butzer T, Held JP, Lambercy O, Gassert R. Fully embedded myoelectric control for a wearable robotic hand orthosis. IEEE Int Conf Rehabil Robot 2017; 2017:615-621. [PMID: 28813888 DOI: 10.1109/icorr.2017.8009316] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
To prevent learned non-use of the affected hand in chronic stroke survivors, rehabilitative training should be continued after discharge from the hospital. Robotic hand orthoses are a promising approach for home rehabilitation. When combined with intuitive control based on electromyography, the therapy outcome can be improved. However, such systems often require extensive cabling, experience in electrode placement and connection to external computers. This paper presents the framework for a stand-alone, fully wearable and real-time myoelectric intention detection system based on the Myo armband. The hard and software for real-time gesture classification were developed and combined with a routine to train and customize the classifier, leading to a unique ease of use. The system including training of the classifier can be set up within less than one minute. Results demonstrated that: (1) the proposed algorithm can classify five gestures with an accuracy of 98%, (2) the final system can online classify three gestures with an accuracy of 94.3% and, in a preliminary test, (3) classify three gestures from data acquired from mildly to severely impaired stroke survivors with an accuracy of over 78.8%. These results highlight the potential of the presented system for electromyography-based intention detection for stroke survivors and, with the integration of the system into a robotic hand orthosis, the potential for a wearable platform for all day robot-assisted home rehabilitation.
Collapse
|
50
|
McDonald CG, Dennis TA, O'Malley MK. Characterization of surface electromyography patterns of healthy and incomplete spinal cord injury subjects interacting with an upper-extremity exoskeleton. IEEE Int Conf Rehabil Robot 2017; 2017:164-169. [PMID: 28813812 DOI: 10.1109/icorr.2017.8009240] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Rehabilitation exoskeletons may make use of myoelectric control to restore in patients with significant motor impairment following a spinal cord injury (SCI) a sense of volitional control over their limb - a crucial component for recovery of movement. Little investigation has been done into the feasibility of using surface electromyography (sEMG) as an exoskeleton control interface for SCI patients, whose impairment manifests in a highly variable way across the patient population. We have demonstrated that by using only a small subset of features extracted from eight bipolar electrodes recording on the upper arm and forearm muscles, we can achieve high predictive accuracy for the intended direction of motion. Five healthy subjects and two SCI subjects performed voluntary isometric contractions while wearing an exoskeleton for the wrist and elbow joints, generating six distinct single and multi-DoF motions in a total of sixteen possible directions. Using linear discriminant analysis, classification performance was then evaluated using randomly selected holdout test data from the same recording session. Commonalities across subjects, both healthy and SCI, were analyzed at the levels of selected features and the values of commonly selected features. Future work will be to investigate group-specific classification of SCI subjects' intended movements for use in the real-time control of a rehabilitation exoskeleton.
Collapse
|