1
|
Teng Z, Xu G, Zhang X, Chen X, Zhang S, Huang HY. Concurrent and continuous estimation of multi-finger forces by synergy mapping and reconstruction: a pilot study. J Neural Eng 2023; 20:066024. [PMID: 38029436 DOI: 10.1088/1741-2552/ad10d1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 11/29/2023] [Indexed: 12/01/2023]
Abstract
Objective.The absence of intuitive control in present myoelectric interfaces makes it a challenge for users to communicate with assistive devices efficiently in real-world conditions. This study aims to tackle this difficulty by incorporating neurophysiological entities, namely muscle and force synergies, onto multi-finger force estimation to allow intuitive myoelectric control.Approach. Eleven healthy subjects performed six isometric grasping tasks at three muscle contraction levels. The exerted fingertip forces were collected concurrently with the surface electromyographic (sEMG) signals from six extrinsic and intrinsic muscles of hand. Muscle synergies were then extracted from recorded sEMG signals, while force synergies were identified from measured force data. Afterwards, a linear regressor was trained to associate the two types of synergies. This would allow us to predict multi-finger forces simply by multiplying the activation signals derived from muscle synergies with the weighting matrix of initially identified force synergies. To mitigate the false activation of unintended fingers, the force predictions were finally corrected by a finger state recognition procedure.Main results. We found that five muscle synergies and four force synergies are able to make a tradeoff between the computation load and the prediction accuracy for the proposed model; When trained and tested on all six grasping tasks, our method (SYN-II) achieved better performance (R2= 0.80 ± 0.04, NRMSE = 0.19 ± 0.01) than conventional sEMG amplitude-based method; Interestingly, SYN-II performed better than all other methods when tested on two unknown tasks outside the four training tasks (R2= 0.74 ± 0.03, NRMSE = 0.22 ± 0.02), which indicated better generalization ability.Significance. This study shows the first attempt to link between muscle and force synergies to allow concurrent and continuous estimation of multi-finger forces from sEMG. The proposed approach may lay the foundation for high-performance myoelectric interfaces that allow users to control robotic hands in a more natural and intuitive manner.
Collapse
Affiliation(s)
- Zhicheng Teng
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Guanghua Xu
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Xun Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Xiaobi Chen
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Sicong Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Hsien-Yung Huang
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
2
|
Zhao K, Wen H, Zhang Z, Atzori M, Müller H, Xie Z, Scano A. Evaluation of Methods for the Extraction of Spatial Muscle Synergies. Front Neurosci 2022; 16:732156. [PMID: 35720729 PMCID: PMC9202610 DOI: 10.3389/fnins.2022.732156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 05/04/2022] [Indexed: 11/18/2022] Open
Abstract
Muscle synergies have been largely used in many application fields, including motor control studies, prosthesis control, movement classification, rehabilitation, and clinical studies. Due to the complexity of the motor control system, the full repertoire of the underlying synergies has been identified only for some classes of movements and scenarios. Several extraction methods have been used to extract muscle synergies. However, some of these methods may not effectively capture the nonlinear relationship between muscles and impose constraints on input signals or extracted synergies. Moreover, other approaches such as autoencoders (AEs), an unsupervised neural network, were recently introduced to study bioinspired control and movement classification. In this study, we evaluated the performance of five methods for the extraction of spatial muscle synergy, namely, principal component analysis (PCA), independent component analysis (ICA), factor analysis (FA), nonnegative matrix factorization (NMF), and AEs using simulated data and a publicly available database. To analyze the performance of the considered extraction methods with respect to several factors, we generated a comprehensive set of simulated data (ground truth), including spatial synergies and temporal coefficients. The signal-to-noise ratio (SNR) and the number of channels (NoC) varied when generating simulated data to evaluate their effects on ground truth reconstruction. This study also tested the efficacy of each synergy extraction method when coupled with standard classification methods, including K-nearest neighbors (KNN), linear discriminant analysis (LDA), support vector machines (SVM), and Random Forest (RF). The results showed that both SNR and NoC affected the outputs of the muscle synergy analysis. Although AEs showed better performance than FA in variance accounted for and PCA in synergy vector similarity and activation coefficient similarity, NMF and ICA outperformed the other three methods. Classification tasks showed that classification algorithms were sensitive to synergy extraction methods, while KNN and RF outperformed the other two methods for all extraction methods; in general, the classification accuracy of NMF and PCA was higher. Overall, the results suggest selecting suitable methods when performing muscle synergy-related analysis.
Collapse
Affiliation(s)
- Kunkun Zhao
- School of Mechanical Engineering, Southeast University, Nanjing, China
| | - Haiying Wen
- School of Mechanical Engineering, Southeast University, Nanjing, China
- Engineering Research Center of New Light Sources Technology and Equipment, Ministry of Education, Nanjing, China
- *Correspondence: Zhisheng Zhang,
| | - Zhisheng Zhang
- School of Mechanical Engineering, Southeast University, Nanjing, China
- *Correspondence: Zhisheng Zhang,
| | - Manfredo Atzori
- Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland
- Department of Neuroscience, University of Padova, Padua, Italy
| | - Henning Müller
- Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland
- Medical Faculty, University of Geneva, Geneva, Switzerland
| | - Zhongqu Xie
- School of Mechanical Engineering, Southeast University, Nanjing, China
| | - Alessandro Scano
- UOS STIIMA Lecco – Human-Centered, Smart and Safe, Living Environment, Italian National Research Council (CNR), Lecco, Italy
| |
Collapse
|
3
|
Pattern Recognition of EMG Signals by Machine Learning for the Control of a Manipulator Robot. SENSORS 2022; 22:s22093424. [PMID: 35591114 PMCID: PMC9102482 DOI: 10.3390/s22093424] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 04/21/2022] [Accepted: 04/25/2022] [Indexed: 02/01/2023]
Abstract
Human Machine Interfaces (HMI) principles are for the development of interfaces for assistance or support systems in physiotherapy or rehabilitation processes. One of the main problems is the degree of customization when applying some rehabilitation therapy or when adapting an assistance system to the individual characteristics of the users. To solve this inconvenience, it is proposed to implement a database of surface Electromyography (sEMG) of a channel in healthy individuals for pattern recognition through Neural Networks of contraction in the muscular region of the biceps brachii. Each movement is labeled using the One-Hot Encoding technique, which activates a state machine to control the position of an anthropomorphic manipulator robot and validate the response time of the designed HMI. Preliminary results show that the learning curve decreases when customizing the interface. The developed system uses muscle contraction to direct the position of the end effector of a virtual robot. The classification of Electromyography (EMG) signals is obtained to generate trajectories in real time by designing a test platform in LabVIEW.
Collapse
|
4
|
Teng Z, Xu G, Liang R, Li M, Zhang S. Evaluation of Synergy-Based Hand Gesture Recognition Method Against Force Variation for Robust Myoelectric Control. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2345-2354. [PMID: 34727034 DOI: 10.1109/tnsre.2021.3124744] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The non-stationary characteristics of surface electromyography (sEMG) and possible adverse variations in real-world conditions make it still an open challenge to realize robust myoelectric control (MEC) for multifunctional prostheses. Variable muscle contraction level is one of the handicaps that may degrade the performance of MEC. In this study, we proposed a force-invariant intent recognition method based on muscle synergy analysis (MSA) in the setting of three self-defined force levels (low, medium, and high). Specifically, a fast matrix factorization algorithm based on alternating non-negativity constrained least squares (NMF/ANLS) was chosen to extract task-specific synergies associated with each of six hand gestures in the training stage; while for the testing samples, we used the non-negative least square (NNLS) method to estimate neural commands for movement classification. The performance of proposed method was compared with conventional pattern recognition (PR) method consisting of LDA (linear discrimination analysis) classifier and representative features in three offline evaluation scenarios. Statistical tests on ten able-bodied subjects revealed no significant difference in intra-force-level (p = 0.353) and multi-force-level (p = 0.695) accuracy; But the synergy-based method performed significantly better than conventional PR-based method under inter-force-level conditions (p < 0.05). Similar results were observed for nine amputee subjects though there was a drop in the classification accuracy. This study was the first to concurrently demonstrate the robustness and predictive power of task-specific synergies under variant force levels and explore their potential for reliable intent recognition against force variation. Although the online performance is yet to be demonstrated, the proposed method is characterized by simple training procedure and acceptable computational efficiency, which would potentially provide an alternative approach for the development of clinically viable prostheses and rehabilitation robots driven by sEMG.
Collapse
|
5
|
Ramos FM, Kojima M, Hayashibe M. Simultaneous Quantification of Personalized Balance, Motion Class and Quality for Whole-body Exercise through Synergy Probe. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:5756-5759. [PMID: 34892427 DOI: 10.1109/embc46164.2021.9629777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Recently, emerging technologies are being used to solve state of the art problems in rehabilitation and physiotherapy. The increasing power of portable sensors is making a great choice for analysis of movements during daily activities. We previously developed a method to personalize the measure of balance only using kinematic data from Kinect. This paper presents the results of simultaneous quantification for the postural balance, motion classification and its quality with Synergy Probe. Previously, it was not possible to verify what happens when the motion balance is unstable. With motion quality index along with the stability, we can quantitatively evaluate the balance stability considering the motion class and its intensity during whole-body exercise.
Collapse
|
6
|
A Real-Time Capable Linear Time Classifier Scheme for Anticipated Hand Movements Recognition from Amputee Subjects Using Surface EMG Signals. Ing Rech Biomed 2021. [DOI: 10.1016/j.irbm.2020.08.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
7
|
Minimum Mapping from EMG Signals at Human Elbow and Shoulder Movements into Two DoF Upper-Limb Robot with Machine Learning. MACHINES 2021. [DOI: 10.3390/machines9030056] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
This research focuses on the minimum process of classifying three upper arm movements (elbow extension, shoulder extension, combined shoulder and elbow extension) of humans with three electromyography (EMG) signals, to control a 2-degrees of freedom (DoF) robotic arm. The proposed minimum process consists of four parts: time divisions of data, Teager–Kaiser energy operator (TKEO), the conventional EMG feature extraction (i.e., the mean absolute value (MAV), zero crossings (ZC), slope-sign changes (SSC), and waveform length (WL)), and eight major machine learning models (i.e., decision tree (medium), decision tree (fine), k-Nearest Neighbor (KNN) (weighted KNN, KNN (fine), Support Vector Machine (SVM) (cubic and fine Gaussian SVM), Ensemble (bagged trees and subspace KNN). Then, we compare and investigate 48 classification models (i.e., 47 models are proposed, and 1 model is the conventional) based on five healthy subjects. The results showed that all the classification models achieved accuracies ranging between 74–98%, and the processing speed is below 40 ms and indicated acceptable controller delay for robotic arm control. Moreover, we confirmed that the classification model with no time division, with TKEO, and with ensemble (subspace KNN) had the best performance in accuracy rates at 96.67, recall rates at 99.66, and precision rates at 96.99. In short, the combination of the proposed TKEO and ensemble (subspace KNN) plays an important role to achieve the EMG classification.
Collapse
|
8
|
Mapping Three Electromyography Signals Generated by Human Elbow and Shoulder Movements to Two Degree of Freedom Upper-Limb Robot Control. ROBOTICS 2020. [DOI: 10.3390/robotics9040083] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
This article sought to address issues related to human-robot cooperation tasks focusing especially on robotic operation using bio-signals. In particular, we propose to develop a control scheme for a robot arm based on electromyography (EMG) signal that allows a cooperative task between humans and robots that would enable teleoperations. A basic framework for achieving the task and conducting EMG signals analysis of the motion of upper limb muscles for mapping the hand motion is presented. The objective of this work is to investigate the application of a wearable EMG device to control a robot arm in real-time. Three EMG sensors are attached to the brachioradialis, biceps brachii, and anterior deltoid muscles as targeted muscles. Three motions were conducted by moving the arm about the elbow joint, shoulder joint, and a combination of the two joints giving a two degree of freedom. Five subjects were used for the experiments. The results indicated that the performance of the system had an overall accuracy varying from 50% to 100% for the three motions for all subjects. This study has further shown that upper-limb motion discrimination can be used to control the robotic manipulator arm with its simplicity and low computational cost.
Collapse
|
9
|
Geng Y, Deng H, Samuel OW, Cheung V, Xu L, Li G. Modulation of muscle synergies for multiple forearm movements under variant force and arm position constraints. J Neural Eng 2020; 17:026015. [PMID: 32126534 DOI: 10.1088/1741-2552/ab7c1a] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
OBJECTIVE To promote clinical applications of muscle-synergy-based neurorehabilitation techniques, this study aims to clarify any potential modulations of both the muscular compositions and temporal activations of forearm muscle synergies for multiple movements under variant force levels and arm positions. APPROACH Two groups of healthy subjects participated in this study. Electromyography (EMG) signals were collected when they performed four hand and wrist movements under variant constraints-three different force levels for one group and five arm positions for the other. Muscle synergies were extracted from the EMGs, and their robustness across variant force levels and arm positions was separately assessed by evaluating their across-condition structure similarity, cross-validation, and cluster analysis. The synergies' activation coefficients across the variant constraints were also compared, and the coefficients were used to discriminate the different force levels and the arm positions, respectively. MAIN RESULTS Overall, the muscle synergies were relatively fixed across variant constraints, but they were more robust to variant forces than to changing arm positions. The activations of muscle synergies depended largely on the level of contraction force and could discriminate the force levels very well, but the coefficients corresponding to different arm positions discriminated the positions with lower accuracy. Similar results were found for all types of forearm movement analyzed. SIGNIFICANCE With our experiment and subject-specific analysis, only slight modulation of the muscular compositions of forearm muscle synergies was found under variant force and arm position constraints. Our results may shed valuable insights to future design of both muscle-synergy-based assistive robots and motor-function assessments.
Collapse
Affiliation(s)
- Yanjuan Geng
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences (CAS), Shenzhen 518055, People's Republic of China. Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen 518055, People's Republic of China
| | | | | | | | | | | |
Collapse
|
10
|
Bahadur R, Rehman SU, Khattak S. Synergy Estimation for Myoelectric Control Using Regularized NMF. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2649-2652. [PMID: 31946440 DOI: 10.1109/embc.2019.8857578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper investigates the problem of achieving robust control for assistive devices using surface electromyogram. We propose the use of regularized non-negative factorization using alternating least square algorithm for the estimation of muscle synergies. The proposed algorithm is tested for 3 different degrees of freedom only one active at a time, providing 97.6 - 99.5% accuracy and when compared with previously proposed methodology it reduces the delay time by 45%.
Collapse
|
11
|
He L, Mathieu PA. Biceps Brachii Muscle Synergy and Target Reaching in a Virtual Environment. Front Neurorobot 2020; 13:100. [PMID: 31920611 PMCID: PMC6914832 DOI: 10.3389/fnbot.2019.00100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Accepted: 11/18/2019] [Indexed: 11/13/2022] Open
Abstract
A muscular synergy is a theory suggesting that the central nervous system uses few commands to activate a group of muscles to produce a given movement. Here, we investigate how a muscle synergy extracted from a single muscle can be at the origin of different signals which could facilitate the control of modern upper limb myoelectric prostheses with many degrees of freedom. Five pairs of surface electrodes were positioned across the biceps of 12 normal subjects and electromyographic (EMG) signals were collected while their upper limbs were in eight different static postures. Those signals were used to move, within a virtual cube, a small red sphere toward different targets. With three muscular synergies extracted from the five EMG signals, a classifier was trained to identify which synergy pattern was associated with a given static posture. Later, when a posture was recognized, the result was a displacement of a red sphere toward a corner of a virtual cube presented on a computer screen. The axes of the cube were assigned to the shoulder, elbow and wrist joint while each of its the corners was associated with a static posture. The goal for subjects was to reach, one at a time, the four targets positioned at different locations and heights in the virtual cube with different sequences of postures. The results of 12 normal subjects indicate that with the muscular synergies of the biceps brachii, it was possible, but not easy for an untrained person, to reach a target on each trial. Thus, as a proof of concept, we show that features of the biceps muscular synergy have the potential to facilitate the control of upper limb myoelectric prostheses. To our knowledge, this has never been shown before.
Collapse
Affiliation(s)
- Liang He
- Department of Pharmacology and Physiology, Biomedical Engineering Institute, Université de Montréal, Montréal, QC, Canada
| | - Pierre A Mathieu
- Department of Pharmacology and Physiology, Biomedical Engineering Institute, Université de Montréal, Montréal, QC, Canada
| |
Collapse
|
12
|
Furui A, Eto S, Nakagaki K, Shimada K, Nakamura G, Masuda A, Chin T, Tsuji T. A myoelectric prosthetic hand with muscle synergy–based motion determination and impedance model–based biomimetic control. Sci Robot 2019; 4:4/31/eaaw6339. [DOI: 10.1126/scirobotics.aaw6339] [Citation(s) in RCA: 59] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Accepted: 05/28/2019] [Indexed: 12/31/2022]
Abstract
Prosthetic hands are prescribed to patients who have suffered an amputation of the upper limb due to an accident or a disease. This is done to allow patients to regain functionality of their lost hands. Myoelectric prosthetic hands were found to have the possibility of implementing intuitive controls based on operator’s electromyogram (EMG) signals. These controls have been extensively studied and developed. In recent years, development costs and maintainability of prosthetic hands have been improved through three-dimensional (3D) printing technology. However, no previous studies have realized the advantages of EMG-based classification of multiple finger movements in conjunction with the introduction of advanced control mechanisms based on human motion. This paper proposes a 3D-printed myoelectric prosthetic hand and an accompanying control system. The muscle synergy–based motion-determination method and biomimetic impedance control are introduced in the proposed system, enabling the classification of unlearned combined motions and smooth and intuitive finger movements of the prosthetic hand. We evaluate the proposed system through operational experiments performed on six healthy participants and an upper-limb amputee participant. The experimental results demonstrate that our prosthetic hand system can successfully classify both learned single motions and unlearned combined motions from EMG signals with a high degree of accuracy. Furthermore, applications to real-world uses of prosthetic hands are demonstrated through control tasks conducted by the amputee participant.
Collapse
|
13
|
York G, Chakrabarty S. A survey on foot drop and functional electrical stimulation. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2019. [DOI: 10.1007/s41315-019-00088-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
14
|
He L, Mathieu PA. Static hand posture classification based on the biceps brachii muscle synergy features. J Electromyogr Kinesiol 2018; 43:201-208. [PMID: 30384222 DOI: 10.1016/j.jelekin.2018.10.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2017] [Revised: 07/27/2018] [Accepted: 10/04/2018] [Indexed: 11/30/2022] Open
Abstract
With modern upper limb myoelectric prostheses, many movements can be produced when many control signals are available. Some of them could originate from the multifunctional biceps brachii which appears to be composed of up to six individually innervated compartments. Given its compartmental nature, this muscle behaves as if composed of many individual muscles acting in synergy to achieve a given motor task. Through an appropriate synergy model, its EMG signals could thus be used to produce some of the many control signals required with modern upper limb myoelectric prostheses. Exploring that possibility, muscular synergy which is usually applied to a group of different muscles, was tested on the biceps brachii only. A non-negative matrix factorization method was applied on pre-recorded data consisting of 8 surface electromyographic signals collected across the biceps of 10 normal subjects who, in Seat or Stand posture, held their hand in 3 different postures. We found that muscular synergies can be extracted from the biceps brachii. With a learning process and a classifier, it was also possible, between a pair of static hand postures, to identify which one was used when a given record was made. The mean score of correctly detected hand posture was >80% for our subjects.
Collapse
Affiliation(s)
- Liang He
- Biomedical Engineering Institute, University of Montreal, Montreal, QC H3T 1J4, Canada
| | - Pierre A Mathieu
- Biomedical Engineering Institute, University of Montreal, Montreal, QC H3T 1J4, Canada.
| |
Collapse
|
15
|
Israely S, Leisman G, Machluf C, Shnitzer T, Carmeli E. Direction Modulation of Muscle Synergies in a Hand-Reaching Task. IEEE Trans Neural Syst Rehabil Eng 2018; 25:2427-2440. [PMID: 29220325 DOI: 10.1109/tnsre.2017.2769659] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Functional tasks of the upper extremity can be executed by a variety of muscular patterns, independent of the direction, speed and load of the task. This large number of degrees of freedom imposes a significant control burden on the CNS. Previous studies suggested that the human cortex synchronizes a discrete number of neural functional units within the brainstem and spinal cord, i.e. muscle synergies, by linearly combining them to execute a great repertoire of movements. Further exploring this control mechanism, we aim to study whether a single set of muscle synergies might be generalized to express movements in different directions. This was implemented by using a modified version of the non-negative matrix factorization algorithm on EMG data sets of the upper extremity of healthy people. Our twelve participants executed hand-reaching movements in multiple directions. Muscle synergies that were extracted from movements to the center of the reaching space could be generalized to synergies for other movement directions. This finding was also supported by the application of a weighted correlation matrix, the similarity index and the results of the K-means cluster analysis. This might reinforce the notion that the CNS flexibly combines a single set of small number of synergies in different amplitudes to modulate movement for different directions.
Collapse
|
16
|
Patel GK, Castellini C, Hahne JM, Farina D, Dosen S. A Classification Method for Myoelectric Control of Hand Prostheses Inspired by Muscle Coordination. IEEE Trans Neural Syst Rehabil Eng 2018; 26:1745-1755. [PMID: 30072332 DOI: 10.1109/tnsre.2018.2861774] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Dexterous upper limb myoelectric prostheses can, to some extent, restore the motor functions lost after an amputation. However, ensuring the reliability of myoelectric control is still an open challenge. In this paper, we propose a classification method that exploits the regularity in muscle activation patterns (uniform scaling) across different force levels within a given movement class. This assumption leads to a simple training procedure, using training data collected at single contraction intensity for each movement class. The proposed method was compared to the widely accepted benchmark [linear discriminant analysis (LDA) classifier] using off-line and online evaluation. The off-line classification errors obtained with the new method were either lower or higher than LDA depending upon the chosen feature set. In the online evaluation, the new classification method was operated using amplitude-EMG features and compared to the state-of-the-art LDA classifier combined with the time domain feature set. The online evaluation was performed in 11 able-bodied and one amputee subject using a set of four functional tasks mimicking daily-life activities. The tasks assessed the dexterity (e.g., switching between functions) and robustness of control (e.g., handling heavy objects). With the new classification scheme, the amputee performed better in all functional tasks, whereas the able-bodied subjects performed significantly better in three out of four functional tasks. Overall, the novel method outperformed the state-of-the-art approach (LDA) while utilizing less training data and a smaller feature set. The proposed method is, therefore, a simple but effective and robust classification scheme, convenient for online implementation and clinical use.
Collapse
|
17
|
Evaluation of matrix factorisation approaches for muscle synergy extraction. Med Eng Phys 2018; 57:51-60. [PMID: 29703696 DOI: 10.1016/j.medengphy.2018.04.003] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2017] [Revised: 03/31/2018] [Accepted: 04/10/2018] [Indexed: 11/20/2022]
Abstract
The muscle synergy concept provides a widely-accepted paradigm to break down the complexity of motor control. In order to identify the synergies, different matrix factorisation techniques have been used in a repertoire of fields such as prosthesis control and biomechanical and clinical studies. However, the relevance of these matrix factorisation techniques is still open for discussion since there is no ground truth for the underlying synergies. Here, we evaluate factorisation techniques and investigate the factors that affect the quality of estimated synergies. We compared commonly used matrix factorisation methods: Principal component analysis (PCA), Independent component analysis (ICA), Non-negative matrix factorization (NMF) and second-order blind identification (SOBI). Publicly available real data were used to assess the synergies extracted by each factorisation method in the classification of wrist movements. Synthetic datasets were utilised to explore the effect of muscle synergy sparsity, level of noise and number of channels on the extracted synergies. Results suggest that the sparse synergy model and a higher number of channels would result in better estimated synergies. Without dimensionality reduction, SOBI showed better results than other factorisation methods. This suggests that SOBI would be an alternative when a limited number of electrodes is available but its performance was still poor in that case. Otherwise, NMF had the best performance when the number of channels was higher than the number of synergies. Therefore, NMF would be the best method for muscle synergy extraction.
Collapse
|
18
|
A Systematic Review on Muscle Synergies: From Building Blocks of Motor Behavior to a Neurorehabilitation Tool. Appl Bionics Biomech 2018; 2018:3615368. [PMID: 29849756 PMCID: PMC5937559 DOI: 10.1155/2018/3615368] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2017] [Accepted: 01/29/2018] [Indexed: 12/20/2022] Open
Abstract
The central nervous system (CNS) is believed to utilize specific predefined modules, called muscle synergies (MS), to accomplish a motor task. Yet questions persist about how the CNS combines these primitives in different ways to suit the task conditions. The MS hypothesis has been a subject of debate as to whether they originate from neural origins or nonneural constraints. In this review article, we present three aspects related to the MS hypothesis: (1) the experimental and computational evidence in support of the existence of MS, (2) algorithmic approaches for extracting them from surface electromyography (EMG) signals, and (3) the possible role of MS as a neurorehabilitation tool. We note that recent advances in computational neuroscience have utilized the MS hypothesis in motor control and learning. Prospective advances in clinical, medical, and engineering sciences and in fields such as robotics and rehabilitation stand to benefit from a more thorough understanding of MS.
Collapse
|
19
|
Learning assistive strategies for exoskeleton robots from user-robot physical interaction. Pattern Recognit Lett 2017. [DOI: 10.1016/j.patrec.2017.04.007] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
20
|
Mastinu E, Doguet P, Botquin Y, Hakansson B, Ortiz-Catalan M. Embedded System for Prosthetic Control Using Implanted Neuromuscular Interfaces Accessed Via an Osseointegrated Implant. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2017; 11:867-877. [PMID: 28541915 DOI: 10.1109/tbcas.2017.2694710] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Despite the technological progress in robotics achieved in the last decades, prosthetic limbs still lack functionality, reliability, and comfort. Recently, an implanted neuromusculoskeletal interface built upon osseointegration was developed and tested in humans, namely the Osseointegrated Human-Machine Gateway. Here, we present an embedded system to exploit the advantages of this technology. Our artificial limb controller allows for bioelectric signals acquisition, processing, decoding of motor intent, prosthetic control, and sensory feedback. It includes a neurostimulator to provide direct neural feedback based on sensory information. The system was validated using real-time tasks characterization, power consumption evaluation, and myoelectric pattern recognition performance. Functionality was proven in a first pilot patient from whom results of daily usage were obtained. The system was designed to be reliably used in activities of daily living, as well as a research platform to monitor prosthesis usage and training, machine-learning-based control algorithms, and neural stimulation paradigms.
Collapse
|
21
|
Krasoulis A, Kyranou I, Erden MS, Nazarpour K, Vijayakumar S. Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements. J Neuroeng Rehabil 2017; 14:71. [PMID: 28697795 PMCID: PMC5505040 DOI: 10.1186/s12984-017-0284-4] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2017] [Accepted: 06/28/2017] [Indexed: 12/04/2022] Open
Abstract
Background Myoelectric pattern recognition systems can decode movement intention to drive upper-limb prostheses. Despite recent advances in academic research, the commercial adoption of such systems remains low. This limitation is mainly due to the lack of classification robustness and a simultaneous requirement for a large number of electromyogram (EMG) electrodes. We propose to address these two issues by using a multi-modal approach which combines surface electromyography (sEMG) with inertial measurements (IMs) and an appropriate training data collection paradigm. We demonstrate that this can significantly improve classification performance as compared to conventional techniques exclusively based on sEMG signals. Methods We collected and analyzed a large dataset comprising recordings with 20 able-bodied and two amputee participants executing 40 movements. Additionally, we conducted a novel real-time prosthetic hand control experiment with 11 able-bodied subjects and an amputee by using a state-of-the-art commercial prosthetic hand. A systematic performance comparison was carried out to investigate the potential benefit of incorporating IMs in prosthetic hand control. Results The inclusion of IM data improved performance significantly, by increasing classification accuracy (CA) in the offline analysis and improving completion rates (CRs) in the real-time experiment. Our findings were consistent across able-bodied and amputee subjects. Integrating the sEMG electrodes and IM sensors within a single sensor package enabled us to achieve high-level performance by using on average 4-6 sensors. Conclusions The results from our experiments suggest that IMs can form an excellent complimentary source signal for upper-limb myoelectric prostheses. We trust that multi-modal control solutions have the potential of improving the usability of upper-extremity prostheses in real-life applications. Electronic supplementary material The online version of this article (doi:10.1186/s12984-017-0284-4) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Agamemnon Krasoulis
- Institute of Perception, Action and Behaviour, School of Informatics, University of Edinburgh, Edinburgh, UK. .,Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, UK.
| | - Iris Kyranou
- Institute of Perception, Action and Behaviour, School of Informatics, University of Edinburgh, Edinburgh, UK.,School of Engineering and Physical Sciences, Heriot Watt University, Edinburgh, UK
| | - Mustapha Suphi Erden
- School of Engineering and Physical Sciences, Heriot Watt University, Edinburgh, UK
| | - Kianoush Nazarpour
- School of Electrical and Electronic Engineering, Newcastle University, Newcastle, UK.,Institute of Neuroscience, Newcastle University, Newcastle, UK
| | - Sethu Vijayakumar
- Institute of Perception, Action and Behaviour, School of Informatics, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
22
|
Ebied A, Spyrou L, Kinney-Lang E, Escudero J. On the use of higher-order tensors to model muscle synergies. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:1792-1795. [PMID: 29060236 DOI: 10.1109/embc.2017.8037192] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The muscle synergy concept provides the best framework to understand motor control and it has been recently utilised in many applications such as prosthesis control. The current muscle synergy model relies on decomposing multi-channel surface Electromyography (EMG) signals into a synergy matrix (spatial mode) and its weighting function (temporal mode). This is done using several matrix factorisation techniques, with Non-negative matrix factorisation (NMF) being the most prominent method. Here, we introduce a 4th-order tensor muscle synergy model that extends the current state of the art by taking spectral information and repetitions (movements) into account. This adds more depth to the model and provides more synergistic information. In particular, we illustrate a proof-of-concept study where the Tucker3 tensor decomposition model was applied to a subset of wrist movements from the Ninapro database. The results showed the potential of Tucker3 tensor factorisation in finding patterns of muscle synergies with information about the movements and highlights the differences between the current and proposed model.
Collapse
|
23
|
Yağmur Günay S, Quivira F, Erdoğmuş D. Muscle Synergy-based Grasp Classification for Robotic Hand Prosthetics. THE ... INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS : PETRA ... INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS 2017; 2017:335-338. [PMID: 31111121 DOI: 10.1145/3056540.3076208] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The main goal of this study is analyzing whether muscle synergies based on surface electromyography (EMG) measurements could be used for hand posture classification in the context of robotic prosthetic control. Target grasps were selected according to usefulness in daily activities. Additionally, due to the feasibility constraints of robotic prosthetics, only 14 gestures (13 feasible grasps and 1 resting state) were analyzed. EMG signals of intact-limb subjects were decomposed into base and activation components for muscle activity evaluation. The results demonstrate that features based on muscle synergies derived from non-negative matrix factorization (NMF) outperform the ones derived from principal component analysis (PCA). Moreover, we also examine the robustness of these methods in the absence of electrodes (muscle importance) and show that NMF is able to provide sufficiently accurate results.
Collapse
|
24
|
Afzal T, Iqbal K, White G, Wright AB. A Method for Locomotion Mode Identification Using Muscle Synergies. IEEE Trans Neural Syst Rehabil Eng 2016; 25:608-617. [PMID: 27362983 DOI: 10.1109/tnsre.2016.2585962] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Active lower limb transfemoral prostheses have enabled amputees to perform different locomotion modes such as walking, stair ascent, stair descent, ramp ascent and ramp descent. To achieve seamless mode transitions, these devices either rely on neural information from the amputee's residual limbs or sensors attached to the prosthesis to identify the intended locomotion modes or both. We present an approach for classification of locomotion modes based on the framework of muscle synergies underlying electromyography signals. Neural information at the critical instances (e.g., heel contact and toe-off) was decoded for this purpose. Non-negative matrix factorization was used to extract the muscles synergies from the muscle feature matrix. The estimation of the neural command was done using non-negative least squares. The muscle synergy approach was compared with linear discriminant analysis (LDA), support vector machine (SVM), and neural network (NN) and was tested on seven able-bodied subjects. There was no significant difference ( p > 0.05 ) in transitional and steady state classification errors during stance phase. The muscle synergy approach performed significantly better ( ) than NN and LDA during swing phase while results were similar to SVM. These results suggest that the muscle synergy approach can be used to discriminate between locomotion modes involving transitions.
Collapse
|
25
|
Afzal T, Iqbal K, White G, Wright AB. Task discrimination for non-weight-bearing movements using muscle synergies. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2015:478-481. [PMID: 26736303 DOI: 10.1109/embc.2015.7318403] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Myoelectric control of lower limb prostheses requires discrimination of task-specific muscle patterns. In this paper we present a method based on the notion of muscle synergies to discriminate between various non-weight-bearing movements such as knee extension/flexion, femur rotation in/out, tibia rotation in/out and ankle dorsiflexion/plantarflexion. Data is recorded from eight targeted muscle sites on the thigh. Non-negative matrix factorization is used to identify the muscle synergies using multiple features and estimation of electromyographic (EMG) patterns is done using non-negative least squares (NNLS). Classification accuracy for the movements involving the knee joint was higher than the movements involving the ankle joint. The proposed algorithm performs at par with the common machine learning algorithm Linear Discriminant Analysis (LDA) in offline analysis.
Collapse
|