Surface EMG in advanced hand prosthetics

Prior estimation of motion using recursive perceptron with sEMG: a case of wrist angle

Muscle activity is followed by myoelectric potentials. Prior estimation of motion by surface electromyography can be utilized to assist the physically impaired people as well as surgeon. In this paper, we proposed a real-time method for the prior estimation of motion from surface electromyography, especially in the case of wrist angle. The method was based on the recursive processing of multi-layer perceptron, which is trained quickly. A single layer perceptron calculates quasi tensional force of muscles from surface electromyography. A three-layer perceptron calculates the wrist's change in angle. In order to estimate a variety of motions properly, the perceptron was designed to estimate motion in a short time period, e.g. 1ms. Recursive processing enables the method to estimate motion in the target time period, e.g. 50ms. The results of the experiments showed statistical significance for the precedence of estimated angle to the measured one.

Orthopaedic research in italy: state of the art

The most significant results in experimental and clinical orthopaedic research in Italy within the last three years have been primarily in major congenital diseases, bone tumors, regenerative medicine, joint replacements, spine, tendons and ligaments. The data presented in the following discussion is comparable with leading international results, highlighting Italian orthopaedic research excellemce as well as its shortcomings.

Comparison of regression models for estimation of isometric wrist joint torques using surface electromyography

BACKGROUND

Several regression models have been proposed for estimation of isometric joint torque using surface electromyography (SEMG) signals. Common issues related to torque estimation models are degradation of model accuracy with passage of time, electrode displacement, and alteration of limb posture. This work compares the performance of the most commonly used regression models under these circumstances, in order to assist researchers with identifying the most appropriate model for a specific biomedical application.

METHODS

Eleven healthy volunteers participated in this study. A custom-built rig, equipped with a torque sensor, was used to measure isometric torque as each volunteer flexed and extended his wrist. SEMG signals from eight forearm muscles, in addition to wrist joint torque data were gathered during the experiment. Additional data were gathered one hour and twenty-four hours following the completion of the first data gathering session, for the purpose of evaluating the effects of passage of time and electrode displacement on accuracy of models. Acquired SEMG signals were filtered, rectified, normalized and then fed to models for training.

RESULTS

It was shown that mean adjusted coefficient of determination (Ra2) values decrease between 20%-35% for different models after one hour while altering arm posture decreased mean Ra2 values between 64% to 74% for different models.

CONCLUSIONS

Model estimation accuracy drops significantly with passage of time, electrode displacement, and alteration of limb posture. Therefore model retraining is crucial for preserving estimation accuracy. Data resampling can significantly reduce model training time without losing estimation accuracy. Among the models compared, ordinary least squares linear regression model (OLS) was shown to have high isometric torque estimation accuracy combined with very short training times.

On-line frequency adaptation and movement imitation for rhythmic robotic tasks

In this paper we present a novel method to obtain the basic frequency of an unknown periodic signal with an arbitrary waveform, which can work online with no additional signal processing or logical operations. The method originates from non-linear dynamical systems for frequency extraction, which are based on adaptive frequency oscillators in a feedback loop. In previous work, we had developed a method that could extract separate frequency components by using several adaptive frequency oscillators in a loop, but that method required a logical algorithm to identify the basic frequency. The novel method presented here uses a Fourier series representation in the feedback loop combined with a single oscillator. In this way it can extract the frequency and the phase of an unknown periodic signal in real time and without any additional signal processing or preprocessing. The method determines the Fourier series coefficients and can be used for dynamic Fourier series implementation. The proposed method can be used for the control of rhythmic robotic tasks, where only the extraction of the basic frequency is crucial. For demonstration several highly non-linear and dynamic periodic robotic tasks are shown, including also a task where an electromyography (EMG) signal is used in a feedback loop.

A preliminary investigation assessing the viability of classifying hand postures in seniors

Background

Fear of frailty is a main concern for seniors. Surface electromyography (sEMG) controlled assistive devices for the upper extremities could potentially be used to augment seniors' force while training their muscles and reduce their fear of frailty. In fact, these devices could both improve self confidence and facilitate independent leaving in domestic environments. The successful implementation of sEMG controlled devices for the elderly strongly relies on the capability of properly determining seniors' actions from their sEMG signals. In this research we investigated the viability of classifying hand postures in seniors from sEMG signals of their forearm muscles.

Methods

Nineteen volunteers, including seniors (70 years old in average) and young people (27 years old in average), participated in this study and sEMG signals from four of their forearm muscles (i.e. Extensor Digitorum, Palmaris Longus, Flexor Carpi Ulnaris and Extensor Carpi Radialis) were recorded. The feature vectors were built by extracting features from each channel of sEMG including autoregressive (AR) model coefficients, waveform length and root mean square (RMS). Multi-class support vector machines (SVM) was used as a classifier to distinguish between fifteen different essential hand gestures including finger pinching.

Results

Classification of hand gestures both in the pronation and supination positions of the arm was possible. Classified hand gestures were: rest, ulnar deviation, radial deviation, grasp and four different finger pinching configurations. The obtained average classification accuracy was 90.6% for the seniors and 97.6% for the young volunteers.

Conclusions

The obtained results proved that the pattern recognition of sEMG signals in seniors is feasible for both pronation and supination positions of the arm and the use of only four EMG channel is sufficient. The outcome of this study therefore validates the hypothesis that, although there are significant neurological and physical changes occurring in humans while ageing, sEMG controlled hand assistive devices could potentially be used by the older people.

Synergy matrices to extract fluid wrist motion intents via surface electromyography

This paper presented an estimation method of multi-directional and proportional fluid wrist motion intents via sEMG using a non-negative muscle synergy matrix and a joint synergy matrix. A real-time experiment was performed to validate feasibility of the proposed method, and the experimental environment was realized for the individuals with wrist amputation. Only four wrist movements were predefined (wrist extension, wrist flexion, radial deviation, and ulnar deviation), but the experimental results showed that fluid wrist motion intents (e.g. a combination of wrist extension and ulnar deviation) could be extracted. This work could be useful for the people with wrist amputations to restore their wrist functions using myoelectric powered wrist prosthesis, and also for research to investigate how humans learn myoelectric controls in two-dimensions via training.

Synergy matrices to estimate fluid wrist movements by surface electromyography

Although many efforts have been undertaken to develop an interface using surface electromyography (sEMG) to connect the gap between a human and a wrist prosthesis, most of these efforts have offered only static positioning (ON/OFF) of the prosthesis. This study introduced synergy matrices to extract fluid wrist movement intents by sEMG to allow individuals with wrist amputations to use wrist prostheses. A non-negative muscle synergy matrix was used to map muscle activities in the forearm into four predefined wrist movement intents (flexion/extension and radial/ulnar deviation). The directions of the predefined intents were constrained to two perpendicular axes, so each movement spanned only a one-dimensional space. A joint synergy matrix was used to span the whole two-dimensional space by combining the four wrist movement intents. Ten healthy subjects volunteered for a validation experiment, which was built as a virtual environment in which people with wrist amputation could receive myoelectric control training. The results showed that proportional two-degree-of-freedom (DOF) movements could be estimated by sEMG. This work could be useful not only for wrist prostheses but also for alternative computer interfaces and studies to examine motor adaptation by sEMG.

A SNR-independent formulation of a double threshold algorithm for the estimation of muscle activation intervals

The aim of this work is to propose an improvement to the double threshold algorithm for muscular activation intervals estimation developed by Bonato and his co-workers. The proposed method has been designed in order to be adaptive also when the Signal to Noise ratio (SNR) of the sEMG signal changes during the trial, by re-evaluating the parameters of the algorithm according to the estimated local SNR and the desired detection and false alarm probabilities. This novel implementation is also suitable for working in pseudo real-time since it can give information on burst estimation shortly after the end of the current muscular activity. The proposed method was tested on simulated signals taking into account changes in the SNR during the trial, and results were compared with those obtained with the classical implementation of the algorithm.

A physiologically and biomechanically approximate model for surface electromyography amplitude estimation

Surface electromygraphy (sEMG) provides information of the neural drive to the muscle, so muscle force estimation by sEMG is of high relevance in biomechanical studies and in bionic applications. Even though mean absolute value (MAV) has been widely used for sEMG amplitude estimation due to the probabilistic nature of sEMG, but it has been used without any comprehensive physiological justification. A physiologically and biomechanically approximate model for the force estimation would enable a clear understanding of the relationships between sEMG and the force, and it can be used as sEMG amplitude estimation method. We proposed a new sEMG amplitude estimation method comprising two procedures: MUAP (motor unit action potential) event detection and muscle force indication using a biomechanical muscle model. The estimation performances were evaluated with nine subjects and compared with MAV. The performance (R(2)) of the proposed method (0.94 ± 0.03) outperformed it of MAV (0.90 ± 0.02). The method we proposed should be widely applicable to quantitatively analysis muscle activities by sEMG.

Surface EMG pattern recognition for real-time control of a wrist exoskeleton

Background

Surface electromyography (sEMG) signals have been used in numerous studies for the classification of hand gestures and movements and successfully implemented in the position control of different prosthetic hands for amputees. sEMG could also potentially be used for controlling wearable devices which could assist persons with reduced muscle mass, such as those suffering from sarcopenia. While using sEMG for position control, estimation of the intended torque of the user could also provide sufficient information for an effective force control of the hand prosthesis or assistive device. This paper presents the use of pattern recognition to estimate the torque applied by a human wrist and its real-time implementation to control a novel two degree of freedom wrist exoskeleton prototype (WEP), which was specifically developed for this work.

Methods

Both sEMG data from four muscles of the forearm and wrist torque were collected from eight volunteers by using a custom-made testing rig. The features that were extracted from the sEMG signals included root mean square (rms) EMG amplitude, autoregressive (AR) model coefficients and waveform length. Support Vector Machines (SVM) was employed to extract classes of different force intensity from the sEMG signals. After assessing the off-line performance of the used classification technique, the WEP was used to validate in real-time the proposed classification scheme.

Results

The data gathered from the volunteers were divided into two sets, one with nineteen classes and the second with thirteen classes. Each set of data was further divided into training and testing data. It was observed that the average testing accuracy in the case of nineteen classes was about 88% whereas the average accuracy in the case of thirteen classes reached about 96%. Classification and control algorithm implemented in the WEP was executed in less than 125 ms.

Conclusions

The results of this study showed that classification of EMG signals by separating different levels of torque is possible for wrist motion and the use of only four EMG channels is suitable. The study also showed that SVM classification technique is suitable for real-time classification of sEMG signals and can be effectively implemented for controlling an exoskeleton device for assisting the wrist.

Cognitive vision system for control of dexterous prosthetic hands: experimental evaluation

BACKGROUND

Dexterous prosthetic hands that were developed recently, such as SmartHand and i-LIMB, are highly sophisticated; they have individually controllable fingers and the thumb that is able to abduct/adduct. This flexibility allows implementation of many different grasping strategies, but also requires new control algorithms that can exploit the many degrees of freedom available. The current study presents and tests the operation of a new control method for dexterous prosthetic hands.

METHODS

The central component of the proposed method is an autonomous controller comprising a vision system with rule-based reasoning mounted on a dexterous hand (CyberHand). The controller, termed cognitive vision system (CVS), mimics biological control and generates commands for prehension. The CVS was integrated into a hierarchical control structure: 1) the user triggers the system and controls the orientation of the hand; 2) a high-level controller automatically selects the grasp type and size; and 3) an embedded hand controller implements the selected grasp using closed-loop position/force control. The operation of the control system was tested in 13 healthy subjects who used Cyberhand, attached to the forearm, to grasp and transport 18 objects placed at two different distances.

RESULTS

The system correctly estimated grasp type and size (nine commands in total) in about 84% of the trials. In an additional 6% of the trials, the grasp type and/or size were different from the optimal ones, but they were still good enough for the grasp to be successful. If the control task was simplified by decreasing the number of possible commands, the classification accuracy increased (e.g., 93% for guessing the grasp type only).

CONCLUSIONS

The original outcome of this research is a novel controller empowered by vision and reasoning and capable of high-level analysis (i.e., determining object properties) and autonomous decision making (i.e., selecting the grasp type and size). The automatic control eases the burden from the user and, as a result, the user can concentrate on what he/she does, not on how he/she should do it. The tests showed that the performance of the controller was satisfactory and that the users were able to operate the system with minimal prior training.

Multi-subject/daily-life activity EMG-based control of mechanical hands

Background

Forearm surface electromyography (EMG) has been in use since the Sixties to feed-forward control active hand prostheses in a more and more refined way. Recent research shows that it can be used to control even a dexterous polyarticulate hand prosthesis such as Touch Bionics's i-LIMB, as well as a multifingered, multi-degree-of-freedom mechanical hand such as the DLR II. In this paper we extend previous work and investigate the robustness of such fine control possibilities, in two ways: firstly, we conduct an analysis on data obtained from 10 healthy subjects, trying to assess the general applicability of the technique; secondly, we compare the baseline controlled condition (arm relaxed and still on a table) with a "Daily-Life Activity" (DLA) condition in which subjects walk, raise their hands and arms, sit down and stand up, etc., as an experimental proxy of what a patient is supposed to do in real life. We also propose a cross-subject model analysis, i.e., training a model on a subject and testing it on another one. The use of pre-trained models could be useful in shortening the time required by the subject/patient to become proficient in using the hand.

Results

A standard machine learning technique was able to achieve a real-time grip posture classification rate of about 97% in the baseline condition and 95% in the DLA condition; and an average correlation to the target of about 0.93 (0.90) while reconstructing the required force. Cross-subject analysis is encouraging although not definitive in its present state.

Conclusion

Performance figures obtained here are in the same order of magnitude of those obtained in previous work about healthy subjects in controlled conditions and/or amputees, which lets us claim that this technique can be used by reasonably any subject, and in DLA situations. Use of previously trained models is not fully assessed here, but more recent work indicates it is a promising way ahead.

Robotics of human movements

The construction of robotic systems that can move the way humans do, with respect to agility, stability and precision, is a necessary prerequisite for the successful integration of robotic systems in human environments. We explain human-centered views on robotics, based on the three basic ingredients (1) actuation; (2) sensing; and (3) control, and formulate detailed examples thereof.

Fine detection of grasp force and posture by amputees via surface electromyography

The state-of-the-art feed-forward control of active hand prostheses is rather poor. Even dexterous, multi-fingered commercial prostheses are controlled via surface electromyography (EMG) in a way that enforces a few fixed grasping postures, or a very basic estimate of force. Control is not natural, meaning that the amputee must learn to associate, e.g., wrist flexion and hand closing. Nevertheless, recent literature indicates that much more information can be gathered from plain, old surface EMG. To check this issue, we have performed an experiment in which three amputees train a Support Vector Machine (SVM) using five commercially available EMG electrodes while asked to perform various grasping postures and forces with their phantom limbs. In agreement with recent neurological studies on cortical plasticity, we show that amputees operated decades ago can still produce distinct and stable signals for each posture and force. The SVM classifies the posture up to a precision of 95% and approximates the force with an error of as little as 7% of the signal range, sample-by-sample at 25Hz. These values are in line with results previously obtained by healthy subjects while feed-forward controlling a dexterous mechanical hand. We then conclude that our subjects could finely feed-forward control a dexterous prosthesis in both force and position, using standard EMG in a natural way, that is, using the phantom limb.

EMG-based and gaze-tracking-based man-machine interfaces

A great demand for brain-machine and, more generally, man-machine interfaces is arising nowadays, pushed by several promising scientific and technological results, which are encouraging the concentration of efforts in this field. The possibility of measuring, processing and decoding brain activity, so as to interpret neural signals, is often looked at as a possibility to bypass lost or damaged neural and/or motor structures. Beyond that, such interfaces currently show a potential for applications in other fields, space science being certainly one of them. At present, the concept of "reading" the brain to detect intended actions and use these to control external devices is being studied with several technical and methodological approaches; among these, interfaces based on electroencephalographic signals play today a prominent role. Within such a context, the aim of this section is to present a brief survey on two types of noninvasive man-machine interfaces based on a different approach. In particular, they rely on the extraction of control signals from the user with techniques that adopt electromyography and gaze tracking. Working principles, implementations, typical features, and applications of these two types of interfaces are reported.