Spatio-spectral filters for low-density surface electromyographic signal classification

Sensing and Controlling Strategy for Upper Extremity Prosthetics Based on Piezoelectric Micromachined Ultrasound Transducer

Surface electromyography (sEMG) is currently the primary method for user control of prosthetic manipulation. Its inherent limitations of low signal-to-noise ratio, limited specificity and susceptibility to noise, however, hinder successful implementation. Ultrasound provides a possible alternative, but current systems with medical probes are expense, bulky and non-wearable. This work proposes an innovative prosthetic control strategy based on a piezoelectric micromachined ultrasound transducer (PMUT) hardware system. Two PMUT-based probes were developed, comprising a 23×26 PMUT array and encapsulated in Ecoflex material. These compact and wearable probes represent a significant improvement over traditional ultrasound probes as they weigh only 1.8 grams and eliminate the need for ultrasound gel. A preliminary test of the probes was performed in non-disabled subjects performing 12 different hand gestures. The two probes were placed perpendicular to the flexor digitorum superficialis and brachioradialis muscles, respectively, to transmit/receive pulse-echo signals reflecting muscle activities. Hand gesture was correctly predicted 96% of the time with only these two probes. The adoption of the PMUT-based strategy greatly reduced the required number of channels, amount of processing circuit and subsequent analysis. The probes show promise for making prosthesis control more practical and economical.

Manipulator Control System Based on Flexible Sensor Technology

The research on the remote control of manipulators based on flexible sensor technology is gradually extensive. In order to achieve stable, accurate, and efficient control of the manipulator, it is necessary to reasonably design the structure of the sensor with excellent tensile strength and flexibility. The acquisition of manual information by high-performance sensors is the basis of manipulator control. This paper starts with the manufacturing of materials of the flexible sensor for the manipulator, introduces the substrate, sensor, and flexible electrode materials, respectively, and summarizes the performance of different flexible sensors. From the perspective of manufacturing, it introduces their basic principles and compares their advantages and disadvantages. Then, according to the different ways of wearing, the two control methods of data glove control and surface EMG control are respectively introduced, the principle, control process, and detection accuracy are summarized, and the problems of material microstructure, reducing the cost, optimizing the circuit design and so on are emphasized in this field. Finally, the commercial application in this field is explained and the future research direction is proposed from two aspects: how to ensure real-time control and better receive the feedback signal from the manipulator.

Brain-machine and muscle-machine bio-sensing methods for gesture intent acquisition in upper-limb prosthesis control: a review

This paper presents a review of a number of bio-sensing methods for gesture intent signal acquisition in control tasks for upper-limb prosthesis. The paper specifically provides a breakdown of the control task in myoelectric prosthesis, and in addition, highlights and describes the importance of the acquisition of a high-quality bio-signal. The paper also describes commonly used invasive and non-invasive brain and muscle machine interfaces such as electroencephalography, electrocorticography, electroneurography, surface electromyography, sonomyography, mechanomyography, near infra-red, force sensitive resistance/pressure, and magnetoencephalography. Each modality is reviewed based on its operating principle and limitations in gesture recognition, followed by respective advantages and disadvantages. Also described within this paper, are multimodal sensing approaches, which involve data fusion of information from various sensing modalities for an enhanced neuromuscular bio-sensing source. Using a semi-systematic review methodology, we are able to derive a novel tabular approach towards contrasting the various strengths and weaknesses of the reviewed bio-sensing methods towards gesture recognition in a prosthesis interface. This would allow for a streamlined method of down selection of an appropriate bio-sensor given specific prosthesis design criteria and requirements. The paper concludes by highlighting a number of research areas that require more work for strides to be made towards improving and enhancing the connection between man and machine as it concerns upper-limb prosthesis. Such areas include classifier augmentation for gesture recognition, filtering techniques for sensor disturbance rejection, feeling of tactile sensations with an artificial limb.

Facilitate sEMG-Based Human–Machine Interaction Through Channel Optimization

Electromyography (EMG) has been widely accepted to interact with prosthetic hands, but still limited to using few channels for the control of few degrees of freedom. The use of more channels can improve the controllability, but it also increases system’s complexity and reduces its wearability. It is yet clear if optimizely placing the EMG channel could provide a feasible solution to this challenge. This study customized a genetic algorithm to optimize the number of channels and its position on the forearm in inter-day hand gesture recognition scenario. Our experimental results demonstrate that optimally selected 14 channels out of 16 can reach a peak inter-day hand gesture recognition accuracy at 72.3%, and optimally selecting 9 and 11 channels would reduce the performance by 3% and 10%. The cross-validation results also demonstrate that the optimally selected EMG channels from five subjects also work on the rest of the subjects, improving the accuracies by 3.09% and 4.5% in 9- and 11-channel combination, respectively. In sum, this study demonstrates the feasibility of channel reduction through genetic algorithm, and preliminary proves the significance of EMG channel optimization for human–machine interaction.

A Human-Machine Interface Using Electrical Impedance Tomography for Hand Prosthesis Control

This paper presents a human-machine interface that establishes a link between the user and a hand prosthesis. It successfully uses electrical impedance tomography, a conventional bio-impedance imaging technique, using an array of electrodes contained in a wristband on the user's forearm. Using a high-performance analog front-end application specific integrated circuit (ASIC), the user's forearm inner bio-impedance redistribution is accurately assessed. These bio-signatures are strongly related to hand motions and using artificial neural networks, they can be learned so as to recognize the user's intention in real time for prosthesis operation. In this work, eleven hand motions are designed for prosthesis operation with a gesture switching enabled sub-grouping method. Experiments with five subjects show that the system can achieve 98.5% accuracy with a grouping of three gestures and an accuracy of 94.4% with two sets of five gestures. The ASIC comprises a current driver with common-mode reduction capability and a current feedback instrumentation amplifier (that occupy an area of 0.07 mm²). The ASIC operates from ±1.65 V power supplies and has a minimum bio-impedance sensitivity of 12.7 mΩ_p-p.

Continuous Recognition of Multifunctional Finger and Wrist Movements in Amputee Subjects Based on sEMG and Accelerometry

Background:

While the classification of multifunctional finger and wrist movement based on surface electromyography (sEMG) signals in intact subjects can reach remarkable recognition rates, the performance obtained from amputated subjects remained low.

Methods:

In this paper, we proposed and evaluated the myoelectric control scheme of upper-limb prostheses by the continuous recognition of 17 multifunctional finger and wrist movements on 5 amputated subjects. Experimental validation was applied to select optimal features and classifiers for identifying sEMG and accelerometry (ACC) modalities under the windows-based analysis scheme. The majority vote is adopted to eliminate transient jumps and produces smooth output for window-based analysis scheme. Furthermore, principle component analysis was employed to reduce the dimension of features and to eliminate redundancy for ACC signal. Then a novel metric, namely movement error rate, was also employed to evaluate the performance of the continuous recognition framework proposed herein.

Results:

The average accuracy rates of classification were up to 88.7 ± 2.6% over 5 amputated subjects, which was an outstanding result in comparison with the previous literature.

Conclusion:

The proposed technique was proven to be a potential candidate for intelligent prosthetic systems, which would increase quality of life for amputated subjects.

Improving robustness against electrode shift of high density EMG for myoelectric control through common spatial patterns

Background

Most prosthetic myoelectric control studies have concentrated on low density (less than 16 electrodes, LD) electromyography (EMG) signals, due to its better clinical applicability and low computation complexity compared with high density (more than 16 electrodes, HD) EMG signals. Since HD EMG electrodes have been developed more conveniently to wear with respect to the previous versions recently, HD EMG signals become an alternative for myoelectric prostheses. The electrode shift, which may occur during repositioning or donning/doffing of the prosthetic socket, is one of the main reasons for degradation in classification accuracy (CA).

Methods

HD EMG signals acquired from the forearm of the subjects were used for pattern recognition-based myoelectric control in this study. Multiclass common spatial patterns (CSP) with two types of schemes, namely one versus one (CSP-OvO) and one versus rest (CSP-OvR), were used for feature extraction to improve the robustness against electrode shift for myoelectric control. Shift transversal (ST1 and ST2) and longitudinal (SL1 and SL2) to the direction of the muscle fibers were taken into consideration. We tested nine intact-limb subjects for eleven hand and wrist motions. The CSP features (CSP-OvO and CSP-OvR) were compared with three commonly used features, namely time-domain (TD) features, time-domain autoregressive (TDAR) features and variogram (Variog) features.

Results

Compared with the TD features, the CSP features significantly improved the CA over 10 % in all shift configurations (ST1, ST2, SL1 and SL2). Compared with the TDAR features, a. the CSP-OvO feature significantly improved the average CA over 5 % in all shift configurations; b. the CSP-OvR feature significantly improved the average CA in shift configurations ST1, SL1 and SL2. Compared with the Variog features, the CSP features significantly improved the average CA in longitudinal shift configurations (SL1 and SL2).

Conclusion

The results demonstrated that the CSP features significantly improved the robustness against electrode shift for myoelectric control with respect to the commonly used features.

The role of muscle synergies in myoelectric control: trends and challenges for simultaneous multifunction control

Myoelectric control is filled with potential to significantly change human-robot interaction due to the ability to non-invasively measure human motion intent. However, current control schemes have struggled to achieve the robust performance that is necessary for use in commercial applications. As demands in myoelectric control trend toward simultaneous multifunctional control, multi-muscle coordinations, or synergies, play larger roles in the success of the control scheme. Detecting and refining patterns in muscle activations robust to the high variance and transient changes associated with surface electromyography is essential for efficient, user-friendly control. This article reviews the role of muscle synergies in myoelectric control schemes by dissecting each component of the scheme with respect to associated challenges for achieving robust simultaneous control of myoelectric interfaces. Electromyography recording details, signal feature extraction, pattern recognition and motor learning based control schemes are considered, and future directions are proposed as steps toward fulfilling the potential of myoelectric control in clinically and commercially viable applications.