Controlling a prosthetic arm with a throat microphone

Human Hand Anatomy-Based Prosthetic Hand

The present paper describes the development of a prosthetic hand based on human hand anatomy. The hand phalanges are printed with 3D printing with Polylactic Acid material. One of the main contributions is the investigation on the prosthetic hand joins; the proposed design enables one to create personalized joins that provide the prosthetic hand a high level of movement by increasing the degrees of freedom of the fingers. Moreover, the driven wire tendons show a progressive grasping movement, being the friction of the tendons with the phalanges very low. Another important point is the use of force sensitive resistors (FSR) for simulating the hand touch pressure. These are used for the grasping stop simulating touch pressure of the fingers. Surface Electromyogram (EMG) sensors allow the user to control the prosthetic hand-grasping start. Their use may provide the prosthetic hand the possibility of the classification of the hand movements. The practical results included in the paper prove the importance of the soft joins for the object manipulation and to get adapted to the object surface. Finally, the force sensitive sensors allow the prosthesis to actuate more naturally by adding conditions and classifications to the Electromyogram sensor.

A hybrid auricular control system: direct, simultaneous, and proportional myoelectric control of two degrees of freedom in prosthetic hands

OBJECTIVE

The conventional myoelectric control scheme of hand prostheses provides a high level of robustness during continuous use. Typically, the electrical activity of an agonist/antagonist muscle pair in the forearm is detected and used to control either opening/closing or rotation of the prosthetic hand. The translation of more sophisticated control approaches (e.g. regression-based classifiers) to clinical practice is limited mainly because of their lack of robustness in real-world conditions (e.g. due to different arm positions). We therefore explore a new hybrid approach, in which a second degree of freedom (DOF) controlled by the myoelectric activity of the posterior auricular muscles is added to the conventional forearm control. With this, an independent, simultaneous and proportional control of rotation and opening/closing of the hand is possible.

APPROACH

In this study, we compared the hybrid auricular control system (hACS) to the two most commonly used control techniques for two DOF. Ten able-bodied subjects and one person with transradial amputation performed two standardizes tests in three different arm positions.

MAIN RESULTS

Subjects controlled a hand prosthesis significantly more rapidly and more accurately using the hACS. Moreover, the robustness of the system was not influenced by different arm positions.

SIGNIFICANCE

The hACS therefore offers an alternative solution for simultaneous and proportional myoelectric control of two degrees of freedom that avoids several robustness issues related to machine learning based approaches.

Epidermal mechano-acoustic sensing electronics for cardiovascular diagnostics and human-machine interfaces

Physiological mechano-acoustic signals, often with frequencies and intensities that are beyond those associated with the audible range, provide information of great clinical utility. Stethoscopes and digital accelerometers in conventional packages can capture some relevant data, but neither is suitable for use in a continuous, wearable mode, and both have shortcomings associated with mechanical transduction of signals through the skin. We report a soft, conformal class of device configured specifically for mechano-acoustic recording from the skin, capable of being used on nearly any part of the body, in forms that maximize detectable signals and allow for multimodal operation, such as electrophysiological recording. Experimental and computational studies highlight the key roles of low effective modulus and low areal mass density for effective operation in this type of measurement mode on the skin. Demonstrations involving seismocardiography and heart murmur detection in a series of cardiac patients illustrate utility in advanced clinical diagnostics. Monitoring of pump thrombosis in ventricular assist devices provides an example in characterization of mechanical implants. Speech recognition and human-machine interfaces represent additional demonstrated applications. These and other possibilities suggest broad-ranging uses for soft, skin-integrated digital technologies that can capture human body acoustics.

Control of a Robotic Hand Using a Tongue Control System-A Prosthesis Application

OBJECTIVE

The aim of this study was to investigate the feasibility of using an inductive tongue control system (ITCS) for controlling robotic/prosthetic hands and arms.

METHODS

This study presents a novel dual modal control scheme for multigrasp robotic hands combining standard electromyogram (EMG) with the ITCS. The performance of the ITCS control scheme was evaluated in a comparative study. Ten healthy subjects used both the ITCS control scheme and a conventional EMG control scheme to complete grasping exercises with the IH1 Azzurra robotic hand implementing five grasps. Time to activate a desired function or grasp was used as the performance metric.

RESULTS

Statistically significant differences were found when comparing the performance of the two control schemes. On average, the ITCS control scheme was 1.15 s faster than the EMG control scheme, corresponding to a 35.4% reduction in the activation time. The largest difference was for grasp 5 with a mean AT reduction of 45.3% (2.38 s).

CONCLUSION

The findings indicate that using the ITCS control scheme could allow for faster activation of specific grasps or functions compared with a conventional EMG control scheme.

SIGNIFICANCE

For transhumeral and especially bilateral amputees, the ITCS control scheme could have a significant impact on the prosthesis control. In addition, the ITCS would provide bilateral amputees with the additional advantage of environmental and computer control for which the ITCS was originally developed.

A comparative study of virtual hand prosthesis control using an inductive tongue control system

This study compares the time required to activate a grasp or function of a hand prosthesis when using an electromyogram (EMG) based control scheme and when using a control scheme combining EMG and control signals from an inductive tongue control system (ITCS). Using a cross-over study design, 10 able-bodied subjects used a computer model of a hand and completed simulated grasping exercises. The time required to activate grasps was recorded and analyzed for both control schemes. End session mean activation times (ATs; seconds) for the EMG control scheme grasps 1 -5 were 0.80, 1.51, 1.95, 2.93, and 3.42; for the ITCS control scheme grasps 1 ‒5 they were 1.19, 1.89, 1.75, 2.26, and 1.80. Mean AT for grasps 1 and 2 was statistically significant in favor of the EMG control scheme (p = 0.030; p = 0.004). For grasp 3 no statistical significance occurred, and for grasps 4 and 5 there was a statistical significance in favour of the ITCS control scheme (p = 0.048; p = 0.004). Based on the amount of training and the achieved level of performance, it is concluded that the proposed ITCS control scheme can be used as a means of enhancing prosthesis control.

Human-Machine Interface for the Control of Multi-Function Systems Based on Electrocutaneous Menu: Application to Multi-Grasp Prosthetic Hands

Modern assistive devices are very sophisticated systems with multiple degrees of freedom. However, an effective and user-friendly control of these systems is still an open problem since conventional human-machine interfaces (HMI) cannot easily accommodate the system’s complexity. In HMIs, the user is responsible for generating unique patterns of command signals directly triggering the device functions. This approach can be difficult to implement when there are many functions (necessitating many command patterns) and/or the user has a considerable impairment (limited number of available signal sources). In this study, we propose a novel concept for a general-purpose HMI where the controller and the user communicate bidirectionally to select the desired function. The system first presents possible choices to the user via electro-tactile stimulation; the user then acknowledges the desired choice by generating a single command signal. Therefore, the proposed approach simplifies the user communication interface (one signal to generate), decoding (one signal to recognize), and allows selecting from a number of options. To demonstrate the new concept the method was used in one particular application, namely, to implement the control of all the relevant functions in a state of the art commercial prosthetic hand without using any myoelectric channels. We performed experiments in healthy subjects and with one amputee to test the feasibility of the novel approach. The results showed that the performance of the novel HMI concept was comparable or, for some outcome measures, better than the classic myoelectric interfaces. The presented approach has a general applicability and the obtained results point out that it could be used to operate various assistive systems (e.g., prosthesis vs. wheelchair), or it could be integrated into other control schemes (e.g., myoelectric control, brain-machine interfaces) in order to improve the usability of existing low-bandwidth HMIs.

The extraction of neural information from the surface EMG for the control of upper-limb prostheses: emerging avenues and challenges

Despite not recording directly from neural cells, the surface electromyogram (EMG) signal contains information on the neural drive to muscles, i.e., the spike trains of motor neurons. Using this property, myoelectric control consists of the recording of EMG signals for extracting control signals to command external devices, such as hand prostheses. In commercial control systems, the intensity of muscle activity is extracted from the EMG and used for single degrees of freedom activation (direct control). Over the past 60 years, academic research has progressed to more sophisticated approaches but, surprisingly, none of these academic achievements has been implemented in commercial systems so far. We provide an overview of both commercial and academic myoelectric control systems and we analyze their performance with respect to the characteristics of the ideal myocontroller. Classic and relatively novel academic methods are described, including techniques for simultaneous and proportional control of multiple degrees of freedom and the use of individual motor neuron spike trains for direct control. The conclusion is that the gap between industry and academia is due to the relatively small functional improvement in daily situations that academic systems offer, despite the promising laboratory results, at the expense of a substantial reduction in robustness. None of the systems so far proposed in the literature fulfills all the important criteria needed for widespread acceptance by the patients, i.e. intuitive, closed-loop, adaptive, and robust real-time ( 200 ms delay) control, minimal number of recording electrodes with low sensitivity to repositioning, minimal training, limited complexity and low consumption. Nonetheless, in recent years, important efforts have been invested in matching these criteria, with relevant steps forwards.

The tracking of reaches in three-dimensions

Prosthetic devices to replace upper limb function have made great progress over the last decade. However, current control modalities for these prosthetics still have severe limitations in the degrees of freedom they offer patients. Brain machine interfaces offer the possibility to improve the functionality of prosthetics. Current research on brain machine interfaces is limited by our understanding of the neural representations for various movements. Few electrophysiology studies have examined the encoding of unconstrained multi-joint movements in neural signals. Here we present a system for the high-speed tracking of multiple joints in three dimensions while recording, optimizing and decoding neural signals.

Cognitive vision system for control of dexterous prosthetic hands: experimental evaluation

BACKGROUND

Dexterous prosthetic hands that were developed recently, such as SmartHand and i-LIMB, are highly sophisticated; they have individually controllable fingers and the thumb that is able to abduct/adduct. This flexibility allows implementation of many different grasping strategies, but also requires new control algorithms that can exploit the many degrees of freedom available. The current study presents and tests the operation of a new control method for dexterous prosthetic hands.

METHODS

The central component of the proposed method is an autonomous controller comprising a vision system with rule-based reasoning mounted on a dexterous hand (CyberHand). The controller, termed cognitive vision system (CVS), mimics biological control and generates commands for prehension. The CVS was integrated into a hierarchical control structure: 1) the user triggers the system and controls the orientation of the hand; 2) a high-level controller automatically selects the grasp type and size; and 3) an embedded hand controller implements the selected grasp using closed-loop position/force control. The operation of the control system was tested in 13 healthy subjects who used Cyberhand, attached to the forearm, to grasp and transport 18 objects placed at two different distances.

RESULTS

The system correctly estimated grasp type and size (nine commands in total) in about 84% of the trials. In an additional 6% of the trials, the grasp type and/or size were different from the optimal ones, but they were still good enough for the grasp to be successful. If the control task was simplified by decreasing the number of possible commands, the classification accuracy increased (e.g., 93% for guessing the grasp type only).

CONCLUSIONS

The original outcome of this research is a novel controller empowered by vision and reasoning and capable of high-level analysis (i.e., determining object properties) and autonomous decision making (i.e., selecting the grasp type and size). The automatic control eases the burden from the user and, as a result, the user can concentrate on what he/she does, not on how he/she should do it. The tests showed that the performance of the controller was satisfactory and that the users were able to operate the system with minimal prior training.