Recapitulating Flesh with Silicon and Steel: Advancements in Upper Extremity Robotic Prosthetics

A Biomimetic Circuit for Electronic Skin With Application in Hand Prosthesis

One major challenge in upper limb prostheses is providing sensory feedback to amputees. Reproducing the spiking patterns of human primary tactile afferents can be considered as the first step for this challenging problem. In this study, a novel biomimetic circuit for SA-I and RA-I afferents is proposed to functionally replicate the spiking response of the biological tactile afferents to indentation stimuli. The circuit has been designed, laid out, and simulated in TSMC 180nm CMOS technology with a 1.8V supply voltage. A pair of SA-I and RA-I afferent circuits consume [Formula: see text] of power. The occupied silicon area is [Formula: see text] for 32 afferents. To provide the inputs for circuit testing, a patch of skin with a grid of mechanoreceptors is simulated and tested by an edge stimulus presented at different orientations. Experimental data are collected using indentation of 3D-printed edges at different orientations on a tactile sensor mounted on a robotic arm. Inspired by innervation patterns observed in biology, the artificial afferents are connected to several neighboring mechanoreceptors with different weights to form complex receptive fields which cover the entire mechanoreceptor grid. Machine learning algorithms are applied offline to classify the edge orientations based on the pattern of neural responses. Our results show that the complex receptive fields arising from the innervation pattern led to smaller circuit area and lower power consumption, while facilitating data encoding from high-resolution sensors. The proposed biomimetic circuit and tactile encoding example demonstrate potential applications in modern tactile sensing modules for developing novel bio-robotic and prosthetic technologies.

Targeted Muscle Reinnervation for Prosthetic Control

Targeted muscle reinnervation (TMR) is a surgical procedure, whereby nerves without muscle targets after extremity amputation are transferred to residual stump muscles. Thereby, the control of prosthesis is improved by increasing the number of independent muscle signals. The authors describe indications for TMR to improve prosthetic control and present standard nerve transfer matrices suitable for transhumeral and glenohumeral amputees. In addition, the perioperative procedure is described, including preoperative testing, surgical approach, and postoperative rehabilitation. Based on recent neurophysiological insights and technological advances, they present an outlook into the future of prosthetic control combining TMR and implantable electromyographic technology.

Novel approach for electromyography-controlled prostheses based on facial action

Individuals with severe tetraplegia frequently require to control their complex assistive devices using body movement with the remaining activity above the neck. Electromyography (EMG) signals from the contractions of facial muscles enable people to produce multiple command signals by conveying information about attempted movements. In this study, a novel EMG-controlled system based on facial actions was developed. The mechanism of different facial actions was processed using an EMG control model. Four asymmetric and symmetry actions were defined to control a two-degree-of-freedom (2-DOF) prosthesis. Both indoor and outdoor experiments were conducted to validate the feasibility of EMG-controlled prostheses based on facial action. The experimental results indicated that the new paradigm presented in this paper yields high performance and efficient control for prosthesis applications. Graphical abstract Individuals with severe tetraplegia frequently require to control their complex assistive devices using body movement with the remaining activity above the neck. Electromyography (EMG) signals from the contractions of facial muscles enable people to produce multiple command signals by conveying information about attempted movements. In this study, a novel EMG-controlled system based on facial actions was developed. The mechanism of different facial actions was processed using an EMG control model. Four asymmetric and symmetry actions were defined to control a two-degree-of-freedom (2-DOF) prosthesis. Both indoor and outdoor experiments were conducted to validate the feasibility of EMG-controlled prostheses based on facial action. The experimental results indicated that the new paradigm presented in this paper yields high performance and efficient control for prosthesis applications.

Clinical neuroprosthetics: Today and tomorrow

Implantable neurostimulation devices provide a direct therapeutic link to the nervous system and can be considered brain-computer interfaces (BCI). Under this definition, BCI are not simply science fiction, they are part of existing neurosurgical practice. Clinical BCI are standard of care for historically difficult to treat neurological disorders. These systems target the central and peripheral nervous system and include Vagus Nerve Stimulation, Responsive Neurostimulation, and Deep Brain Stimulation. Recent advances in clinical BCI have focused on creating "closed-loop" systems. These systems rely on biomarker feedback and promise individualized therapy with optimal stimulation delivery and minimal side effects. Success of clinical BCI has paralleled research efforts to create BCI that restore upper extremity motor and sensory function to patients. Efforts to develop closed loop motor/sensory BCI is linked to the successes of today's clinical BCI.

An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm

One of the most exciting areas of rehabilitation research is brain-controlled prostheses, which translate electroencephalography (EEG) signals into control commands that operate prostheses. However, the existing brain-control methods have an obstacle between the selection of brain computer interface (BCI) and its performance. In this paper, a novel BCI system based on a facial expression paradigm is proposed to control prostheses that uses the characteristics of theta and alpha rhythms of the prefrontal and motor cortices. A portable brain-controlled prosthesis system was constructed to validate the feasibility of the facial-expression-based BCI (FE-BCI) system. Four types of facial expressions were used in this study. An effective filtering algorithm based on noise-assisted multivariate empirical mode decomposition (NA-MEMD) and sample entropy (SampEn) was used to remove electromyography (EMG) artifacts. A wavelet transform (WT) was applied to calculate the feature set, and a back propagation neural network (BPNN) was employed as a classifier. To prove the effectiveness of the FE-BCI system for prosthesis control, 18 subjects were involved in both offline and online experiments. The grand average accuracy over 18 subjects was 81.31 ± 5.82% during the online experiment. The experimental results indicated that the proposed FE-BCI system achieved good performance and can be efficiently applied for prosthesis control.

An approach for brain-controlled prostheses based on Scene Graph Steady-State Visual Evoked Potentials

Brain control technology can restore communication between the brain and a prosthesis, and choosing a Brain-Computer Interface (BCI) paradigm to evoke electroencephalogram (EEG) signals is an essential step for developing this technology. In this paper, the Scene Graph paradigm used for controlling prostheses was proposed; this paradigm is based on Steady-State Visual Evoked Potentials (SSVEPs) regarding the Scene Graph of a subject's intention. A mathematic model was built to predict SSVEPs evoked by the proposed paradigm and a sinusoidal stimulation method was used to present the Scene Graph stimulus to elicit SSVEPs from subjects. Then, a 2-degree of freedom (2-DOF) brain-controlled prosthesis system was constructed to validate the performance of the Scene Graph-SSVEP (SG-SSVEP)-based BCI. The classification of SG-SSVEPs was detected via the Canonical Correlation Analysis (CCA) approach. To assess the efficiency of proposed BCI system, the performances of traditional SSVEP-BCI system were compared. Experimental results from six subjects suggested that the proposed system effectively enhanced the SSVEP responses, decreased the degradation of SSVEP strength and reduced the visual fatigue in comparison with the traditional SSVEP-BCI system. The average signal to noise ratio (SNR) of SG-SSVEP was 6.31 ± 2.64 dB, versus 3.38 ± 0.78 dB of traditional-SSVEP. In addition, the proposed system achieved good performances in prosthesis control. The average accuracy was 94.58% ± 7.05%, and the corresponding high information transfer rate (IRT) was 19.55 ± 3.07 bit/min. The experimental results revealed that the SG-SSVEP based BCI system achieves the good performance and improved the stability relative to the conventional approach.

Broadband Prosthetic Interfaces: Combining Nerve Transfers and Implantable Multichannel EMG Technology to Decode Spinal Motor Neuron Activity

Modern robotic hands/upper limbs may replace multiple degrees of freedom of extremity function. However, their intuitive use requires a high number of control signals, which current man-machine interfaces do not provide. Here, we discuss a broadband control interface that combines targeted muscle reinnervation, implantable multichannel electromyographic sensors, and advanced decoding to address the increasing capabilities of modern robotic limbs. With targeted muscle reinnervation, nerves that have lost their targets due to an amputation are surgically transferred to residual stump muscles to increase the number of intuitive prosthetic control signals. This surgery re-establishes a nerve-muscle connection that is used for sensing nerve activity with myoelectric interfaces. Moreover, the nerve transfer determines neurophysiological effects, such as muscular hyper-reinnervation and cortical reafferentation that can be exploited by the myoelectric interface. Modern implantable multichannel EMG sensors provide signals from which it is possible to disentangle the behavior of single motor neurons. Recent studies have shown that the neural drive to muscles can be decoded from these signals and thereby the user's intention can be reliably estimated. By combining these concepts in chronic implants and embedded electronics, we believe that it is in principle possible to establish a broadband man-machine interface, with specific applications in prosthesis control. This perspective illustrates this concept, based on combining advanced surgical techniques with recording hardware and processing algorithms. Here we describe the scientific evidence for this concept, current state of investigations, challenges, and alternative approaches to improve current prosthetic interfaces.