Closed-Loop Control of Functional Electrical Stimulation Using a Selectively Recording and Bidirectional Nerve Cuff Interface

Discriminating recorded afferent neural information can provide sensory feedback for closed-loop control of functional electrical stimulation, which restores movement to paralyzed limbs. Previous work achieved state-of-the-art off-line classification of electrical activity in different neural pathways recorded by a multi-contact nerve cuff electrode, by applying deep learning to spatiotemporal neural patterns. The objective of this study was to demonstrate the feasibility of this approach in the context of closed-loop stimulation. Acute in vivo experiments were conducted on 11 Long Evans rats to demonstrate closed-loop stimulation. A 64-channel ( 8×8 ) nerve cuff electrode was implanted on each rat's sciatic nerve for recording and stimulation. A convolutional neural network (CNN) was trained with spatiotemporal signal recordings associated with 3 different states of the hindpaw (dorsiflexion, plantarflexion, and pricking of the heel). After training, firing rates were reconstructed from the classifier outputs for each of the three target classes. A rule-based closed-loop controller was implemented to produce ankle movement trajectories using neural stimulation, based on the classified nerve recordings. Closed-loop stimulation was successfully demonstrated in 6 subjects. The number of successful movement sequence trials per subject ranged from 1-17 and number of correct state transitions per trial ranged from 3-53. This work demonstrates that a CNN applied to multi-contact nerve cuff recordings can be used for closed-loop control of functional electrical stimulation.

Stabilizing leaning postures with feedback controlled functional neuromuscular stimulation after trunk paralysis

Spinal cord injury (SCI) can cause paralysis of trunk and hip musculature that negatively impacts seated balance and ability to lean away from an upright posture and interact fully with the environment. Constant levels of electrical stimulation of peripheral nerves can activate typically paralyzed muscles and aid in maintaining a single upright seated posture. However, in the absence of a feedback controller, such seated postures and leaning motions are inherently unstable and unable to respond to perturbations. Three individuals with motor complete SCI who had previously received a neuroprosthesis capable of activating the hip and trunk musculature volunteered for this study. Subject-specific muscle synergies were identified through system identification of the lumbar moments produced via neural stimulation. Synergy-based calculations determined the real-time stimulation parameters required to assume leaning postures. When combined with a proportional, integral, derivative (PID) feedback controller and an accelerometer to infer trunk orientation, all individuals were able to assume non-erect postures of 30-40° flexion and 15° lateral bending. Leaning postures increased forward reaching capabilities by 10.2, 46.7, and 16 cm respectively for each subject when compared with no stimulation. Additionally, the leaning controllers were able to resist perturbations of up to 90 N, and all subjects perceived the leaning postures as moderately to very stable. Implementation of leaning controllers for neuroprostheses have the potential of expanding workspaces, increasing independence, and facilitating activities of daily living for individuals with paralysis.

Robot-Inspired Human Impedance Control Through Functional Electrical Stimulation

Functional Electrical Stimulation is an effective tool to foster rehabilitation of neurological patients suffering from impaired motor functions. It can also serve as an assistive device to compensate for compromised motor functions in the chronic phase occurring after a disease or trauma. In all cases, the dominant paradigm in FES applications is that of aiding specialized, task-specific movements, such as reaching or grasping. Usually this is achieved by targeting specific muscle groups which are associated to the targeted motion by experts. A general purpose, FES-based control theory capable of enabling neurological patients to achieve a wide range of positional goals in their peri-personal space is still missing. In this paper, we present an early analysis of the performance achievable through a muscular impedance control loop employing FES to actuate force and movement. The control is evaluated in a test where the user's upper limb is moved by means of an exonerve to a series of target positions on a plane without providing visual feedback nor requiring volitional effort. The results allow to characterize the performance of such a setup over time and to assess how well can it generalize over different target positions in the user's peri-personal space. The current study population also allows to evaluate the effects of user's experience with FES systems on the overall performance during the test. The results indicate that the proposed control loop can generalize well over different arm poses.

A Co-driven Functional Electrical Stimulation Control Strategy by Dynamic Surface Electromyography and Joint Angle

Functional electrical stimulation (FES) is widely used in neurorehabilitation to improve patients’ motion ability. It has been verified to promote neural remodeling and relearning, during which FES has to produce an accurate movement to obtain a good efficacy. Therefore, many studies have focused on the relationship between FES parameters and the generated movements. However, most of the relationships have been established in static contractions, which leads to an unsatisfactory result when applied to dynamic conditions. Therefore, this study proposed a FES control strategy based on the surface electromyography (sEMG) and kinematic information during dynamic contractions. The pulse width (PW) of FES was determined by a direct transfer function (DTF) with sEMG features and joint angles as the input. The DTF was established by combing the polynomial transfer functions of sEMG and joint torque and the polynomial transfer functions of joint torque and FES. Moreover, the PW of two FES channels was set based on the muscle synergy ratio obtained through sEMG. A total of six healthy right-handed subjects were recruited in this experiment to verify the validity of the strategy. The PW of FES applied to the left arm was evaluated based on the sEMG of the right extensor carpi radialis (ECR) and the right wrist angle. The coefficient of determination (R²) and the normalized root mean square error (NRMSE) of FES-included and voluntary wrist angles and torques were used to verify the performance of the strategy. The result showed that this study achieved a high accuracy (R² = 0.965 and NRMSE = 0.047) of joint angle and a good accuracy (R² = 0.701 and NRMSE = 0.241) of joint torque reproduction during dynamic movements. Moreover, the DTF in real-time FES system also had a nice performance of joint angle fitting (R² = 0.940 and NRMSE = 0.071) and joint torque fitting (R² = 0.607 and NRMSE = 0.303). It is concluded that the proposed strategy is able to generate proper FES parameters based on sEMG and kinematic information for dynamic movement reproduction and can be used in a real-time FES system combined with bilateral movements for better rehabilitation.

An in vitro hand simulator for simultaneous control of hand and wrist movements

A human hand is a complex biomechanical system, in which bones, ligaments, and musculotendon units dynamically interact to produce seemingly simple motions. A new physiological hand simulator has been developed, in which electromechanical actuators apply load to the tendons of extrinsic hand and wrist muscles to recreate movements in cadaveric specimens in a biofidelic way. This novel simulator simultaneously and independently controls the movements of the wrist (flexion/extension and radio-ulnar deviation) and flexion/extension of the fingers and thumb. Control of these four degrees of freedom (DOF) is made possible by actuating eleven extrinsic muscles of the hand. The coupled dynamics of the wrist, fingers, and thumb, and the over-actuated nature of the human musculoskeletal system make feedback control of hand movements challenging. Two control algorithms were developed and tested. The optimal controller relies on an optimization algorithm to calculate the required tendon tensions using the collective error in all DOFs, and the action-based controller loads the tendons solely based on their actions on the controlled DOFs (e.g., activating all flexors if a flexing moment is required). Both controllers resulted in hand movements with small errors from the reference trajectories (<3.4); however, the optimal controller achieved this with 16% lower total force. Owing to its simpler structure, the action-based controller was extended to enable feedback control of grip force. This simulator has been shown to be a highly repeatable tool (<0.25 N and <0.2 variations in force and kinematics, respectively) for in vitro analyses of human hand biomechanics.

Predicting functional force production capabilities of upper extremity functional electrical stimulation neuroprostheses: a proof of concept study

OBJECTIVE

This study's goal was to demonstrate person-specific predictions of the force production capabilities of a paralyzed arm when actuated with a functional electrical stimulation (FES) neuroprosthesis. These predictions allow us to determine, for each hand position in a person's workspace, if FES activated muscles can produce enough force to hold the arm against gravity and other passive forces, the amount of force the arm can potentially exert on external objects, and in which directions FES can move the arm.

APPROACH

We computed force production predictions for a person with high tetraplegia and an FES neuroprosthesis used to activate muscles in her shoulder and arm. We developed Gaussian process regression models of the force produced at the end of the forearm when stimulating individual muscles at different wrist positions in the person's workspace. For any given wrist position, we predicted all possible forces a person can produce by any combination of individual muscles. Based on the force predictions, we determined if FES could produce force sufficient to overcome passive forces to hold a wrist position, the maximum force FES could produce in all directions, and the set of directions in which FES could move the arm. To estimate the error in our predictions, we then compared our force predictions based on single-muscle models to the actual forces produced when stimulating combinations of the person's muscles.

MAIN RESULTS

Our models classified the person's ability to hold static arm positions correctly for 83% (Session #1) and 69% (Session #2) for 39 wrist positions over two sessions. We predicted this person's ability to produce force at the end of her arm with an RMS error of 5.5 N and the percent of directions for which FES could achieve motion with RMS error of 10%. The accuracy of these predictions is similar to that found in the literature for FES systems with fewer degrees of freedom and fewer muscles.

SIGNIFICANCE

These person and device-specific predictions of functional capabilities of the arm allow neuroprosthesis developers to set achievable functional objectives for the systems they develop. These predictions can potentially serve as a screening tool for clinicians to use in planning neuroprosthetic interventions, greatly reducing the risk and uncertainty in such interventions.

Developing a Quasi-Static Controller for a Paralyzed Human Arm: A Simulation Study

Individuals with paralyzed limbs due to spinal cord injuries lack the ability to perform the reaching motions necessary to every day life. Functional electrical stimulation (FES) is a promising technology for restoring reaching movements to these individuals by reanimating their paralyzed muscles. We have proposed using a quasi-static model-based control strategy to achieve reaching controlled by FES. This method uses a series of static positions to connect the starting wrist position to the goal. As a first step to implementing this controller, we have completed a simulated study using a MATLAB based dynamic model of the arm in order to determine the suitable parameters for the quasi-static controller. The selected distance between static positions in the path was 6 cm, and the amount of time between switching target positions was 1.3 s. The final controller can complete reaches of over 30 cm with a median accuracy of 6.8 cm.

On the Relationship Between Muscle Synergies and Redundant Degrees of Freedom in Musculoskeletal Systems

It has been suggested that the human nervous system controls motions in the task (or operational) space. However, little attention has been given to the separation of the control of the task-related and task-irrelevant degrees of freedom. Aim: We investigate how muscle synergies may be used to separately control the task-related and redundant degrees of freedom in a computational model. Approach: We generalize an existing motor control model, and assume that the task and redundant spaces have orthogonal basis vectors. This assumption originates from observations that the human nervous system tightly controls the task-related variables, and leaves the rest uncontrolled. In other words, controlling the variables in one space does not affect the other space; thus, the actuations must be orthogonal in the two spaces. We implemented this assumption in the model by selecting muscle synergies that produce force vectors with orthogonal directions in the task and redundant spaces. Findings: Our experimental results show that the orthogonality assumption performs well in reconstructing the muscle activities from the measured kinematics/dynamics in the task and redundant spaces. Specifically, we found that approximately 70% of the variation in the measured muscle activity can be captured with the orthogonality assumption, while allowing efficient separation of the control in the two spaces. Implications: The developed motor control model is a viable tool in real-time simulations of musculoskeletal systems, as well as model-based control of bio-mechatronic systems, where a computationally efficient representation of the human motion controller is needed.

A Synergy-Based Motor Control Framework for the Fast Feedback Control of Musculoskeletal Systems

This paper presents a computational framework for the fast feedback control of musculoskeletal systems using muscle synergies. The proposed motor control framework has a hierarchical structure. A feedback controller at the higher level of hierarchy handles the trajectory planning and error compensation in the task space. This high-level task space controller only deals with the task-related kinematic variables, and thus is computationally efficient. The output of the task space controller is a force vector in the task space, which is fed to the low-level controller to be translated into muscle activity commands. Muscle synergies are employed to make this force-to-activation (F2A) mapping computationally efficient. The explicit relationship between the muscle synergies and task space forces allows for the fast estimation of muscle activations that result in the reference force. The synergy-enabled F2A mapping replaces a computationally heavy nonlinear optimization process by a vector decomposition problem that is solvable in real time. The estimation performance of the F2A mapping is evaluated by comparing the F2A-estimated muscle activities against the measured electromyography (EMG) data. The results show that the F2A algorithm can estimate the muscle activations using only the task-related kinematics/dynamics information with ∼70% accuracy. An example predictive simulation is also presented, and the results show that this feedback motor control framework can control arbitrary movements of a three-dimensional (3D) musculoskeletal arm model quickly and near optimally. It is two orders-of-magnitude faster than the optimal controller, with only 12% increase in muscle activities compared to the optimal. The developed motor control model can be used for real-time near-optimal predictive control of musculoskeletal system dynamics.