Human-Inspired Reflex to Autonomously Prevent Slip of Grasped Objects Rotated with a Prosthetic Hand

Enhancing Force Control of Prosthetic Controller for Hand Prosthesis by Mimicking Biological Properties

Prosthetic hands are frequently rejected due to frustrations in daily uses. By adopting principles of human neuromuscular control, it could potentially achieve human-like compliance in hand functions, thereby improving functionality in prosthetic hand. Previous studies have confirmed the feasibility of real-time emulation of neuromuscular reflex for prosthetic control. This study further to explore the effect of feedforward electromyograph (EMG) decoding and proprioception on the biomimetic controller. The biomimetic controller included a feedforward Bayesian model for decoding alpha motor commands from stump EMG, a muscle model, and a closed-loop component with a model of muscle spindle modified with spiking afferents. Real-time control was enabled by neuromorphic hardware to accelerate evaluation of biologically inspired models. This allows us to investigate which aspects in the controller could benefit from biological properties for improvements on force control performance. 3 non-disabled and 3 amputee subjects were recruited to conduct a "press-without-break" task, subjects were required to press a transducer till the pressure stabilized in an expected range without breaking the virtual object. We tested whether introducing more complex but biomimetic models could enhance the task performance. Data showed that when replacing proportional feedback with the neuromorphic spindle, success rates of amputees increased by 12.2% and failures due to breakage decreased by 26.3%. More prominently, success rates increased by 55.5% and failures decreased by 79.3% when replacing a linear model of EMG with the Bayesian model in the feedforward EMG processing. Results suggest that mimicking biological properties in feedback and feedforward control may improve the manipulation of objects by amputees using prosthetic hands. Clinical and Translational Impact Statement: This control approach may eventually assist amputees to perform fine force control when using prosthetic hands, thereby improving the motor performance of amputees. It highlights the promising potential of the biomimetic controller integrating biological properties implemented on neuromorphic models as a viable approach for clinical application in prosthetic hands.

Examining the in vivo functionality of the Magnetically Aligned Regenerative Tissue-Engineered Electronic Nerve Interface (MARTEENI)

OBJECTIVE

Although neural-enabled prostheses have been used to restore some lost functionality in clinical trials, they have faced difficulty in achieving high degree of freedom, natural use compared to healthy limbs. This study investigated the in vivo functionality of a flexible and scalable regenerative peripheral-nerve interface suspended within a microchannel-embedded, tissue-engineered hydrogel (the Magnetically Aligned Regenerative Tissue-Engineered Electronic Nerve Interface, MARTEENI) as a potential approach to improving current issues in peripheral nerve interfaces.

APPROACH

Assembled MARTEENI devices were implanted in the gaps of severed sciatic nerves in Lewis rats. Both acute and chronic electrophysiology were recorded, and channel-isolated activity was examined. In terminal experiments, evoked activity during paw compression and stimulus response curves generated from proximal nerve stimulation were examined. Electrochemical impedance spectroscopy was performed to assess the complex impedance of recording sites during chronic data collection. Features of the foreign-body response in non-functional implants were examined using immunohistological methods.

MAIN RESULTS

Channel-isolated activity was observed in acute, chronic, and terminal experiments and showed a typically biphasic morphology with peak-to-peak amplitudes varying between 50 to 500 µV. For chronic experiments, electrophysiology was observed for 77 days post-implant. Within the templated hydrogel, regenerating axons formed minifascicles that varied in both size and axon count and were also found to surround device threads. No axons were found to penetrate the foreign-body response. Together these results suggest the MARTEENI is a promising approach for interfacing with peripheral nerves.

SIGNIFICANCE

Findings demonstrate a high likelihood that observed electrophysiological activity recorded from implanted MARTEENIs originated from neural tissue. The variation in minifascicle size seen histologically suggests that amplitude distributions observed in functional MARTEENIs may be due to a combination of individual axon and mini-compound action potentials. This study provided an assessment of a functional MARTEENI in an in vivo animal model for the first time.

Measuring mental workload in assistive wearable devices: a review

As wearable assistive devices, such as prostheses and exoskeletons, become increasingly sophisticated and effective, the mental workload associated with their use remains high and becomes a major challenge to their ecological use and long-term adoption. Numerous methods of measuring mental workload co-exist, making analysis of this research topic difficult. The aim of this review is to examine how mental workload resulting from the use of wearable assistive devices has been measured, in order to gain insight into the specific possibilities and limitations of this field. Literature searches were conducted in the main scientific databases and 60 articles measuring the mental workload induced by the use of a wearable assistive device were included in this study. Three main families of methods were identified, the most common being 'dual task' and 'subjective assessment' methods, followed by those based on 'physiological measures', which included a wide variety of methods. The variability of the measurements was particularly high, making comparison difficult. There is as yet no evidence that any particular method of measuring mental workload is more appropriate to the field of wearable assistive devices. Each method has intrinsic limitations such as subjectivity, imprecision, robustness or complexity of implementation or interpretation. A promising metric seems to be the measurement of brain activity, as it is the only method that is directly related to mental workload. Finally, regardless of the measurement method chosen, special attention should be paid to the measurement of mental workload in the context of wearable assistive devices. In particular, certain practical considerations, such as ecological situations and environments or the level of expertise of the participants tested, may be essential to ensure the validity of the mental workload assessed.

Neuromorphic Model of Reflex for Realtime Human-Like Compliant Control of Prosthetic Hand

Current control of prosthetic hands is ineffective when grasping deformable, irregular, or heavy objects. In humans, grasping is achieved under spinal reflexive control of the musculotendon skeletal structure, which produces a hand stiffness commensurate with the task. We hypothesize that mimicking reflex on a prosthetic hand may improve grasping performance and safety when interacting with human. Here, we present a design of compliant controller for prosthetic hand with a neuromorphic model of human reflex. The model includes 6 motoneuron pools containing 768 spiking neurons, 1 muscle spindle with 128 spiking afferents, and 1 modified Hill-type muscle. Models are implemented using neuromorphic hardware with 1 kHz real-time computing. Experimental tests showed that the prosthetic hand could sustain a 40 N load compared to 95 N for an adult. Stiffness range was adjustable from 60 to 640 N/m, about 46.6% of that of human hand. The grasping velocity could be ramped up to 14.4 cm/s, or 24% of the human peak velocity. The complaint control could switch between free movement and contact force when pressing a deformable beam. The amputee can achieve a 47% information throughput of healthy humans. Overall, the reflex-enabled prosthetic hand demonstrated the attributes of human compliant grasping with the neuromorphic model of spinal neuromuscular reflex.

Advanced technologies for intuitive control and sensation of prosthetics

The Department of Defense, Department of Veterans Affairs and National Institutes of Health have invested significantly in advancing prosthetic technologies over the past 25 years, with the overall intent to improve the function, participation and quality of life of Service Members, Veterans, and all United States Citizens living with limb loss. These investments have contributed to substantial advancements in the control and sensory perception of prosthetic devices over the past decade. While control of motorized prosthetic devices through the use of electromyography has been widely available since the 1980s, this technology is not intuitive. Additionally, these systems do not provide stimulation for sensory perception. Recent research has made significant advancement not only in the intuitive use of electromyography for control but also in the ability to provide relevant meaningful perceptions through various stimulation approaches. While much of this previous work has traditionally focused on those with upper extremity amputation, new developments include advanced bidirectional neuroprostheses that are applicable to both the upper and lower limb amputation. The goal of this review is to examine the state-of-the-science in the areas of intuitive control and sensation of prosthetic devices and to discuss areas of exploration for the future. Current research and development efforts in external systems, implanted systems, surgical approaches, and regenerative approaches will be explored.