Restoring natural sensory feedback in real-time bidirectional hand prostheses

Sensory integration for neuroprostheses: from functional benefits to neural correlates

In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation-elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system.

Phantom limb syndrome: from pathogenesis to treatment. A narrative review

Phantom Limb Syndrome (PLS) can be defined as the disabling or painful sensation of the presence of a body part that is no longer present after its amputation. Anatomical changes involved in Phantom Limb Syndrome, occurring at peripheral, spinal and brain levels and include the formation of neuromas and scars, dorsal horn sensitization and plasticity, short-term and long-term modifications at molecular and topographical levels. The molecular reorganization processes of Phantom Limb Syndrome include NMDA receptors hyperactivation in the dorsal horn of the spinal column leading to inflammatory mechanisms both at a peripheral and central level. At the brain level, a central role has been recognized for sodium channels, BDNF and adenosine triphosphate receptors. In the paper we discuss current available pharmacological options with a final overview on non-pharmacological options in the pipeline.

Restoration of grasping in an upper limb amputee using the myokinetic prosthesis with implanted magnets

The loss of a hand disrupts the sophisticated neural pathways between the brain and the hand, severely affecting the level of independence of the patient and the ability to carry out daily work and social activities. Recent years have witnessed a rapid evolution of surgical techniques and technologies aimed at restoring dexterous motor functions akin to those of the human hand through bionic solutions, mainly relying on probing of electrical signals from the residual nerves and muscles. Here, we report the clinical implementation of an interface aimed at achieving this goal by exploiting muscle deformation, sensed through passive magnetic implants: the myokinetic interface. One participant with a transradial amputation received an implantation of six permanent magnets in three muscles of the residual limb. A truly self-contained myokinetic prosthetic arm embedding all hardware components and the battery within the prosthetic socket was developed. By retrieving muscle deformation caused by voluntary contraction through magnet localization, we were able to control in real time a dexterous robotic hand following both a direct control strategy and a pattern recognition approach. In just 6 weeks, the participant successfully completed a series of functional tests, achieving scores similar to those achieved when using myoelectric controllers, a standard-of-care solution, with comparable physical and mental workloads. This experience raised conceptual and technical limits of the interface, which nevertheless pave the way for further investigations in a partially unexplored field. This study also demonstrates a viable possibility for intuitively interfacing humans with robotic technologies.

A bioinspired tactile scanner for computer haptics

Computer haptics (CH) is about integration of tactile sensation and rendering in Metaverse. However, unlike computer vision (CV) where both hardware infrastructure and software programs are well developed, a generic tactile data capturing device that serves the same role as what a camera does for CV, is missing. Bioinspired by electrophysiological processes in human tactile somatosensory nervous system, here we propose a tactile scanner along with a neuromorphically-engineered system, in which a closed-loop tactile acquisition and rendering (re-creation) are preliminarily achieved. Based on the architecture of afferent nerves and intelligent functions of mechano-gating and leaky integrate-and-fire models, such a tactile scanner is designed and developed by using piezoelectric transducers as axon neurons and thin film transistor (TFT)-based neuromorphic circuits to mimic synaptic behaviours and neural functions. As an example, the neuron-like tactile information of surface textures is captured and further used to render the texture friction of a virtual surface for "recreating" a "true" feeling of touch.

Bioelectronics for electrical stimulation: materials, devices and biomedical applications

Bioelectronics is a hot research topic, yet an important tool, as it facilitates the creation of advanced medical devices that interact with biological systems to effectively diagnose, monitor and treat a broad spectrum of health conditions. Electrical stimulation (ES) is a pivotal technique in bioelectronics, offering a precise, non-pharmacological means to modulate and control biological processes across molecular, cellular, tissue, and organ levels. This method holds the potential to restore or enhance physiological functions compromised by diseases or injuries by integrating sophisticated electrical signals, device interfaces, and designs tailored to specific biological mechanisms. This review explains the mechanisms by which ES influences cellular behaviors, introduces the essential stimulation principles, discusses the performance requirements for optimal ES systems, and highlights the representative applications. From this review, we can realize the potential of ES based bioelectronics in therapy, regenerative medicine and rehabilitation engineering technologies, ranging from tissue engineering to neurological technologies, and the modulation of cardiovascular and cognitive functions. This review underscores the versatility of ES in various biomedical contexts and emphasizes the need to adapt to complex biological and clinical landscapes it addresses.

Characterization of a conductive hydrogel@Carbon fibers electrode as a novel intraneural interface

Peripheral neural interfaces facilitate bidirectional communication between the nervous system and external devices, enabling precise control for prosthetic limbs, sensory feedback systems, and therapeutic interventions in the field of Bioelectronic Medicine. Intraneural interfaces hold great promise since they ensure high selectivity in communicating only with the desired nerve fascicles. Despite significant advancements, challenges such as chronic immune response, signal degradation over time, and lack of long-term biocompatibility remain critical considerations in the development of such devices. Here we report on the development and benchtop characterization of a novel design of an intraneural interface based on carbon fiber bundles. Carbon fibers possess low impedance, enabling enhanced signal detection and stimulation efficacy compared to traditional metal electrodes. We provided a 3D-stabilizing structure for the carbon fiber bundles made of PEDOT:PSS hydrogel, to enhance the biocompatibility between the carbon fibers and the nervous tissue. We further coated the overall bundles with a thin layer of elastomeric material to provide electrical insulation. Taken together, our results demonstrated that our electrode possesses adequate structural and electrochemical properties to ensure proper stimulation and recording of peripheral nerve fibers and a biocompatible interface with the nervous tissue.

A preliminary study exploring the effects of transcutaneous spinal cord stimulation on spinal excitability and phantom limb pain in people with a transtibial amputation

Objective. Phantom limb pain (PLP) is debilitating and affects over 70% of people with lower-limb amputation. Other neuropathic pain conditions correspond with increased spinal excitability, which can be measured using reflexes andF-waves. Spinal cord neuromodulation can be used to reduce neuropathic pain in a variety of conditions and may affect spinal excitability, but has not been extensively used for treating PLP. Here, we propose using a non-invasive neuromodulation method, transcutaneous spinal cord stimulation (tSCS), to reduce PLP and modulate spinal excitability after transtibial amputation.Approach. We recruited three participants, two males (5- and 9-years post-amputation, traumatic and alcohol-induced neuropathy) and one female (3 months post-amputation, diabetic neuropathy) for this 5 d study. We measured pain using the McGill Pain Questionnaire (MPQ), visual analog scale (VAS), and pain pressure threshold (PPT) test. We measured spinal reflex and motoneuron excitability using posterior root-muscle (PRM) reflexes andF-waves, respectively. We delivered tSCS for 30 min d-1for 5 d.Main Results. After 5 d of tSCS, MPQ scores decreased by clinically-meaningful amounts for all participants from 34.0 ± 7.0-18.3 ± 6.8; however, there were no clinically-significant decreases in VAS scores. Two participants had increased PPTs across the residual limb (Day 1: 5.4 ± 1.6 lbf; Day 5: 11.4 ± 1.0 lbf).F-waves had normal latencies but small amplitudes. PRM reflexes had high thresholds (59.5 ± 6.1μC) and low amplitudes, suggesting that in PLP, the spinal cord is hypoexcitable. After 5 d of tSCS, reflex thresholds decreased significantly (38.6 ± 12.2μC;p< 0.001).Significance. These preliminary results in this non-placebo-controlled study suggest that, overall, limb amputation and PLP may be associated with reduced spinal excitability and tSCS can increase spinal excitability and reduce PLP.

Human tactile sensing and sensorimotor mechanism: from afferent tactile signals to efferent motor control

In tactile sensing, decoding the journey from afferent tactile signals to efferent motor commands is a significant challenge primarily due to the difficulty in capturing population-level afferent nerve signals during active touch. This study integrates a finite element hand model with a neural dynamic model by using microneurography data to predict neural responses based on contact biomechanics and membrane transduction dynamics. This research focuses specifically on tactile sensation and its direct translation into motor actions. Evaluations of muscle synergy during in -vivo experiments revealed transduction functions linking tactile signals and muscle activation. These functions suggest similar sensorimotor strategies for grasping influenced by object size and weight. The decoded transduction mechanism was validated by restoring human-like sensorimotor performance on a tendon-driven biomimetic hand. This research advances our understanding of translating tactile sensation into motor actions, offering valuable insights into prosthetic design, robotics, and the development of next-generation prosthetics with neuromorphic tactile feedback.

Restoration of sensory feedback from the foot and reduction of phantom limb pain via closed-loop spinal cord stimulation

Restoring somatosensory feedback in individuals with lower-limb amputations would reduce the risk of falls and alleviate phantom limb pain. Here we show, in three individuals with transtibial amputation (one traumatic and two owing to diabetic peripheral neuropathy), that sensations from the missing foot, with control over their location and intensity, can be evoked via lateral lumbosacral spinal cord stimulation with commercially available electrodes and by modulating the intensity of stimulation in real time on the basis of signals from a wireless pressure-sensitive shoe insole. The restored somatosensation via closed-loop stimulation improved balance control (with a 19-point improvement in the composite score of the Sensory Organization Test in one individual) and gait stability (with a 5-point improvement in the Functional Gait Assessment in one individual). And over the implantation period of the stimulation leads, the three individuals experienced a clinically meaningful decrease in phantom limb pain (with an average reduction of nearly 70% on a visual analogue scale). Our findings support the further clinical assessment of lower-limb neuroprostheses providing somatosensory feedback.

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, we exploited a recently developed non-invasive deep brain stimulation technique called transcranial temporal interference stimulation (tTIS) during reinforcement motor learning with concurrent neuroimaging, in a randomized, sham-controlled, double-blind study. Striatal tTIS applied at 80 Hz, but not at 20 Hz, abolished the benefits of reinforcement on motor learning. This effect was related to a selective modulation of neural activity within the striatum. Moreover, 80 Hz, but not 20 Hz, tTIS increased the neuromodulatory influence of the striatum on frontal areas involved in reinforcement motor learning. These results show that tTIS can non-invasively and selectively modulate a striatal mechanism involved in reinforcement learning, expanding our tools for the study of causal relationships between deep brain structures and human behaviour.

Our research path toward the restoration of natural sensations in hand prostheses

The human hand, with its intricate sensory capabilities, plays a pivotal role in our daily interactions with the world. This remarkable organ possesses a wide range of natural sensors that enrich our experiences, enabling us to perceive touch, position, and temperature. These natural sensors work in concert to provide us with a rich sensory experience, enabling us to distinguish between various textures, gauge the force of our grip, determine the position of our fingers without needing to see them, perceive the temperature of objects we come into contact with or detect if a cloth is wet or dry. This complex sensory system is fundamental to our ability to manipulate objects, explore our surroundings, and interact with the world and people around us. In this article, we summarize the research performed in our laboratories over the years and our findings to restore both touch, position, and temperature modalities. The combination of intraneural stimulation, sensory substitution, and wearable technology opens new possibilities for enhancing sensory feedback in prosthetic hands, promising improved functionality and a closer approximation to natural sensory experiences for individuals with limb differences.

Emerging Medical Technologies and Their Use in Bionic Repair and Human Augmentation

As both the proportion of older people and the length of life increases globally, a rise in age-related degenerative diseases, disability, and prolonged dependency is projected. However, more sophisticated biomedical materials, as well as an improved understanding of human disease, is forecast to revolutionize the diagnosis and treatment of conditions ranging from osteoarthritis to Alzheimer's disease as well as impact disease prevention. Another, albeit quieter, revolution is also taking place within society: human augmentation. In this context, humans seek to improve themselves, metamorphosing through self-discipline or more recently, through use of emerging medical technologies, with the goal of transcending aging and mortality. In this review, and in the pursuit of improved medical care following aging, disease, disability, or injury, we first highlight cutting-edge and emerging materials-based neuroprosthetic technologies designed to restore limb or organ function. We highlight the potential for these technologies to be utilized to augment human performance beyond the range of natural performance. We discuss and explore the growing social movement of human augmentation and the idea that it is possible and desirable to use emerging technologies to push the boundaries of what it means to be a healthy human into the realm of superhuman performance and intelligence. This potential future capability is contrasted with limitations in the right-to-repair legislation, which may create challenges for patients. Now is the time for continued discussion of the ethical strategies for research, implementation, and long-term device sustainability or repair.

Creation of a biological sensorimotor interface for bionic reconstruction

Neuromuscular control of bionic arms has constantly improved over the past years, however, restoration of sensation remains elusive. Previous approaches to reestablish sensory feedback include tactile, electrical, and peripheral nerve stimulation, however, they cannot recreate natural, intuitive sensations. Here, we establish an experimental biological sensorimotor interface and demonstrate its potential use in neuroprosthetics. We transfer a mixed nerve to a skeletal muscle combined with glabrous dermal skin transplantation, thus forming a bi-directional communication unit in a rat model. Morphological analyses indicate reinnervation of the skin, mechanoreceptors, NMJs, and muscle spindles. Furthermore, sequential retrograde labeling reveals specific sensory reinnervation at the level of the dorsal root ganglia. Electrophysiological recordings show reproducible afferent signals upon tactile stimulation and tendon manipulation. The results demonstrate the possibility of surgically creating an interface for both decoding efferent motor control, as well as encoding afferent tactile and proprioceptive feedback, and may indicate the way forward regarding clinical translation of biological communication pathways for neuroprosthetic applications.

DistaNet: grasp-specific distance biofeedback promotes the retention of myoelectric skills

Objective.An active myoelectric interface responds to the user's muscle signals to enable movements. Machine learning can decode user intentions from myoelectric signals. However, machine learning-based interface control lacks continuous, intuitive feedback about task performance, needed to facilitate the acquisition and retention of myoelectric control skills.Approach.We propose DistaNet as a neural network-based framework that extracts smooth, continuous, and low-dimensional signatures of the hand grasps from multi-channel myoelectric signals and provides grasp-specific biofeedback to the users.Main results.Experimental results show its effectiveness in decoding user gestures and providing biofeedback, helping users retain the acquired motor skills.Significance.We demonstrates myoelectric skill retention in a pattern recognition setting for the first time.

Real-time vibrotactile pattern generation and identification using discrete event-driven feedback

This study assesses human identification of vibrotactile patterns by using real-time discrete event-driven feedback. Previously acquired force and bend sensor data from a robotic hand were used to predict movement-type (stationary, flexion, contact, extension, release) and object-type (no object, hard object, soft object) states by using decision tree (DT) algorithms implemented in a field-programmable gate array (FPGA). Six able-bodied humans performed a 2- and 3-step sequential pattern recognition task in which state transitions were signaled as vibrotactile feedback. The stimuli were generated according to predicted classes represented by two frequencies (F1: 80 Hz, F2: 180 Hz) and two magnitudes (M1: low, M2: high) calibrated psychophysically for each participant; and they were applied by two actuators (Haptuators) placed on upper arms. A soft/hard object was mapped to F1/F2; and manipulating it with low/high force was assigned to M1/M2 in the left actuator. On the other hand, flexion/extension movement was mapped to F1/F2 in the right actuator, with movement in air as M1 and during object manipulation as M2. DT algorithm performed better for the object-type (97%) than the movement-type (88%) classification in real time. Participants could recognize feedback associated with 14 discrete-event sequences with low-to-medium accuracy. The performance was higher (76 ± 9% recall, 76 ± 17% precision, 78 ± 4% accuracy) for recognizing any one event in the sequences. The results show that FPGA implementation of classification for discrete event-driven vibrotactile feedback can be feasible in haptic devices with additional cues in the physical context.

Selective intrafascicular stimulation of myelinated and unmyelinated nerve fibers through a longitudinal electrode: A computational study

Carbon nanotube (CNT) fiber electrodes have demonstrated exceptional spatial selectivity and sustained reliability in the context of intrafascicular electrical stimulation, as evidenced through rigorous animal experimentation. A significant presence of unmyelinated C fibers, known to induce uncomfortable somatosensory experiences, exists within peripheral nerves. This presence poses a considerable challenge to the excitation of myelinated Aβ fibers, which are crucial for tactile sensation. To achieve nuanced tactile sensory feedback utilizing CNT fiber electrodes, the selective stimulation of Aβ sensory afferents emerges as a critical factor. In confronting this challenge, the present investigation sought to refine and apply a rat sciatic-nerve model leveraging the capabilities of the COMSOL-NEURON framework. This approach enables a systematic evaluation of the influence exerted by stimulation parameters and electrode geometry on the activation dynamics of both myelinated Aβ and unmyelinated C fibers. The findings advocate for the utilization of current pulses featuring a pulse width of 600 μs, alongside the deployment of CNT fibers characterized by a diminutive diameter of 10 μm, with an exclusively exposed cross-sectional area, to facilitate reduced activation current thresholds. Comparative analysis under monopolar and bipolar electrical stimulation conditions revealed proximate activation thresholds, albeit with bipolar stimulation exhibiting superior fiber selectivity relative to its monopolar counterpart. Concerning pulse waveform characteristics, the adoption of an anodic-first biphasic stimulation modality is favored, taking into account the dual criteria of activation threshold and fiber selectivity optimization. Consequently, this investigation furnishes an efficacious stimulation paradigm for the selective activation of touch-related nerve fibers, alongside provisioning a comprehensive theoretical foundation for the realization of natural tactile feedback within the domain of prosthetic hand applications.

Biomimetic versus arbitrary motor control strategies for bionic hand skill learning

A long-standing engineering ambition has been to design anthropomorphic bionic limbs: devices that look like and are controlled in the same way as the biological body (biomimetic). The untested assumption is that biomimetic motor control enhances device embodiment, learning, generalization and automaticity. To test this, we compared biomimetic and non-biomimetic control strategies for non-disabled participants when learning to control a wearable myoelectric bionic hand operated by an eight-channel electromyography pattern-recognition system. We compared motor learning across days and behavioural tasks for two training groups: biomimetic (mimicking the desired bionic hand gesture with biological hand) and arbitrary control (mapping an unrelated biological hand gesture with the desired bionic gesture). For both trained groups, training improved bionic limb control, reduced cognitive reliance and increased embodiment over the bionic hand. Biomimetic users had more intuitive and faster control early in training. Arbitrary users matched biomimetic performance later in training. Furthermore, arbitrary users showed increased generalization to a new control strategy. Collectively, our findings suggest that biomimetic and arbitrary control strategies provide different benefits. The optimal strategy is probably not strictly biomimetic, but rather a flexible strategy within the biomimetic-to-arbitrary spectrum, depending on the user, available training opportunities and user requirements.

Excitation of natural spinal reflex loops in the sensory-motor control of hand prostheses

Sensory feedback for prosthesis control is typically based on encoding sensory information in specific types of sensory stimuli that the users interpret to adjust the control of the prosthesis. However, in physiological conditions, the afferent feedback received from peripheral nerves is not only processed consciously but also modulates spinal reflex loops that contribute to the neural information driving muscles. Spinal pathways are relevant for sensory-motor integration, but they are commonly not leveraged for prosthesis control. We propose an approach to improve sensory-motor integration for prosthesis control based on modulating the excitability of spinal circuits through the vibration of tendons in a closed loop with muscle activity. We measured muscle signals in healthy participants and amputees during different motor tasks, and we closed the loop by applying vibration on tendons connected to the muscles, which modulated the excitability of motor neurons. The control signals to the prosthesis were thus the combination of voluntary control and additional spinal reflex inputs induced by tendon vibration. Results showed that closed-loop tendon vibration was able to modulate the neural drive to the muscles. When closed-loop tendon vibration was used, participants could achieve similar or better control performance in interfaces using muscle activation than without stimulation. Stimulation could even improve prosthetic grasping in amputees. Overall, our results indicate that closed-loop tendon vibration can integrate spinal reflex pathways in the myocontrol system and open the possibility of incorporating natural feedback loops in prosthesis control.

Spike timing-based coding in neuromimetic tactile system enables dynamic object classification

Rapid processing of tactile information is essential to human haptic exploration and dexterous object manipulation. Conventional electronic skins generate frames of tactile signals upon interaction with objects. Unfortunately, they are generally ill-suited for efficient coding of temporal information and rapid feature extraction. In this work, we report a neuromorphic tactile system that uses spike timing, especially the first-spike timing, to code dynamic tactile information about touch and grasp. This strategy enables the system to seamlessly code highly dynamic information with millisecond temporal resolution on par with the biological nervous system, yielding dynamic extraction of tactile features. Upon interaction with objects, the system rapidly classifies them in the initial phase of touch and grasp, thus paving the way to fast tactile feedback desired for neuro-robotics and neuro-prosthetics.

Toward more naturalistic tactile sensors

An artificial tactile system mimicking human touch enables effective object recognition.

Prosthetic Limb Attachment via Electromagnetic Attraction Through a Closed Skin Envelope

OBJECTIVE

Current socket-based methods of prosthetic limb attachment are responsible for many of the dominant problems reported by persons with amputation. In this work, we introduce a new paradigm for attachment via electromagnetic attraction between a bone-anchored ferromagnetic implant and an external electromagnet. Our objective was to develop a design framework for electromagnetic attachment, and to evaluate this framework in the context of transfemoral amputation.

METHODS

We first used inverse dynamics to calculate the forces required to suspend a knee-ankle-foot prosthesis during gait. We then conducted cadaveric dissections to inform implant geometry and design a surgical methodology for covering the implant. We also developed an in silico framework to investigate how electromagnet design affects system performance. Simulations were validated against benchtop testing of a custom-built electromagnet.

RESULTS

The physical electromagnet matched simulations, with a root-mean-square percentage error of 4.2% between measured and predicted forces. Using this electromagnet, we estimate that suspension of a prosthesis during gait would require 33 W of average power. After 200 and 1000 steps of simulated walking, the temperature at the skin would increase 2.3 °C and 15.4 °C relative to ambient, respectively.

CONCLUSION

Our design framework produced an implant and electromagnet that could feasibly suspend a knee-ankle-foot prosthesis during short walking bouts. Future work will focus on optimization of this system to reduce heating during longer bouts.

SIGNIFICANCE

This work demonstrates the initial feasibility of an electromagnetic prosthetic attachment paradigm that has the potential to increase comfort and improve residual limb health for persons with amputation.

A hybrid sensory feedback system for thermal nociceptive warning and protection in prosthetic hand

Background

Advanced prosthetic hands may embed nanosensors and microelectronics in their cosmetic skin. Heat influx may cause damage to these delicate structures. Protecting the integrity of the prosthetic hand becomes critical and necessary to ensure sustainable function. This study aims to mimic the sensorimotor control strategy of the human hand in perceiving nociceptive stimuli and triggering self-protective mechanisms and to investigate how similar neuromorphic mechanisms implemented in prosthetic hand can allow amputees to both volitionally release a hot object upon a nociceptive warning and achieve reinforced release via a bionic withdrawal reflex.

Methods

A steady-state temperature prediction algorithm was proposed to shorten the long response time of a thermosensitive temperature sensor. A hybrid sensory strategy for transmitting force and a nociceptive temperature warning using transcutaneous electrical nerve stimulation based on evoked tactile sensations was designed to reconstruct the nociceptive sensory loop for amputees. A bionic withdrawal reflex using neuromorphic muscle control technology was used so that the prosthetic hand reflexively opened when a harmful temperature was detected. Four able-bodied subjects and two forearm amputees randomly grasped a tube at the different temperatures based on these strategies.

Results

The average prediction error of temperature prediction algorithm was 8.30 ± 6.00%. The average success rate of six subjects in perceiving force and nociceptive temperature warnings was 86.90 and 94.30%, respectively. Under the reinforcement control mode in Test 2, the median reaction time of all subjects was 1.39 s, which was significantly faster than the median reaction time of 1.93 s in Test 1, in which two able-bodied subjects and two amputees participated. Results demonstrated the effectiveness of the integration of nociceptive sensory strategy and withdrawal reflex control strategy in a closed loop and also showed that amputees restored the warning of nociceptive sensation while also being able to withdraw from thermal danger through both voluntary and reflexive protection.

Conclusion

This study demonstrated that it is feasible to restore the sensorimotor ability of amputees to warn and react against thermal nociceptive stimuli. Results further showed that the voluntary release and withdrawal reflex can work together to reinforce heat protection. Nevertheless, fusing voluntary and reflex functions for prosthetic performance in activities of daily living awaits a more cogent strategy in sensorimotor control.

Nanoporous graphene-based thin-film microelectrodes for in vivo high-resolution neural recording and stimulation

One of the critical factors determining the performance of neural interfaces is the electrode material used to establish electrical communication with the neural tissue, which needs to meet strict electrical, electrochemical, mechanical, biological and microfabrication compatibility requirements. This work presents a nanoporous graphene-based thin-film technology and its engineering to form flexible neural interfaces. The developed technology allows the fabrication of small microelectrodes (25 µm diameter) while achieving low impedance (∼25 kΩ) and high charge injection (3-5 mC cm-2). In vivo brain recording performance assessed in rodents reveals high-fidelity recordings (signal-to-noise ratio >10 dB for local field potentials), while stimulation performance assessed with an intrafascicular implant demonstrates low current thresholds (<100 µA) and high selectivity (>0.8) for activating subsets of axons within the rat sciatic nerve innervating tibialis anterior and plantar interosseous muscles. Furthermore, the tissue biocompatibility of the devices was validated by chronic epicortical (12 week) and intraneural (8 week) implantation. This work describes a graphene-based thin-film microelectrode technology and demonstrates its potential for high-precision and high-resolution neural interfacing.

Three Sliding Probes Placed on Forelimb Skin for Proprioceptive Feedback Differentially yet Complementarily Contribute to Hand Gesture Detection and Object-Size Discrimination

The purpose was to assess the effectiveness of three sliding tactile probes placed on the forelimb skin to provide proprioceptive feedback for the detection of hand gestures and discrimination of object size. Tactile contactors representing the first three fingers were driven along the proximodistal axis by linear servo motors. Twenty healthy subjects were involved in the gesture detection test, with 10 of them also participating in the object-size discrimination task. Motors were controlled by computer in the first four sessions of the gesture detection experiment, while the fifth session utilized a sensorized glove. Both the volar and dorsal sides of the forearm were examined. In the object-size discrimination experiment, the method was exclusively assessed on the volar surface under four distinct feedback conditions, including all fingers and each finger separately. The psychophysical data were further analyzed using a structural equation model (SEM) to evaluate the specific contributions of each individual contactor. Subjects consistently outperformed the chance level in detecting gestures. Performance improved up to the third session, with better results obtained on the volar side. The performances were similar in the fourth and fifth sessions. The just noticeable difference for achieving a 75% discrimination accuracy was found to be 2.90 mm of movement on the skin. SEM analysis indicated that the contactor for the index finger had the lowest importance in gesture detection, while it played a more significant role in object-size discrimination. However, all fingers were found to be significant predictors of subjects' responses in both experiments, except for the thumb, which was deemed insignificant in object-size discrimination. The study highlights the importance of considering the partial contribution of each degree of freedom in a sensory feedback system, especially concerning the task, when designing such systems.

A Sensory Feedback Neural Stimulator Prototype for Both Implantable and Wearable Applications

The restoration of sensory feedback is one of the current challenges in the field of prosthetics. This work, following the analysis of the various types of sensory feedback, aims to present a prototype device that could be used both for implantable applications to perform PNS and for wearable applications, performing TENS, to restore sensory feedback. The two systems are composed of three electronic boards that are presented in detail, as well as the bench tests carried out. To the authors' best knowledge, this work presents the first device that can be used in a dual scenario for restoring sensory feedback. Both the implantable and wearable versions respected the expected values regarding the stimulation parameters. In its implantable version, the proposed system allows simultaneous and independent stimulation of 30 channels. Furthermore, the capacity of the wearable version to elicit somatic sensations was evaluated on healthy participants demonstrating performance comparable with commercial solutions.

An Investigation of Manifold-Based Direct Control for a Brain-to-Body Neural Bypass

Objective: Brain-body interfaces (BBIs) have emerged as a very promising solution for restoring voluntary hand control in people with upper-limb paralysis. The BBI module decoding motor commands from brain signals should provide the user with intuitive, accurate, and stable control. Here, we present a preliminary investigation in a monkey of a brain decoding strategy based on the direct coupling between the activity of intrinsic neural ensembles and output variables, aiming at achieving ease of learning and long-term robustness. Results: We identified an intrinsic low-dimensional space (called manifold) capturing the co-variation patterns of the monkey's neural activity associated to reach-to-grasp movements. We then tested the animal's ability to directly control a computer cursor using cortical activation along the manifold axes. By daily recalibrating only scaling factors, we achieved rapid learning and stable high performance in simple, incremental 2D tasks over more than 12 weeks of experiments. Finally, we showed that this brain decoding strategy can be effectively coupled to peripheral nerve stimulation to trigger voluntary hand movements. Conclusions: These results represent a proof of concept of manifold-based direct control for BBI applications.

Activity-dependent recruitment of inhibition and excitation in the awake mammalian cortex during electrical stimulation

Electrical stimulation is an effective tool for mapping and altering brain connectivity, with applications ranging from treating pharmacology-resistant neurological disorders to providing sensory feedback for neural prostheses. Paramount to the success of these applications is the ability to manipulate electrical currents to precisely control evoked neural activity patterns. However, little is known about stimulation-evoked responses in inhibitory neurons nor how stimulation-evoked activity patterns depend on ongoing neural activity. In this study, we used 2-photon imaging and cell-type specific labeling to measure single-cell responses of excitatory and inhibitory neurons to electrical stimuli in the visual cortex of awake mice. Our data revealed strong interactions between electrical stimulation and pre-stimulus activity of single neurons in awake animals and distinct recruitment and response patterns for excitatory and inhibitory neurons. This work demonstrates the importance of cell-type-specific labeling of neurons in future studies.

The role of stimulus periodicity on spinal cord stimulation-induced artificial sensations in rodents

Objective.Sensory feedback is critical for effectively controlling brain-machine interfaces and neuroprosthetic devices. Spinal cord stimulation (SCS) is proposed as a technique to induce artificial sensory perceptions in rodents, monkeys, and humans. However, to realize the full potential of SCS as a sensory neuroprosthetic technology, a better understanding of the effect of SCS pulse train parameter changes on sensory detection and discrimination thresholds is necessary.Approach.Here we investigated whether stimulation periodicity impacts rats' ability to detect and discriminate SCS-induced perceptions at different frequencies.Main results.By varying the coefficient of variation (CV) of interstimulus pulse interval, we showed that at lower frequencies, rats could detect highly aperiodic SCS pulse trains at lower amplitudes (i.e. decreased detection thresholds). Furthermore, rats learned to discriminate stimuli with subtle differences in periodicity, and the just-noticeable differences from a highly aperiodic stimulus were smaller than those from a periodic stimulus.Significance.These results demonstrate that the temporal structure of an SCS pulse train is an integral parameter for modulating sensory feedback in neuroprosthetic applications.

Neural population dynamics reveals disruption of spinal circuits' responses to proprioceptive input during electrical stimulation of sensory afferents

While neurostimulation technologies are rapidly approaching clinical applications for sensorimotor disorders, the impact of electrical stimulation on network dynamics is still unknown. Given the high degree of shared processing in neural structures, it is critical to understand if neurostimulation affects functions that are related to, but not targeted by, the intervention. Here, we approach this question by studying the effects of electrical stimulation of cutaneous afferents on unrelated processing of proprioceptive inputs. We recorded intraspinal neural activity in four monkeys while generating proprioceptive inputs from the radial nerve. We then applied continuous stimulation to the radial nerve cutaneous branch and quantified the impact of the stimulation on spinal processing of proprioceptive inputs via neural population dynamics. Proprioceptive pulses consistently produce neural trajectories that are disrupted by concurrent cutaneous stimulation. This disruption propagates to the somatosensory cortex, suggesting that electrical stimulation can perturb natural information processing across the neural axis.

Biomimetic computer-to-brain communication enhancing naturalistic touch sensations via peripheral nerve stimulation

Artificial communication with the brain through peripheral nerve stimulation shows promising results in individuals with sensorimotor deficits. However, these efforts lack an intuitive and natural sensory experience. In this study, we design and test a biomimetic neurostimulation framework inspired by nature, capable of "writing" physiologically plausible information back into the peripheral nervous system. Starting from an in-silico model of mechanoreceptors, we develop biomimetic stimulation policies. We then experimentally assess them alongside mechanical touch and common linear neuromodulations. Neural responses resulting from biomimetic neuromodulation are consistently transmitted towards dorsal root ganglion and spinal cord of cats, and their spatio-temporal neural dynamics resemble those naturally induced. We implement these paradigms within the bionic device and test it with patients (ClinicalTrials.gov identifier NCT03350061). He we report that biomimetic neurostimulation improves mobility (primary outcome) and reduces mental effort (secondary outcome) compared to traditional approaches. The outcomes of this neuroscience-driven technology, inspired by the human body, may serve as a model for advancing assistive neurotechnologies.

Using Compound Neural Action Potentials for Functional Validation of a High-Density Intraneural Interface: A Preliminary Study

Compound nerve action potentials (CNAPs) were used as a metric to assess the stimulation performance of a novel high-density, transverse, intrafascicular electrode in rat models. We show characteristic CNAPs recorded from distally implanted cuff electrodes. Evaluation of the CNAPs as a function of stimulus current and calculation of recruitment plots were used to obtain a qualitative approximation of the neural interface's placement and orientation inside the nerve. This method avoids elaborate surgeries required for the implantation of EMG electrodes and thus minimizes surgical complications and may accelerate the healing process of the implanted subject.

[Prosthetic Fitting Concepts after Major Amputation in the Upper Limb - an Overview of Current Possibilities]

BACKGROUND

The upper extremity and particularly the hands are crucial for patients in interacting with their environment, therefore amputations or severe damage with loss of hand function significantly impact their quality of life. In cases where biological reconstruction is not feasible or does not lead to sufficient success, bionic reconstruction plays a key role in patient care. Classical myoelectric prostheses are controlled using two signals derived from surface electrodes in the area of the stump muscles. Prosthesis control, especially in high amputations, is then limited and cumbersome. The surgical technique of Targeted Muscle Reinnervation (TMR) offers an innovative solution: The major arm nerves that have lost their target organs due to amputation are rerouted to muscles in the stump area. This enables the establishment of cognitive control signals that allow significantly improved prosthesis control.

PATIENTS/MATERIALS AND METHODS

A selective literature review on TMR and bionic reconstruction was conducted, incorporating relevant articles and discussing them considering the clinical experience of our research group. Additionally, a clinical case is presented.

RESULTS

Bionic reconstruction combined with Targeted Muscle Reinnervation enables intuitive prosthetic control with simultaneous movement of various prosthetic degrees of freedom and the treatment of neuroma and phantom limb pain. Long-term success requires a high level of patient compliance and intensive signal training during the prosthetic rehabilitation phase. Despite technological advances, challenges persist, especially in enhancing signal transmission and integrating natural sensory feedback into bionic prostheses.

CONCLUSION

TMR surgery represents a significant advancement in the bionic care of amputees. Employing selective nerve transfers for signal multiplication and amplification, opens up possibilities for improving myoelectric prosthesis function and thus enhancing patient care. Advances in the area of external prosthetic components, improvements in the skeletal connection due to osseointegration and more fluid signal transmission using wireless, fully implanted electrode systems will lead to significant progress in bionic reconstruction, both in terms of precision of movement and embodiment.

Merging Humans and Neuroprosthetics through Regenerative Peripheral Nerve Interfaces

Limb amputations can be devastating and significantly affect an individual's independence, leading to functional and psychosocial challenges in nearly 2 million people in the United States alone. Over the past decade, robotic devices driven by neural signals such as neuroprostheses have shown great potential to restore the lost function of limbs, allowing amputees to regain movement and sensation. However, current neuroprosthetic interfaces have challenges in both signal quality and long-term stability. To overcome these limitations and work toward creating bionic limbs, the Neuromuscular Laboratory at University of Michigan Plastic Surgery has developed the Regenerative Peripheral Nerve Interface (RPNI). This surgical construct embeds a transected peripheral nerve into a free muscle graft, effectively amplifying small peripheral nerve signals to provide enhanced control signals for a neuroprosthetic limb. Furthermore, the RPNI has the potential to provide sensory feedback to the user and facilitate neuroprosthesis embodiment. This review focuses on the animal studies and clinical trials of the RPNI to recapitulate the promising trajectory toward neurobionics where the boundary between an artificial device and the human body becomes indistinct. This paper also sheds light on the prospects of the improvement and dissemination of the RPNI technology.

Clinical outcomes of peripheral nerve interfaces for rehabilitation in paralysis and amputation: a literature review

Peripheral nerve interfaces (PNIs) are electrical systems designed to integrate with peripheral nerves in patients, such as following central nervous system (CNS) injuries to augment or replace CNS control and restore function. We review the literature for clinical trials and studies containing clinical outcome measures to explore the utility of human applications of PNIs. We discuss the various types of electrodes currently used for PNI systems and their functionalities and limitations. We discuss important design characteristics of PNI systems, including biocompatibility, resolution and specificity, efficacy, and longevity, to highlight their importance in the current and future development of PNIs. The clinical outcomes of PNI systems are also discussed. Finally, we review relevant PNI clinical trials that were conducted, up to the present date, to restore the sensory and motor function of upper or lower limbs in amputees, spinal cord injury patients, or intact individuals and describe their significant findings. This review highlights the current progress in the field of PNIs and serves as a foundation for future development and application of PNI systems.

Cortical Reorganization after Limb Loss: Bridging the Gap between Basic Science and Clinical Recovery

Despite the increasing incidence and prevalence of amputation across the globe, individuals with acquired limb loss continue to struggle with functional recovery and chronic pain. A more complete understanding of the motor and sensory remodeling of the peripheral and central nervous system that occurs postamputation may help advance clinical interventions to improve the quality of life for individuals with acquired limb loss. The purpose of this article is to first provide background clinical context on individuals with acquired limb loss and then to provide a comprehensive review of the known motor and sensory neural adaptations from both animal models and human clinical trials. Finally, the article bridges the gap between basic science researchers and clinicians that treat individuals with limb loss by explaining how current clinical treatments may restore function and modulate phantom limb pain using the underlying neural adaptations described above. This review should encourage the further development of novel treatments with known neurological targets to improve the recovery of individuals postamputation.Significance Statement In the United States, 1.6 million people live with limb loss; this number is expected to more than double by 2050. Improved surgical procedures enhance recovery, and new prosthetics and neural interfaces can replace missing limbs with those that communicate bidirectionally with the brain. These advances have been fairly successful, but still most patients experience persistent problems like phantom limb pain, and others discontinue prostheses instead of learning to use them daily. These problematic patient outcomes may be due in part to the lack of consensus among basic and clinical researchers regarding the plasticity mechanisms that occur in the brain after amputation injuries. Here we review results from clinical and animal model studies to bridge this clinical-basic science gap.

Morphology and morphometry of the ulnar nerve in the forelimb of pigs

The knowledge of the morphology and morphometry of peripheral nerves is essential for developing neural interfaces and understanding nerve regeneration in basic and applied research. Currently, the most adopted animal model is the rat, even though recent studies have suggested that the neuroanatomy of large animal models is more comparable to humans. The present knowledge of the morphological structure of large animal models is limited; therefore, the present study aims to describe the morphological characteristics of the Ulnar Nerve (UN) in pigs. UN cross-sections were taken from seven Danish landrace pigs at three distinct locations: distal UN, proximal UN and at the dorsal cutaneous branch of the UN (DCBUN). The nerve diameter, fascicle diameter and number, number of fibres and fibre size were quantified. The UN diameter was larger in the proximal section compared to the distal segment and the DCBUN. The proximal branch also had a more significant number of fascicles (median: 15) than the distal (median: 10) and the DCBUN (median: 11) segments. Additionally, the mean fascicle diameter was smaller at the DCBUN (mean: 165 μm) than at the distal (mean: 197 μm) and proximal (mean: 199 μm) segments of the UN. Detailed knowledge of the microscopical structure of the UN in pigs is critical for further studies investigating neural interface designs and computational models of the peripheral nervous system.

Artificial Neuron Devices

Efforts to design devices emulating complex cognitive abilities and response processes of biological systems have long been a coveted goal. Recent advancements in flexible electronics, mirroring human tissue's mechanical properties, hold significant promise. Artificial neuron devices, hinging on flexible artificial synapses, bioinspired sensors, and actuators, are meticulously engineered to mimic the biological systems. However, this field is in its infancy, requiring substantial groundwork to achieve autonomous systems with intelligent feedback, adaptability, and tangible problem-solving capabilities. This review provides a comprehensive overview of recent advancements in artificial neuron devices. It starts with fundamental principles of artificial synaptic devices and explores artificial sensory systems, integrating artificial synapses and bioinspired sensors to replicate all five human senses. A systematic presentation of artificial nervous systems follows, designed to emulate fundamental human nervous system functions. The review also discusses potential applications and outlines existing challenges, offering insights into future prospects. We aim for this review to illuminate the burgeoning field of artificial neuron devices, inspiring further innovation in this captivating area of research.

Fusion of dual modalities of non-invasive sensory feedback for object profiling with prosthetic hands

Introduction

Either non-invasive somatotopic or substitute sensory feedback is capable of conveying a single modality of sensory information from prosthetic hands to amputees. However, the neurocognitive ability of amputees to integrate multi-modality sensory information for functional discrimination is unclear. The purpose of this study was to assess the fusion of non-invasive somatotopic tactile and substitute aperture feedbacks for profile perception of multiple physical features during grasping objects.

Methods

Two left transradial amputees with somatotopic evoked tactile sensation (ETS) of five fingers participated in the study. The tactile information of prosthetic hand was provided to amputees by the ETS feedback elicited on the stump projected finger map. Hand aperture information was conveyed to amputees with substitute electrotactile stimulation on the forearm or upper arm. Two types of sensory feedback were integrated to a commercial prosthetic hand. The efficacy of somatotopic ETS feedback on object length identification task was assessed with or without substitute aperture stimulation. The object size identification task was utilized to assess how ETS stimulation at the stump may affect aperture perception with stimulation on the ipsilateral upper arm or forearm. Finally, the task of identifying combined length and size was conducted to evaluate the ability of amputees to integrate the dual modalities of sensory feedback for perceiving profile features.

Results

The study revealed that amputee subjects can effectively integrate the ETS feedback with electrotactile substitutive feedback for object profile discrimination. Specifically, ETS was robust to provide object length information with electrotactile stimulation at either the forearm or upper arm. However, electrotactile stimulation at the upper arm for aperture perception was less susceptible to the interference of ETS stimulation than at the forearm.

Discussion

Amputee subjects are able to combine somatotopic ETS and aperture feedbacks for identifying multi-dimensional features in object profiling. The two sensory streams of information can be fused effectively without mutual interference for functional discrimination.

Sensory Restoration for Improved Motor Control of Prostheses

Somatosensory neuroprostheses are devices with the potential to restore the senses of touch and movement from prosthetic limbs for people with limb amputation or paralysis. By electrically stimulating the peripheral or central nervous system, these devices evoke sensations that appear to emanate from the missing or insensate limb, and when paired with sensors on the prosthesis, they can improve the functionality and embodiment of the prosthesis. There have been major advances in the design of these systems over the past decade, although several important steps remain before they can achieve widespread clinical adoption outside the lab setting. Here, we provide a brief overview of somatosensory neuroprostheses and explores these hurdles and potential next steps towards clinical translation.

Touch, press and stroke: a soft capacitive sensor skin

Soft sensors that can discriminate shear and normal force could help provide machines the fine control desirable for safe and effective physical interactions with people. A capacitive sensor is made for this purpose, composed of patterned elastomer and containing both fixed and sliding pillars that allow the sensor to deform and buckle, much like skin itself. The sensor differentiates between simultaneously applied normal force and shear using summation and differences of signals from four deformable capacitors. Cross talk from shear to normal force is less than 2.5%, and between shear axes is less than 10%. Normal and shear stress sensitivity is 0.49 kPa and 0.31 kPa respectively, with a minimum displacement resolution of 40 μm. In addition, finger proximity is detectable at a range of up to 15 mm. The operation is demonstrated on a simple gripper holding a cup. The combination of features and the straightforward fabrication method make this sensor a candidate for implementation as a sensing skin for humanoid robotics applications.

Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm

The main goal of this research is to develop a highly advanced anthropomorphic control system utilizing multiple sensor technologies to achieve precise control of a robotic arm. Combining Kinect and IMU sensors, together with a data glove, we aim to create a multimodal sensor system for capturing rich information of human upper body movements. Specifically, the four angles of upper limb joints are collected using the Kinect sensor and IMU sensor. In order to improve the accuracy and stability of motion tracking, we use the Kalman filter method to fuse the Kinect and IMU data. In addition, we introduce data glove technology to collect the angle information of the wrist and fingers in seven different directions. The integration and fusion of multiple sensors provides us with full control over the robotic arm, giving it flexibility with 11 degrees of freedom. We successfully achieved a variety of anthropomorphic movements, including shoulder flexion, abduction, rotation, elbow flexion, and fine movements of the wrist and fingers. Most importantly, our experimental results demonstrate that the anthropomorphic control system we developed is highly accurate, real-time, and operable. In summary, the contribution of this study lies in the creation of a multimodal sensor system capable of capturing and precisely controlling human upper limb movements, which provides a solid foundation for the future development of anthropomorphic control technologies. This technology has a wide range of application prospects and can be used for rehabilitation in the medical field, robot collaboration in industrial automation, and immersive experience in virtual reality environments.

A highly integrated bionic hand with neural control and feedback for use in daily life

Restoration of sensorimotor function after amputation has remained challenging because of the lack of human-machine interfaces that provide reliable control, feedback, and attachment. Here, we present the clinical implementation of a transradial neuromusculoskeletal prosthesis-a bionic hand connected directly to the user's nervous and skeletal systems. In one person with unilateral below-elbow amputation, titanium implants were placed intramedullary in the radius and ulna bones, and electromuscular constructs were created surgically by transferring the severed nerves to free muscle grafts. The native muscles, free muscle grafts, and ulnar nerve were implanted with electrodes. Percutaneous extensions from the titanium implants provided direct skeletal attachment and bidirectional communication between the implanted electrodes and a prosthetic hand. Operation of the bionic hand in daily life resulted in improved prosthetic function, reduced postamputation, and increased quality of life. Sensations elicited via direct neural stimulation were consistently perceived on the phantom hand throughout the study. To date, the patient continues using the prosthesis in daily life. The functionality of conventional artificial limbs is hindered by discomfort and limited and unreliable control. Neuromusculoskeletal interfaces can overcome these hurdles and provide the means for the everyday use of a prosthesis with reliable neural control fixated into the skeleton.

Mold-Free Manufacturing of Highly Sensitive and Fast-Response Pressure Sensors Through High-Resolution 3D Printing and Conformal Oxidative Chemical Vapor Deposition Polymers

A new manufacturing paradigm is showcased to exclude conventional mold-dependent manufacturing of pressure sensors, which typically requires a series of complex and expensive patterning processes. This mold-free manufacturing leverages high-resolution 3D-printed multiscale microstructures as the substrate and a gas-phase conformal polymer coating technique to complete the mold-free sensing platform. The array of dome and spike structures with a controlled spike density of a 3D-printed substrate ensures a large contact surface with pressures applied and extended linearity in a wider pressure range. For uniform coating of sensing elements on the microstructured surface, oxidative chemical vapor deposition is employed to deposit a highly conformal and conductive sensing element, poly(3,4-ethylenedioxythiophene) at low temperatures (<60 °C). The fabricated pressure sensor reacts sensitively to various ranges of pressures (up to 185 kPa-1 ) depending on the density of the multiscale features and shows an ultrafast response time (≈36 µs). The mechanism investigations through the finite element analysis identify the effect of the multiscale structure on the figure-of-merit sensing performance. These unique findings are expected to be of significant relevance to technology that requires higher sensing capability, scalability, and facile adjustment of a sensor geometry in a cost-effective manufacturing manner.

From rubber hands to neuroprosthetics: Neural correlates of embodiment

Our interaction with the world rests on the knowledge that we are a body in space and time, which can interact with the environment. This awareness is usually referred to as sense of embodiment. For the good part of the past 30 years, the rubber hand illusion (RHI) has been a prime tool to study embodiment in healthy and people with a variety of clinical conditions. In this paper, we provide a critical overview of this research with a focus on the RHI paradigm as a tool to study prothesis embodiment in individuals with amputation. The RHI relies on well-documented multisensory integration mechanisms based on sensory precision, where parietal areas are involved in resolving the visuo-tactile conflict, and premotor areas in updating the conscious bodily representation. This mechanism may be transferable to prosthesis ownership in amputees. We discuss how these results might transfer to technological development of sensorised prostheses, which in turn might progress the acceptability by users.

Automated calibration of somatosensory stimulation using reinforcement learning

BACKGROUND

The identification of the electrical stimulation parameters for neuromodulation is a subject-specific and time-consuming procedure that presently mostly relies on the expertise of the user (e.g., clinician, experimenter, bioengineer). Since the parameters of stimulation change over time (due to displacement of electrodes, skin status, etc.), patients undergo recurrent, long calibration sessions, along with visits to the clinics, which are inefficient and expensive. To address this issue, we developed an automatized calibration system based on reinforcement learning (RL) allowing for accurate and efficient identification of the peripheral nerve stimulation parameters for somatosensory neuroprostheses.

METHODS

We developed an RL algorithm to automatically select neurostimulation parameters for restoring sensory feedback with transcutaneous electrical nerve stimulation (TENS). First, the algorithm was trained offline on a dataset comprising 49 subjects. Then, the neurostimulation was then integrated with a graphical user interface (GUI) to create an intuitive AI-based mapping platform enabling the user to autonomously perform the sensation characterization procedure. We assessed the algorithm against the performance of both experienced and naïve and of a brute force algorithm (BFA), on 15 nerves from five subjects. Then, we validated the AI-based platform on six neuropathic nerves affected by distal sensory loss.

RESULTS

Our automatized approach demonstrated the ability to find the optimal values of neurostimulation achieving reliable and comfortable elicited sensations. When compared to alternatives, RL outperformed the naïve and BFA, significantly decreasing the time for mapping and the number of delivered stimulation trains, while improving the overall quality. Furthermore, the RL algorithm showed performance comparable to trained experimenters. Finally, we exploited it successfully for eliciting sensory feedback in neuropathic patients.

CONCLUSIONS

Our findings demonstrated that the AI-based platform based on a RL algorithm can automatically and efficiently calibrate parameters for somatosensory nerve stimulation. This holds promise to avoid experts' employment in similar scenarios, thanks to the merging between AI and neurotech. Our RL algorithm has the potential to be used in other neuromodulation fields requiring a mapping process of the stimulation parameters.

TRIAL REGISTRATION

ClinicalTrial.gov (Identifier: NCT04217005).

Integration of proprioception in upper limb prostheses through non-invasive strategies: a review

Proprioception plays a key role in moving our body dexterously and effortlessly. Nevertheless, the majority of investigations evaluating the benefits of providing supplemental feedback to prosthetics users focus on delivering touch restitution. These studies evaluate the influence of touch sensation in an attempt to improve the controllability of current robotic devices. Contrarily, investigations evaluating the capabilities of proprioceptive supplemental feedback have yet to be comprehensively analyzed to the same extent, marking a major gap in knowledge within the current research climate. The non-invasive strategies employed so far to restitute proprioception are reviewed in this work. In the absence of a clearly superior strategy, approaches employing vibrotactile, electrotactile and skin-stretch stimulation achieved better and more consistent results, considering both kinesthetic and grip force information, compared with other strategies or any incidental feedback. Although emulating the richness of the physiological sensory return through artificial feedback is the primary hurdle, measuring its effects to eventually support the integration of cumbersome and energy intensive hardware into commercial prosthetic devices could represent an even greater challenge. Thus, we analyze the strengths and limitations of previous studies and discuss the possible benefits of coupling objective measures, like neurophysiological parameters, as well as measures of prosthesis embodiment and cognitive load with behavioral measures of performance. Such insights aim to provide additional and collateral outcomes to be considered in the experimental design of future investigations of proprioception restitution that could, in the end, allow researchers to gain a more detailed understanding of possibly similar behavioral results and, thus, support one strategy over another.

Stimulation of peroneal nerves reveals maintained somatosensory representation in transtibial amputees

Introduction

Several studies have found changes in the organization of the primary somatosensory cortex (SI) after amputation. This SI reorganization was mainly investigated by stimulating neighboring areas to amputation. Unexpectedly, the somatosensory representation of the deafferented limb has rarely been directly tested.

Methods

We stimulated the truncated peroneal nerve in 24 unilateral transtibial amputees and 15 healthy controls. The stimulation intensity was adjusted to make the elicited percept comparable between both stimulation sides. Neural sources of the somatosensory-evoked magnetic fields (SEFs) to peroneal stimulation were localized in the contralateral foot/leg areas of SI in 19 patients and 14 healthy controls.

Results

We demonstrated the activation of functionally preserved cortical representations of amputated lower limbs. None of the patients reported evoked phantom limb pain (PLP) during stimulation. Stimulation that evoked perceptions in the foot required stronger intensities on the amputated side than on the intact side. In addition to this, stronger stimulation intensities were required for amputees than for healthy controls. Exploratorily, PLP intensity was neither associated with stimulation intensity nor dipole strength nor with differences in Euclidean distances (between SEF sources of the healthy peroneus and mirrored SEF sources of the truncated peroneus).

Discussion

Our results provide hope that the truncated nerve may be used to establish both motor control and somatosensory feedback via the nerve trunk when a permanently functional connection between the nerve trunk and the prosthesis becomes available.

Modulating individual axons and axonal populations in the peripheral nerve using transverse intrafascicular multichannel electrodes

Objective.A transverse intrafascicular multichannel electrode (TIME) may offer advantages over more conventional cuff electrodes including higher spatial selectivity and reduced stimulation charge requirements. However, the performance of TIME, especially in the context of non-conventional stimulation waveforms, remains relatively unexplored. As part of our overarching goal of investigating stimulation efficacy of TIME, we developed a computational toolkit that automates the creation and usage ofin siliconerve models with TIME setup, which solves nerve responses using cable equations and computes extracellular potentials using finite element method.Approach.We began by implementing a flexible and scalable Python/MATLAB-based toolkit for automatically creating models of nerve stimulation in the hybrid NEURON/COMSOL ecosystems. We then developed a sciatic nerve model containing 14 fascicles with 1,170 myelinated (A-type, 30%) and unmyelinated (C-type, 70%) fibers to study fiber responses over a variety of TIME arrangements (monopolar and hexapolar) and stimulation waveforms (kilohertz stimulation and cathodic ramp modulation).Main results.Our toolkit obviates the conventional need to re-create the same nerve in two disparate modeling environments and automates bi-directional transfer of results. Our population-based simulations suggested that kilohertz stimuli provide selective activation of targeted C fibers near the stimulating electrodes but also tended to activate non-targeted A fibers further away. However, C fiber selectivity can be enhanced by hexapolar TIME arrangements that confined the spatial extent of electrical stimuli. Improved upon prior findings, we devised a high-frequency waveform that incorporates cathodic DC ramp to completely remove undesirable onset responses.Conclusion.Our toolkit allows agile, iterative design cycles involving the nerve and TIME, while minimizing the potential operator errors during complex simulation. The nerve model created by our toolkit allowed us to study and optimize the design of next-generation intrafascicular implants for improved spatial and fiber-type selectivity.

Functional assessment of current upper limb prostheses: An integrated clinical and technological perspective

Although recent technological developments in the field of bionic upper limb prostheses, their rejection rate remains excessively high. The reasons are diverse (e.g. lack of functionality, control complexity, and comfortability) and most of these are reported only through self-rated questionnaires. Indeed, there is no quantitative evaluation of the extent to which a novel prosthetic solution can effectively address users' needs compared to other technologies. This manuscript discusses the challenges and limitations of current upper limb prosthetic devices and evaluates their functionality through a standard functional assessment, the Assessment of Capacity for Myoelectric Control (ACMC). To include a good representation of technologies, the authors collect information from participants in the Cybathlon Powered Arm Prostheses Race 2016 and 2020. The article analyzes 7 hour and 41 min of video footage to evaluate the performance of different prosthetic devices in various tasks inspired by activities of daily living (ADL). The results show that commercially-available rigid hands perform well in dexterous grasping, while body-powered solutions are more reliable and convenient for competitive environments. The article also highlights the importance of wrist design and control modality for successful execution of ADL. Moreover, we discuss the limitations of the evaluation methodology and suggest improvements for future assessments. With regard to future development, this work highlights the need for research in intuitive control of multiple degrees of freedom, adaptive solutions, and the integration of sensory feedback.

EEG-based functional connectivity for tactile roughness discrimination

Tactile sensation and perception involve cooperation between different parts of the brain. Roughness discrimination is an important phase of texture recognition. In this study, we investigated how different roughness levels would influence the brain network characteristics. We recorded EEG signals from nine right-handed healthy subjects who underwent touching three surfaces with different levels of roughness. The experiment was separately repeated in 108 trials for each hand for both static and dynamic touch. For estimation of the functional connectivity between brain regions, the phase lag index method was employed. Frequency-specific connectivity patterns were observed in the ipsilateral and contralateral hemispheres to the hand of interest, for delta, theta, alpha, and beta frequency bands under the study. A number of connections were identified to be in charge of discrimination between surfaces in both alpha and beta frequency bands for the left hand in static touch and for the right hand in dynamic touch. In addition, common connections were determined in both hands for all three roughness in alpha band for static touch and in theta band for dynamic touch. The common connections were identified for the smooth surface in beta band for static touch and in delta and alpha bands for dynamic touch. As observed for static touch in alpha band and for dynamic touch in theta band, the number of common connections between the two hands was decreased by increasing the surface roughness. The results of this research would extend the current knowledge about tactile information processing in the brain.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09876-1.