Optimally-calibrated non-invasive feedback improves amputees' metabolic consumption, balance and walking confidence

Sensory integration for neuroprostheses: from functional benefits to neural correlates

In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation-elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system.

Unconscious multisensory integration: behavioral and neural evidence from subliminal stimuli

Introduction

The prevailing theories of consciousness consider the integration of different sensory stimuli as a key component for this phenomenon to rise on the brain level. Despite many theories and models have been proposed for multisensory integration between supraliminal stimuli (e.g., the optimal integration model), we do not know if multisensory integration occurs also for subliminal stimuli and what psychophysical mechanisms it follows.

Methods

To investigate this, subjects were exposed to visual (Virtual Reality) and/or haptic stimuli (Electro-Cutaneous Stimulation) above or below their perceptual threshold. They had to discriminate, in a two-Alternative Forced Choice Task, the intensity of unimodal and/or bimodal stimuli. They were then asked to discriminate the sensory modality while recording their EEG responses.

Results

We found evidence of multisensory integration for supraliminal condition, following the classical optimal model. Importantly, even for subliminal trials participant's performances in the bimodal condition were significantly more accurate when discriminating the intensity of the stimulation. Moreover, significant differences emerged between unimodal and bimodal activity templates in parieto-temporal areas known for their integrative role.

Discussion

These converging evidences - even if preliminary and needing confirmation from the collection of further data - suggest that subliminal multimodal stimuli can be integrated, thus filling a meaningful gap in the debate about the relationship between consciousness and multisensory integration.

Bionic blink improves real-time eye closure in unilateral facial paralysis

Facial paralysis is the inability to move facial muscles thereby impairing the ability to blink and make facial expressions. Depending on the localization of the nerve malfunction it is subcategorised into central or peripheral and is usually unilateral. This leads to health deficits stemming from corneal dryness and social ostracization.Objective: Electrical stimulation shows promise as a method through which to restore the blink function and as a result improve eye health. However, it is unknown whether a real-time, myoelectrically controlled, neurostimulating device can be used as assistance to this pathological condition.Approach: We developed NEURO-BLINK, a wearable robotic system, that can detect the volitional healthy contralateral blink through electromyography and electrically stimulate the impaired subcutaneous facial nerve and orbicularis oculi muscle to compensate for lost blink function. Alongside the system, we developed a method to evaluate optimal electrode placement through the relationship between blink amplitude and injected charge.Main results: Ten patients with unilateral facial palsy were enrolled in the NEURO-BLINK study, with eight completing testing under two conditions. (1) where the stimulation was cued with an auditory signal (i.e. paced controlled) and (2) synchronized with the natural blink (i.e. myoelectrically controlled). In both scenarios, overall eye closure (distance between eyelids) and cornea coverage measured with high FPS video were found to significantly improve when measured in real-time, while no significant clinical changes were found immediately after use.Significance: This work takes steps towards the development of a portable medical device for blink restoration and facial stimulation which has the potential to improve long-term ocular health.

White noise insole: an artificial evoked sensation device that can be expected to improve plantar sensation of diabetic foot

Diabetic foot is a common severe complication of diabetes, and its main symptom is diabetic foot ulcer. The production of plantar diabetic foot ulcers is usually affected by two factors, namely neuropathy or vascular disease. While previous studies proved that stochastic resonance (SR) could effectively enhance the plantar touch of patients with diabetic feet, the potential impact of SR on neural circuit feedback, especially on the input of the tactile nerves of the lower limbs, is less clear. This study aims to explore the potential impact on the tactile threshold of the human foot when using vibrating insoles. We study a white noise vibration insole based on SR mechanism. We compare and analyze the tactile threshold voltage (TTV) triggered by an electrical stimulation device in three main plantar pressure-bearing areas (the second metatarsal (M2), the fourth metatarsal (M4), and the heel (H) area) of 8 participants using EEG and self-developed vibration insole. Significance found in M2 and M4 areas, white noise signal (WNS) lowered the tactile threshold in these areas, and had a potentially positive impact on patients with diabetic feet, especially in the M4 area. The influence of WNS on the plantar heel area was still controversial. This study showed that WNS applied to the sole could improve the plantar tactile sensing ability of patients with diabetic feet, but it did not cover all areas. The application of WNS showed better benefits for the forefoot area than for the hindfoot area, which was speculated that may be related to the difference in the distribution density of blood vessels in plantar areas. Due to the impaired natural touch in participants with diabetic foot, using artificial evoked sensation WNS intervention, would be a feasible approach to improve plantar sensation.

Sensory-Motor Neurostimulation to Enhance Exosuit Performance

Exosuits typically provide limited mechanical support and rely on a user's residual functional ability. However, people with neurological impairments often suffer from both motor and sensory deficits that limit the assistance an exosuit can provide. To overcome these limitations, we developed the REINFORCE system, that complements the mechanical assistance provided by an exosuit, the Myosuit, with (1) functional electrical stimulation to enhance the activities of leg muscles, and (2) transcutaneous electrical nerve stimulation to restore somatosensory information. It consists of a fully portable and highly modular system that can be easily adapted to the level of impairment and specific need of each participant. Technical verification with three healthy participants showed reliable synchronization between all modules of the systems in all phases of walking. Additionally, we tested the system's effectiveness in one participant with multiple sclerosis who walked overground with and without functional electrical stimulation. Results showed a slight increase in self-selected walking speed (approx. 18%) and in the peak hip flexion at late swing (approx. 12%) as well as reduced step-to-step variability of step length and step time when electrical stimulation was provided. Our findings push towards a clinical trial involving more patients to validate the effectiveness of the REINFORCE system on participants' mobility.

Brain-Computer Interface to Deliver Individualized Multisensory Intervention for Neuropathic Pain

To unravel the complexity of the neuropathic pain experience, researchers have tried to identify reliable pain signatures (biomarkers) using electroencephalography (EEG) and skin conductance (SC). Nevertheless, their use as a clinical aid to design personalized therapies remains scarce and patients are prescribed with common and inefficient painkillers. To address this need, novel non-pharmacological interventions, such as transcutaneous electrical nerve stimulation (TENS) to activate peripheral pain relief via neuromodulation and virtual reality (VR) to modulate patients' attention, have emerged. However, all present treatments suffer from the inherent bias of the patient's self-reported pain intensity, depending on their predisposition and tolerance, together with unspecific, pre-defined scheduling of sessions which does not consider the timing of pain episodes onset. Here, we show a Brain-Computer Interface (BCI) detecting in real-time neurophysiological signatures of neuropathic pain from EEG combined with SC and accordingly triggering a multisensory intervention combining TENS and VR. After validating that the multisensory intervention effectively decreased experimentally induced pain, the BCI was tested with thirteen healthy subjects by electrically inducing pain and showed 82% recall in decoding pain in real time. Such constructed BCI was then validated with eight neuropathic patients reaching 75% online pain precision, and consequently releasing the intervention inducing a significant decrease (50% NPSI score) in neuropathic patients' pain perception. Our results demonstrate the feasibility of real-time pain detection from objective neurophysiological signals, and the effectiveness of a triggered combination of VR and TENS to decrease neuropathic pain. This paves the way towards personalized, data-driven pain therapies using fully portable technologies.

Investigation with able-bodied subjects suggests Myosuit may potentially serve as a stair ascent training robot

Real world settings are seldomly just composed of level surfaces and stairs are frequently encountered in daily life. Unfortunately, ~ 90% of the elderly population use some sort of compensation pattern in order to negotiate stairs. Because the biomechanics required to successfully ascend stairs is significantly different from level walking, an independent training protocol is warranted. Here, we present as a preliminary investigation with 11 able-bodied subjects, prior to clinical trials, whether Myosuit could potentially serve as a stair ascent training robot. Myosuit is a soft wearable exosuit that was designed to assist the user via hip and knee extension during the early stance phase. We hypothesized that clinical studies could be carried out if the lower limb kinematics, sensory feedback via plantar force, and electromyography (EMG) patterns do not deviate from the user's physiological stair ascent patterns while reducing hip and knee extensor demand. Our results suggest that Myosuit conserves the user's physiological kinematic and plantar force patterns. Moreover, we observe approximately 20% and 30% decrease in gluteus maximus and vastus medialis EMG levels in the pull up phase, respectively. Collectively, Myosuit reduces the hip and knee extensor demand during stair ascent without any introduction of significant compensation patterns.

The impact of walking on the perception of multichannel electrotactile stimulation in individuals with lower-limb amputation and able-bodied participants

BACKGROUND

One of the drawbacks of lower-limb prostheses is that they do not provide explicit somatosensory feedback to their users. Electrotactile stimulation is an attractive technology to restore such feedback because it enables compact solutions with multiple stimulation points. This allows stimulating a larger skin area to provide more information concurrently and modulate parameters spatially as well as in amplitude. However, for effective use, electrotactile stimulation needs to be calibrated and it would be convenient to perform this procedure while the subject is seated. However, amplitude and spatial perception can be affected by motion and/or physical coupling between the residual limb and the socket. In the present study, we therefore evaluated and compared the psychometric properties of multichannel electrotactile stimulation applied to the thigh/residual limb during sitting versus walking.

METHODS

The comprehensive assessment included the measurement of the sensation and discomfort thresholds (ST & DT), just noticeable difference (JND), number of distinct intervals (NDI), two-point discrimination threshold (2PD), and spatial discrimination performance (SD). The experiment involved 11 able-bodied participants (4 females and 7 males; 29.2 ± 3.8 years), 3 participants with transtibial amputation, and 3 participants with transfemoral amputation.

RESULTS

In able-bodied participants, the results were consistent for all the measured parameters, and they indicated that both amplitude and spatial perception became worse during walking. More specifically, ST and DT increased significantly during walking vs. sitting (2.90 ± 0.82 mA vs. 2.00 ± 0.52 mA; p < 0.001 for ST and 7.74 ± 0.84 mA vs. 7.21 ± 1.30 mA; p < 0.05 for DT) and likewise for the JND (22.47 ± 12.21% vs. 11.82 ± 5.07%; p < 0.01), while the NDI became lower (6.46 ± 3.47 vs. 11.27 ± 5.18 intervals; p < 0.01). Regarding spatial perception, 2PD was higher during walking (69.78 ± 17.66 mm vs. 57.85 ± 14.87 mm; p < 0.001), while the performance of SD was significantly lower (56.70 ± 10.02% vs. 64.55 ± 9.44%; p < 0.01). For participants with lower-limb amputation, the ST, DT, and performance in the SD assessment followed the trends observed in the able-bodied population. The results for 2PD and JND were however different and subject-specific.

CONCLUSION

The conducted evaluation demonstrates that electrotactile feedback should be calibrated in the conditions in which it will be used (e.g., during walking). The calibration during sitting, while more convenient, might lead to an overly optimistic (or in some cases pessimistic) estimate of sensitivity. In addition, the results underline that calibration is particularly important in people affected by lower-limb loss to capture the substantial variability in the conditions of the residual limb and prosthesis setup. These insights are important for the implementation of artificial sensory feedback in lower-limb prosthetics applications.

Cognitive benefits of using non-invasive compared to implantable neural feedback

A non-optimal prosthesis integration into an amputee’s body schema suggests some important functional and health consequences after lower limb amputation. These include low perception of a prosthesis as a part of the body, experiencing it as heavier than the natural limb, and cognitively exhausting use for users. Invasive approaches, exploiting the surgical implantation of electrodes in residual nerves, improved prosthesis integration by restoring natural and somatotopic sensory feedback in transfemoral amputees. A non-invasive alternative that avoids surgery would reduce costs and shorten certification time, significantly increasing the adoption of such systems. To explore this possibility, we compared results from a non-invasive, electro-cutaneous stimulation system to outcomes observed with the use of implants in above the knee amputees. This non-invasive solution was tested in transfemoral amputees through evaluation of their ability to perceive and recognize touch intensity and locations, or movements of a prosthesis, and its cognitive integration (through dual task performance and perceived prosthesis weight). While this managed to evoke the perception of different locations on the artificial foot, and closures of the leg, it was less performant than invasive solutions. Non-invasive stimulation induced similar improvements in dual motor and cognitive tasks compared to neural feedback. On the other hand, results demonstrate that remapped, evoked sensations are less informative and intuitive than the neural evoked somatotopic sensations. The device therefore fails to improve prosthesis embodiment together with its associated weight perception. This preliminary evaluation meaningfully highlights the drawbacks of non-invasive systems, but also demonstrates benefits when performing multiple tasks at once. Importantly, the improved dual task performance is consistent with invasive devices, taking steps towards the expedited development of a certified device for widespread use.