Restoration of grasp following paralysis through brain-controlled stimulation of muscles

Few-shot Algorithms for Consistent Neural Decoding (FALCON) Benchmark

Intracortical brain-computer interfaces (iBCIs) can restore movement and communication abilities to individuals with paralysis by decoding their intended behavior from neural activity recorded with an implanted device. While this activity yields high-performance decoding over short timescales, neural data are often nonstationary, which can lead to decoder failure if not accounted for. To maintain performance, users must frequently recalibrate decoders, which requires the arduous collection of new neural and behavioral data. Aiming to reduce this burden, several approaches have been developed that either limit recalibration data requirements (few-shot approaches) or eliminate explicit recalibration entirely (zero-shot approaches). However, progress is limited by a lack of standardized datasets and comparison metrics, causing methods to be compared in an ad hoc manner. Here we introduce the FALCON benchmark suite (Few-shot Algorithms for COnsistent Neural decoding) to standardize evaluation of iBCI robustness. FALCON curates five datasets of neural and behavioral data that span movement and communication tasks to focus on behaviors of interest to modern-day iBCIs. Each dataset includes calibration data, optional few-shot recalibration data, and private evaluation data. We implement a flexible evaluation platform which only requires user-submitted code to return behavioral predictions on unseen data. We also seed the benchmark by applying baseline methods spanning several classes of possible approaches. FALCON aims to provide rigorous selection criteria for robust iBCI decoders, easing their translation to real-world devices.

Neural decoding and feature selection methods for closed-loop control of avoidance behavior

Objective.Many psychiatric disorders involve excessive avoidant or defensive behavior, such as avoidance in anxiety and trauma disorders or defensive rituals in obsessive-compulsive disorders. Developing algorithms to predict these behaviors from local field potentials (LFPs) could serve as the foundational technology for closed-loop control of such disorders. A significant challenge is identifying the LFP features that encode these defensive behaviors.Approach.We analyzed LFP signals from the infralimbic cortex and basolateral amygdala of rats undergoing tone-shock conditioning and extinction, standard for investigating defensive behaviors. We utilized a comprehensive set of neuro-markers across spectral, temporal, and connectivity domains, employing SHapley Additive exPlanations for feature importance evaluation within Light Gradient-Boosting Machine models. Our goal was to decode three commonly studied avoidance/defensive behaviors: freezing, bar-press suppression, and motion (accelerometry), examining the impact of different features on decoding performance.Main results.Band power and band power ratio between channels emerged as optimal features across sessions. High-gamma (80-150 Hz) power, power ratios, and inter-regional correlations were more informative than other bands that are more classically linked to defensive behaviors. Focusing on highly informative features enhanced performance. Across 4 recording sessions with 16 subjects, we achieved an average coefficient of determination of 0.5357 and 0.3476, and Pearson correlation coefficients of 0.7579 and 0.6092 for accelerometry jerk and bar press rate, respectively. Utilizing only the most informative features revealed differential encoding between accelerometry and bar press rate, with the former primarily through local spectral power and the latter via inter-regional connectivity. Our methodology demonstrated remarkably low training/inference time and memory usage, requiring<310 ms for training,<0.051 ms for inference, and 16.6 kB of memory, using a single core of AMD Ryzen Threadripper PRO 5995WX CPU.Significance.Our results demonstrate the feasibility of accurately decoding defensive behaviors with minimal latency, using LFP features from neural circuits strongly linked to these behaviors. This methodology holds promise for real-time decoding to identify physiological targets in closed-loop psychiatric neuromodulation.

Thin-film implants for bioelectronic medicine

This article is based on the MRS Mid-Career Researcher Award "for outstanding contributions to the fundamentals and development of organic electronic materials and their application in biology and medicine" presentation given by George G. Malliaras, University of Cambridge, at the 2023 MRS Spring Meeting in San Francisco, Calif.Bioelectronic medicine offers a revolutionary approach to treating disease by stimulating the body with electricity. While current devices show safety and efficacy, limitations, including bulkiness, invasiveness, and scalability, hinder their wider application. Thin-film implants promise to overcome these limitations. Made using microfabrication technologies, these implants conform better to neural tissues, reduce tissue damage and foreign body response, and provide high-density, multimodal interfaces with the body. This article explores how thin-film implants using organic materials and novel designs may contribute to disease management, intraoperative monitoring, and brain mapping applications. Additionally, the technical challenges to be addressed for this technology to succeed are discussed.

Graphical abstract

Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface

Objective

Creating an intracortical brain-computer interface (iBCI) capable of seamless transitions between tasks and contexts would greatly enhance user experience. However, the nonlinearity in neural activity presents challenges to computing a global iBCI decoder. We aimed to develop a method that differs from a globally optimized decoder to address this issue.

Approach

We devised an unsupervised approach that relies on the structure of a low-dimensional neural manifold to implement a piecewise linear decoder. We created a distinctive dataset in which monkeys performed a diverse set of tasks, some trained, others innate, while we recorded neural signals from the motor cortex (M1) and electromyographs (EMGs) from upper limb muscles. We used both linear and nonlinear dimensionality reduction techniques to discover neural manifolds and applied unsupervised algorithms to identify clusters within those spaces. Finally, we fit a linear decoder of EMG for each cluster. A specific decoder was activated corresponding to the cluster each new neural data point belonged to.

Main results

We found clusters in the neural manifolds corresponding with the different tasks or task sub-phases. The performance of piecewise decoding improved as the number of clusters increased and plateaued gradually. With only two clusters it already outperformed a global linear decoder, and unexpectedly, it outperformed even a global recurrent neural network (RNN) decoder with 10-12 clusters.

Significance

This study introduced a computationally lightweight solution for creating iBCI decoders that can function effectively across a broad range of tasks. EMG decoding is particularly challenging, as muscle activity is used, under varying contexts, to control interaction forces and limb stiffness, as well as motion. The results suggest that a piecewise linear decoder can provide a good approximation to the nonlinearity between neural activity and motor outputs, a result of our increased understanding of the structure of neural manifolds in motor cortex.

Brain-Computer Interface for Patients with Spinal Cord Injury: A Bibliometric Study

BACKGROUND

Spinal cord injury (SCI) is a debilitating condition with profound implications on patients' quality of life. Recent advancements in brain-computer interface (BCI) technology have provided novel opportunities for individuals with paralysis due to SCI. Consequently, research on the application of BCI for treating SCI has received increasing attention from scholars worldwide. However, there is a lack of rigorous bibliometric studies on the evolution and trends in this field. Hence, the present study aimed to use bibliometric methods to investigate the current status and emerging trends in the field of applying BCI for treating SCI and thus identify novel therapeutic options for SCI.

METHODS

We conducted a comprehensive review of the relevant literature on BCI applications for treating SCI published between 2005 and 2024 by using the Web of Science Core Collection database. To facilitate visualization and quantitative analysis of the published literature, we used VOSviewer and CiteSpace software tools. These tools enabled the assessment of co-authorships, co-occurrences, citations, and co-citations in the selected literature, thereby providing an overview of the current trends and predictive insights into the field.

RESULTS

The literature search yielded 714 publications from the Web of Science Core Collection database. The findings indicated a significant upward trend in the number of publications, yielding a total of 24,804 citations, with an average citation rate of 34.74 per publication and an H-index of 75. Research contributions were identified from 54 countries/regions, and the United States, China, and Germany emerged as the predominant contributors. A total of 1114 research institutions contributed to the retrieved literature, with Harvard Medical School, Brown University, and Northwestern University producing the highest number of publications. The published literature was predominantly distributed across 258 academic journals, and the Journal of Neural Engineering was the most frequently utilized publication source. Hochberg, Leigh, Henderson, Jaimie, and Collinger were the prominent authors in this field.

CONCLUSIONS

In recent years, there has been a steep increase in research on the use of BCI for treating SCI. Existing research focuses on the application of BCI for improving rehabilitation and quality of life of patients with SCI. Interdisciplinary collaboration is the current trend in this field.

Bioelectronics for electrical stimulation: materials, devices and biomedical applications

Bioelectronics is a hot research topic, yet an important tool, as it facilitates the creation of advanced medical devices that interact with biological systems to effectively diagnose, monitor and treat a broad spectrum of health conditions. Electrical stimulation (ES) is a pivotal technique in bioelectronics, offering a precise, non-pharmacological means to modulate and control biological processes across molecular, cellular, tissue, and organ levels. This method holds the potential to restore or enhance physiological functions compromised by diseases or injuries by integrating sophisticated electrical signals, device interfaces, and designs tailored to specific biological mechanisms. This review explains the mechanisms by which ES influences cellular behaviors, introduces the essential stimulation principles, discusses the performance requirements for optimal ES systems, and highlights the representative applications. From this review, we can realize the potential of ES based bioelectronics in therapy, regenerative medicine and rehabilitation engineering technologies, ranging from tissue engineering to neurological technologies, and the modulation of cardiovascular and cognitive functions. This review underscores the versatility of ES in various biomedical contexts and emphasizes the need to adapt to complex biological and clinical landscapes it addresses.

Neural population dynamics in songbird RA and HVC during learned motor-vocal behavior

Complex, learned motor behaviors involve the coordination of large-scale neural activity across multiple brain regions, but our understanding of the population-level dynamics within different regions tied to the same behavior remains limited. Here, we investigate the neural population dynamics underlying learned vocal production in awake-singing songbirds. We use Neuropixels probes to record the simultaneous extracellular activity of populations of neurons in two regions of the vocal motor pathway. In line with observations made in non-human primates during limb-based motor tasks, we show that the population-level activity in both the premotor nucleus HVC and the motor nucleus RA is organized on low-dimensional neural manifolds upon which coordinated neural activity is well described by temporally structured trajectories during singing behavior. Both the HVC and RA latent trajectories provide relevant information to predict vocal sequence transitions between song syllables. However, the dynamics of these latent trajectories differ between regions. Our state-space models suggest a unique and continuous-over-time correspondence between the latent space of RA and vocal output, whereas the corresponding relationship for HVC exhibits a higher degree of neural variability. We then demonstrate that comparable high-fidelity reconstruction of continuous vocal outputs can be achieved from HVC and RA neural latents and spiking activity. Unlike those that use spiking activity, however, decoding models using neural latents generalize to novel sub-populations in each region, consistent with the existence of preserved manifolds that confine vocal-motor activity in HVC and RA.

Evolution, biomechanics, and neurobiology converge to explain selective finger motor control

Humans use their fingers to perform a variety of tasks, from simple grasping to manipulating objects, to typing and playing musical instruments, a variety wider than any other species. The more sophisticated the task, the more it involves individuated finger movements, those in which one or more selected fingers perform an intended action while the motion of other digits is constrained. Here we review the neurobiology of such individuated finger movements. We consider their evolutionary origins, the extent to which finger movements are in fact individuated, and the evolved features of neuromuscular control that both enable and limit individuation. We go on to discuss other features of motor control that combine with individuation to create dexterity, the impairment of individuation by disease, and the broad extent of capabilities that individuation confers on humans. We comment on the challenges facing the development of a truly dexterous bionic hand. We conclude by identifying topics for future investigation that will advance our understanding of how neural networks interact across multiple regions of the central nervous system to create individuated movements for the skills humans use to express their cognitive activity.

Neural Decoding and Feature Selection Techniques for Closed-Loop Control of Defensive Behavior

Objective

Many psychiatric disorders involve excessive avoidant or defensive behavior, such as avoidance in anxiety and trauma disorders or defensive rituals in obsessive-compulsive disorders. Developing algorithms to predict these behaviors from local field potentials (LFPs) could serve as foundational technology for closed-loop control of such disorders. A significant challenge is identifying the LFP features that encode these defensive behaviors.

Approach

We analyzed LFP signals from the infralimbic cortex and basolateral amygdala of rats undergoing tone-shock conditioning and extinction, standard for investigating defensive behaviors. We utilized a comprehensive set of neuro-markers across spectral, temporal, and connectivity domains, employing SHapley Additive exPlanations for feature importance evaluation within Light Gradient-Boosting Machine models. Our goal was to decode three commonly studied avoidance/defensive behaviors: freezing, bar-press suppression, and motion (accelerometry), examining the impact of different features on decoding performance.

Main results

Band power and band power ratio between channels emerged as optimal features across sessions. High-gamma (80-150 Hz) power, power ratios, and inter-regional correlations were more informative than other bands that are more classically linked to defensive behaviors. Focusing on highly informative features enhanced performance. Across 4 recording sessions with 16 subjects, we achieved an average coefficient of determination of 0.5357 and 0.3476, and Pearson correlation coefficients of 0.7579 and 0.6092 for accelerometry jerk and bar press rate, respectively. Utilizing only the most informative features revealed differential encoding between accelerometry and bar press rate, with the former primarily through local spectral power and the latter via inter-regional connectivity. Our methodology demonstrated remarkably low time complexity, requiring <110 ms for training and <1 ms for inference.

Significance

Our results demonstrate the feasibility of accurately decoding defensive behaviors with minimal latency, using LFP features from neural circuits strongly linked to these behaviors. This methodology holds promise for real-time decoding to identify physiological targets in closed-loop psychiatric neuromodulation.

A prefrontal motor circuit initiates persistent movement

Persistence reinforces continuous action, which benefits animals in many aspects. Diverse external or internal signals may trigger animals to start a persistent movement. However, it is unclear how the brain decides to persist with current actions by selecting specific information. Using single-unit extracellular recordings and opto-tagging in awake mice, we demonstrated that a group of dorsal mPFC (dmPFC) motor cortex projecting (MP) neurons initiate a persistent movement by selectively encoding contextual information rather than natural valence. Inactivation of dmPFC MP neurons impairs the initiation and reduces neuronal activity in the insular and motor cortex. After the persistent movement is initiated, the dmPFC MP neurons are not required to maintain it. Finally, a computational model suggests that a successive sensory stimulus acts as an input signal for the dmPFC MP neurons to initiate a persistent movement. These results reveal a neural initiation mechanism on the persistent movement.

Closed-loop optogenetic neuromodulation enables high-fidelity fatigue-resistant muscle control

Closed-loop neuroprostheses show promise in restoring motion in individuals with neurological conditions. However, conventional activation strategies based on functional electrical stimulation (FES) fail to accurately modulate muscle force and exhibit rapid fatigue because of their unphysiological recruitment mechanism. Here, we present a closed-loop control framework that leverages physiological force modulation under functional optogenetic stimulation (FOS) to enable high-fidelity muscle control for extended periods of time (>60 minutes) in vivo. We first uncovered the force modulation characteristic of FOS, showing more physiological recruitment and significantly higher modulation ranges (>320%) compared with FES. Second, we developed a neuromuscular model that accurately describes the highly nonlinear dynamics of optogenetically stimulated muscle. Third, on the basis of the optogenetic model, we demonstrated real-time control of muscle force with improved performance and fatigue resistance compared with FES. This work lays the foundation for fatigue-resistant neuroprostheses and optogenetically controlled biohybrid robots with high-fidelity force modulation.

Closed-Loop Wearable Device Network of Intrinsically-Controlled, Bilateral Coordinated Functional Electrical Stimulation for Stroke

Innovative functional electrical stimulation has demonstrated effectiveness in enhancing daily walking and rehabilitating stroke patients with foot drop. However, its lack of precision in stimulating timing, individual adaptivity, and bilateral symmetry, resulted in diminished clinical efficacy. Therefore, a closed-loop wearable device network of intrinsically controlled functional electrical stimulation (CI-FES) system is proposed, which utilizes the personal surface myoelectricity, derived from the intrinsic neuro signal, as the switch to activate/deactivate the stimulation on the affected side. Simultaneously, it decodes the myoelectricity signal of the patient's healthy side to adjust the stimulation intensity, forming an intrinsically controlled loop with the inertial measurement units. With CI-FES assistance, patients' walking ability significantly improved, evidenced by the shift in ankle joint angle mean and variance from 105.53° and 28.84 to 102.81° and 17.71, and the oxyhemoglobin concentration tested by the functional near-infrared spectroscopy. In long-term CI-FES-assisted clinical testing, the discriminability in machine learning classification between patients and healthy individuals gradually decreased from 100% to 92.5%, suggesting a remarkable recovery tendency, further substantiated by performance on the functional movement scales. The developed CI-FES system is crucial for contralateral-hemiplegic stroke recovery, paving the way for future closed-loop stimulation systems in stroke rehabilitation is anticipated.

Preparatory activity and the expansive null-space

The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.

A prefrontal motor circuit initiates persistent movement

Persistence reinforces continuous action, which benefits animals in many aspects. Diverse information may trigger animals to start a persistent movement. However, it is unclear how the brain decides to persist with current actions by selecting specific information. Using single-unit extracellular recordings and opto-tagging in awake mice, we demonstrated that a group of dorsal mPFC (dmPFC) motor cortex projecting (MP) neurons initiate a persistent movement selectively encoding contextual information rather than natural valence. Inactivation of dmPFC MP neurons impairs the initiation and reduces neuronal activity in the insular and motor cortex. Finally, a computational model suggests that a successive sensory stimulus acts as an input signal for the dmPFC MP neurons to initiate a persistent movement. These results reveal a neural initiation mechanism on the persistent movement.

An Investigation of Manifold-Based Direct Control for a Brain-to-Body Neural Bypass

Objective: Brain-body interfaces (BBIs) have emerged as a very promising solution for restoring voluntary hand control in people with upper-limb paralysis. The BBI module decoding motor commands from brain signals should provide the user with intuitive, accurate, and stable control. Here, we present a preliminary investigation in a monkey of a brain decoding strategy based on the direct coupling between the activity of intrinsic neural ensembles and output variables, aiming at achieving ease of learning and long-term robustness. Results: We identified an intrinsic low-dimensional space (called manifold) capturing the co-variation patterns of the monkey's neural activity associated to reach-to-grasp movements. We then tested the animal's ability to directly control a computer cursor using cortical activation along the manifold axes. By daily recalibrating only scaling factors, we achieved rapid learning and stable high performance in simple, incremental 2D tasks over more than 12 weeks of experiments. Finally, we showed that this brain decoding strategy can be effectively coupled to peripheral nerve stimulation to trigger voluntary hand movements. Conclusions: These results represent a proof of concept of manifold-based direct control for BBI applications.

Personalized strategies of neurostimulation: from static biomarkers to dynamic closed-loop assessment of neural function

Despite considerable advancement of first choice treatment (pharmacological, physical therapy, etc.) over many decades, neurological disorders still represent a major portion of the worldwide disease burden. Particularly concerning, the trend is that this scenario will worsen given an ever expanding and aging population. The many different methods of brain stimulation (electrical, magnetic, etc.) are, on the other hand, one of the most promising alternatives to mitigate the suffering of patients and families when conventional treatment fall short of delivering efficacious treatment. With applications in virtually all neurological conditions, neurostimulation has seen considerable success in providing relief of symptoms. On the other hand, a large variability of therapeutic outcomes has also been observed, particularly in the usage of non-invasive brain stimulation (NIBS) modalities. Borrowing inspiration and concepts from its pharmacological counterpart and empowered by unprecedented neurotechnological advancement, the neurostimulation field has seen in recent years a widespread of methods aimed at the personalization of its parameters, based on biomarkers of the individuals being treated. The rationale is that, by taking into account important factors influencing the outcome, personalized stimulation can yield a much-improved therapy. Here, we review the literature to delineate the state-of-the-art of personalized stimulation, while also considering the important aspects of the type of informing parameter (anatomy, function, hybrid), invasiveness, and level of development (pre-clinical experimentation versus clinical trials). Moreover, by reviewing relevant literature on closed loop neuroengineering solutions in general and on activity dependent stimulation method in particular, we put forward the idea that improved personalization may be achieved when the method is able to track in real time brain dynamics and adjust its stimulation parameters accordingly. We conclude that such approaches have great potential of promoting the recovery of lost functions and enhance the quality of life for patients.

High-frequency amplitude-modulated sinusoidal stimulation induces desynchronized yet controllable neural firing

Regaining sensory feedback is pivotal for people living with limb amputation. Electrical stimulation of sensory fibers in peripheral nerves has been shown to restore focal percepts in the missing limb. However, conventional rectangular current pulses induce sensations often described as unnatural. This is likely due to the synchronous and periodic nature of activity evoked by these pulses. Here we introduce a fast-oscillating amplitude-modulated sinusoidal (FAMS) stimulation waveform that desynchronizes evoked neural activity. We used a computational model to show that sinusoidal waveforms evoke asynchronous and irregular firing and that firing patterns are frequency dependent. We designed the FAMS waveform to leverage both low- and high-frequency effects and found that membrane non-linearities enhance neuron-specific differences when exposed to FAMS. We implemented this waveform in a feline model of peripheral nerve stimulation and demonstrated that FAMS-evoked activity is more asynchronous than activity evoked by rectangular pulses, while being easily controllable with simple stimulation parameters. These results represent an important step towards biomimetic stimulation strategies useful for clinical applications to restore sensory feedback.

Surgical Implantation of Brain Computer Interfaces

This article discusses the function and capabilities of brain computer interfaces as a novel approach to rehabilitation for a variety of neurological disorders.

Brain control of bimanual movement enabled by recurrent neural networks

Brain-computer interfaces have so far focused largely on enabling the control of a single effector, for example a single computer cursor or robotic arm. Restoring multi-effector motion could unlock greater functionality for people with paralysis (e.g., bimanual movement). However, it may prove challenging to decode the simultaneous motion of multiple effectors, as we recently found that a compositional neural code links movements across all limbs and that neural tuning changes nonlinearly during dual-effector motion. Here, we demonstrate the feasibility of high-quality bimanual control of two cursors via neural network (NN) decoders. Through simulations, we show that NNs leverage a neural 'laterality' dimension to distinguish between left and right-hand movements as neural tuning to both hands become increasingly correlated. In training recurrent neural networks (RNNs) for two-cursor control, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously. Our results suggest that neural network decoders may be advantageous for multi-effector decoding, provided they are designed to transfer to the online setting.

From monkeys to humans: observation-basedEMGbrain-computer interface decoders for humans with paralysis

Objective. Intracortical brain-computer interfaces (iBCIs) aim to enable individuals with paralysis to control the movement of virtual limbs and robotic arms. Because patients' paralysis prevents training a direct neural activity to limb movement decoder, most iBCIs rely on 'observation-based' decoding in which the patient watches a moving cursor while mentally envisioning making the movement. However, this reliance on observed target motion for decoder development precludes its application to the prediction of unobservable motor output like muscle activity. Here, we ask whether recordings of muscle activity from a surrogate individual performing the same movement as the iBCI patient can be used as target for an iBCI decoder.Approach. We test two possible approaches, each using data from a human iBCI user and a monkey, both performing similar motor actions. In one approach, we trained a decoder to predict the electromyographic (EMG) activity of a monkey from neural signals recorded from a human. We then contrast this to a second approach, based on the hypothesis that the low-dimensional 'latent' neural representations of motor behavior, known to be preserved across time for a given behavior, might also be preserved across individuals. We 'transferred' an EMG decoder trained solely on monkey data to the human iBCI user after using Canonical Correlation Analysis to align the human latent signals to those of the monkey.Main results. We found that both direct and transfer decoding approaches allowed accurate EMG predictions between two monkeys and from a monkey to a human.Significance. Our findings suggest that these latent representations of behavior are consistent across animals and even primate species. These methods are an important initial step in the development of iBCI decoders that generate EMG predictions that could serve as signals for a biomimetic decoder controlling motion and impedance of a prosthetic arm, or even muscle force directly through functional electrical stimulation.

Implanted Electrodes for Functional Electrical Stimulation to Restore Upper and Lower Extremity Function: History and Future Directions

Functional electrical stimulation (FES) to activate nerves and muscles in paralyzed extremities has considerable promise to improve outcome after neurological disease or injury, especially in individuals who have upper motor nerve dysfunction due to central nervous system pathology. Because technology has improved, a wide variety of methods for providing electrical stimulation to create functional movements have been developed, including muscle stimulating electrodes, nerve stimulating electrodes, and hybrid constructs. However, in spite of decades of success in experimental settings with clear functional improvements for individuals with paralysis, the technology has not yet reached widespread clinical translation. In this review, we outline the history of FES techniques and approaches and describe future directions in evolution of the technology.

An implantable, wireless, battery-free system for tactile pressure sensing

The sense of touch is critical to dexterous use of the hands and thus an essential component of efforts to restore hand function after amputation or paralysis. Prosthetic systems have addressed this goal with wearable tactile sensors. However, such wearable sensors are suboptimal for neuroprosthetic systems designed to reanimate a patient's own paralyzed hand. Here, we developed an implantable tactile sensing system intended for subdermal placement. The system is composed of a microfabricated capacitive pressure sensor, a custom integrated circuit supporting wireless powering and data transmission, and a laser-fused hermetic silica package. The miniature device was validated through simulations, benchtop assessment, and testing in a primate hand. The sensor implanted in the fingertip accurately measured applied skin forces with a resolution of 4.3 mN. The output from this novel sensor could be encoded in the brain with microstimulation to provide tactile feedback. More broadly, the materials, system design, and fabrication approach establish new foundational capabilities for various applications of implantable sensing systems.

Intracortical brain-computer interfaces in primates: a review and outlook

Brain-computer interfaces (BCI) translate brain signals into artificial output to restore or replace natural central nervous system (CNS) functions. Multiple processes, including sensorimotor integration, decision-making, motor planning, execution, and updating, are involved in any movement. For example, a BCI may be better able to restore naturalistic motor behaviors if it uses signals from multiple brain areas and decodes natural behaviors' cognitive and motor aspects. This review provides an overview of the preliminary information necessary to plan a BCI project focusing on intracortical implants in primates. Since the brain structure and areas of non-human primates (NHP) are similar to humans, exploring the result of NHP studies will eventually benefit human BCI studies. The different types of BCI systems based on the target cortical area, types of signals, and decoding methods will be discussed. In addition, various successful state-of-the-art cases will be reviewed in more detail, focusing on the general algorithm followed in the real-time system. Finally, an outlook for improving the current BCI research studies will be debated.

Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex

Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.

Translating deep learning to neuroprosthetic control

Advances in deep learning have given rise to neural network models of the relationship between movement and brain activity that appear to far outperform prior approaches. Brain-computer interfaces (BCIs) that enable people with paralysis to control external devices, such as robotic arms or computer cursors, might stand to benefit greatly from these advances. We tested recurrent neural networks (RNNs) on a challenging nonlinear BCI problem: decoding continuous bimanual movement of two computer cursors. Surprisingly, we found that although RNNs appeared to perform well in offline settings, they did so by overfitting to the temporal structure of the training data and failed to generalize to real-time neuroprosthetic control. In response, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously, far outperforming standard linear methods. Our results provide evidence that preventing models from overfitting to temporal structure in training data may, in principle, aid in translating deep learning advances to the BCI setting, unlocking improved performance for challenging applications.

Persistence is driven by a prefrontal motor circuit

Persistence provides a long-lasting effect on actions, including avoiding predators and storing energy, and hence is crucial for the survival (Adolphs and Anderson, 2018). However, how the brain loads persistence on movements is unknown. Here, we demonstrate that being persistent is determined at the initial phase of movement, and this persistency will be sustained until the terminal signaling. The neural coding of persistent movement phases (initial or terminal) is independent from the judgement (i.e. valence) (Li et al., 2022; Wang et al., 2018) upon the external stimuli. Next, we identify a group of dorsal medial prefrontal cortex (dmPFC) motor cortex projecting (MP) neurons (Wang and Sun, 2021), which encodes the initial phase of a persistent movement rather than the valence. Inactivation of dmPFC MP neurons impairs the initiation of persistency and reduce the neural activity in the insular and motor cortex. Finally, a MP network-based computational model suggests that an intact, successive sensory stimulus acts as a triggering signal to direct the initiation of persistent movements. These findings reveal a neural mechanism that transforms the brain state from neutral to persistent during a movement.

Neural Bypasses: Literature Review and Future Directions in Developing Artificial Neural Connections

Reported neuro-modulation schemes in the literature are typically classified as closed-loop or open-loop. A novel group of recently developed neuro-modulation devices may be better described as a neural bypass, which attempts to transmit neural data from one location of the nervous system to another. The most common form of neural bypasses in the literature utilize EEG recordings of cortical information paired with functional electrical stimulation for effector muscle output, most commonly for assistive applications and rehabilitation in spinal cord injury or stroke. Other neural bypass locations that have also been described, or may soon be in development, include cortical-spinal bypasses, cortical-cortical bypasses, autonomic bypasses, peripheral-central bypasses, and inter-subject bypasses. The most common recording devices include EEG, ECoG, and microelectrode arrays, while stimulation devices include both invasive and noninvasive electrodes. Several devices are in development to improve the temporal and spatial resolution and biocompatibility for neuronal recording and stimulation. A major barrier to entry includes neuroplasticity and current decoding mechanisms that regularly require retraining. Neural bypasses are a unique class of neuro-modulation. Continued advancement of neural recording and stimulating devices with high spatial and temporal resolution, combined with decoding mechanisms uninhibited by neuroplasticity, can expand the therapeutic capability of neural bypassing. Overall, neural bypasses are a promising modality to improve the treatment of common neurologic disorders, including stroke, spinal cord injury, peripheral nerve injury, brain injury and more.

An implantable wireless tactile sensing system

The sense of touch is critical to dexterous use of the hands and thus an essential component to efforts to restore hand function after amputation or paralysis. Prosthetic systems have focused on wearable tactile sensors. But wearable sensors are suboptimal for neuroprosthetic systems designed to reanimate a patient's own paralyzed hand. Here, we developed an implantable tactile sensing system intended for subdermal placement. The system is composed of a microfabricated capacitive force sensor, a custom integrated circuit supporting wireless powering and data transmission, and a laser-fused hermetic silica package. The miniature device was validated through simulations, benchtop testing, and ex vivo testing in a primate hand. The sensor implanted in the fingertip accurately measured skin forces with a resolution of 4.3 mN. The output from this novel sensor could be encoded in the brain with microstimulation to provide tactile feedback. More broadly, the materials, system design, and fabrication approach establish new foundational capabilities for various applications of implantable sensing systems.

Implantable intracortical microelectrodes: reviewing the present with a focus on the future

Implantable intracortical microelectrodes can record a neuron's rapidly changing action potentials (spikes). In vivo neural activity recording methods often have either high temporal or spatial resolution, but not both. There is an increasing need to record more neurons over a longer duration in vivo. However, there remain many challenges to overcome before achieving long-term, stable, high-quality recordings and realizing comprehensive, accurate brain activity analysis. Based on the vision of an idealized implantable microelectrode device, the performance requirements for microelectrodes are divided into four aspects, including recording quality, recording stability, recording throughput, and multifunctionality, which are presented in order of importance. The challenges and current possible solutions for implantable microelectrodes are given from the perspective of each aspect. The current developments in microelectrode technology are analyzed and summarized.

Corticospinal interface to restore voluntary control of joint torque in a paralyzed forearm following spinal cord injury in non-human primates

The corticospinal tract plays a major role in the control of voluntary limb movements, and its damage impedes voluntary limb control. We investigated the feasibility of closed-loop brain-controlled subdural spinal stimulation through a corticospinal interface for the modulation of wrist torque in the paralyzed forearm of monkeys with spinal cord injury at C4/C5. Subdural spinal stimulation of the preserved cervical enlargement activated multiple muscles on the paralyzed forearm and wrist torque in the range from flexion to ulnar-flexion. The magnitude of the evoked torque could be modulated by changing current intensity. We then employed the corticospinal interface designed to detect the firing rate of an arbitrarily selected "linked neuron" in the forearm territory of the primary motor cortex (M1) and convert it in real time to activity-contingent electrical stimulation of a spinal site caudal to the lesion. Linked neurons showed task-related activity that modulated the magnitude of the evoked torque and the activation of multiple muscles depending on the required torque. Unlinked neurons, which were independent of spinal stimulation and located in the vicinity of the linked neurons, exhibited task-related or -unrelated activity. Thus, monkeys were able to modulate the wrist torque of the paralyzed forearm by modulating the firing rate of M1 neurons including unlinked and linked neurons via the corticospinal interface. These results suggest that the corticospinal interface can replace the function of the corticospinal tract after spinal cord injury.

Personalized Brain-Computer Interface and Its Applications

Brain-computer interfaces (BCIs) are a new technology that subverts traditional human-computer interaction, where the control signal source comes directly from the user's brain. When a general BCI is used for practical applications, it is difficult for it to meet the needs of different individuals because of the differences among individual users in physiological and mental states, sensations, perceptions, imageries, cognitive thinking activities, and brain structures and functions. For this reason, it is necessary to customize personalized BCIs for specific users. So far, few studies have elaborated on the key scientific and technical issues involved in personalized BCIs. In this study, we will focus on personalized BCIs, give the definition of personalized BCIs, and detail their design, development, evaluation methods and applications. Finally, the challenges and future directions of personalized BCIs are discussed. It is expected that this study will provide some useful ideas for innovative studies and practical applications of personalized BCIs.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Global trends and hot topics in electrical stimulation of skeletal muscle research over the past decade: A bibliometric analysis

Background

Over the past decade, numerous advances have been made in the research on electrical stimulation of skeletal muscle. However, the developing status and future direction of this field remain unclear. This study aims to visualize the evolution and summarize global research hot topics and trends based on quantitative and qualitative evidence from bibliometrics.

Methods

Literature search was based on the Web of Science Core Collection (WoSCC) database from 2011 to 2021. CiteSpace and VOSviewer, typical bibliometric tools, were used to perform analysis and visualization.

Results

A total of 3,059 documents were identified. The number of literature is on the rise in general. Worldwide, researchers come primarily from North America and Europe, represented by the USA, France, Switzerland, and Canada. The Udice French Research Universities is the most published affiliation. Millet GY and Maffiuletti NA are the most prolific and the most co-cited authors, respectively. Plos One is the most popular journal, and the Journal of Applied Physiology is the top co-cited journal. The main keywords are muscle fatigue, neuromuscular electrical stimulation, spinal cord injury, tissue engineering, and atrophy. Moreover, this study systematically described the hotspots in this field.

Conclusion

As the first bibliometric analysis of electrical stimulation of skeletal muscle research over the past decade, this study can help scholars recognize hot topics and trends and provide a reference for further exploration in this field.

Validation of a non-invasive, real-time, human-in-the-loop model of intracortical brain-computer interfaces

Objective. Despite the tremendous promise of invasive brain-computer interfaces (iBCIs), the associated study costs, risks, and ethical considerations limit the opportunity to develop and test the algorithms that decode neural activity into a user's intentions. Our goal was to address this challenge by designing an iBCI model capable of testing many human subjects in closed-loop.Approach. We developed an iBCI model that uses artificial neural networks (ANNs) to translate human finger movements into realistic motor cortex firing patterns, which can then be decoded in real time. We call the model the joint angle BCI, or jaBCI. jaBCI allows readily recruited, healthy subjects to perform closed-loop iBCI tasks using any neural decoder, preserving subjects' control-relevant short-latency error correction and learning dynamics.Main results. We validated jaBCI offline through emulated neuron firing statistics, confirming that emulated neural signals have firing rates, low-dimensional PCA geometry, and rotational jPCA dynamics that are quite similar to the actual neurons (recorded in monkey M1) on which we trained the ANN. We also tested jaBCI in closed-loop experiments, our single study examining roughly as many subjects as have been tested world-wide with iBCIs (n= 25). Performance was consistent with that of the paralyzed, human iBCI users with implanted intracortical electrodes. jaBCI allowed us to imitate the experimental protocols (e.g. the same velocity Kalman filter decoder and center-out task) and compute the same seven behavioral measures used in three critical studies.Significance. These encouraging results suggest the jaBCI's real-time firing rate emulation is a useful means to provide statistically robust sample sizes for rapid prototyping and optimization of decoding algorithms, the study of bi-directional learning in iBCIs, and improving iBCI control.

Deep learning for neural decoding in motor cortex

Objective. Neural decoding is an important tool in neural engineering and neural data analysis. Of various machine learning algorithms adopted for neural decoding, the recently introduced deep learning is promising to excel. Therefore, we sought to apply deep learning to decode movement trajectories from the activity of motor cortical neurons.Approach. In this paper, we assessed the performance of deep learning methods in three different decoding schemes, concurrent, time-delay, and spatiotemporal. In the concurrent decoding scheme where the input to the network is the neural activity coincidental to the movement, deep learning networks including artificial neural network (ANN) and long-short term memory (LSTM) were applied to decode movement and compared with traditional machine learning algorithms. Both ANN and LSTM were further evaluated in the time-delay decoding scheme in which temporal delays are allowed between neural signals and movements. Lastly, in the spatiotemporal decoding scheme, we trained convolutional neural network (CNN) to extract movement information from images representing the spatial arrangement of neurons, their activity, and connectomes (i.e. the relative strengths of connectivity between neurons) and combined CNN and ANN to develop a hybrid spatiotemporal network. To reveal the input features of the CNN in the hybrid network that deep learning discovered for movement decoding, we performed a sensitivity analysis and identified specific regions in the spatial domain.Main results. Deep learning networks (ANN and LSTM) outperformed traditional machine learning algorithms in the concurrent decoding scheme. The results of ANN and LSTM in the time-delay decoding scheme showed that including neural data from time points preceding movement enabled decoders to perform more robustly when the temporal relationship between the neural activity and movement dynamically changes over time. In the spatiotemporal decoding scheme, the hybrid spatiotemporal network containing the concurrent ANN decoder outperformed single-network concurrent decoders.Significance. Taken together, our study demonstrates that deep learning could become a robust and effective method for the neural decoding of behavior.

A low-power stretchable neuromorphic nerve with proprioceptive feedback

By relaying neural signals from the motor cortex to muscles, devices for neurorehabilitation can enhance the movement of limbs in which nerves have been damaged as a consequence of injuries affecting the spinal cord or the lower motor neurons. However, conventional neuroprosthetic devices are rigid and power-hungry. Here we report a stretchable neuromorphic implant that restores coordinated and smooth motions in the legs of mice with neurological motor disorders, enabling the animals to kick a ball, walk or run. The neuromorphic implant acts as an artificial efferent nerve by generating electrophysiological signals from excitatory post-synaptic signals and by providing proprioceptive feedback. The device operates at low power (~1/150 that of a typical microprocessor system), and consists of hydrogel electrodes connected to a stretchable transistor incorporating an organic semiconducting nanowire (acting as an artificial synapse), connected via an ion gel to an artificial proprioceptor incorporating a carbon nanotube strain sensor (acting as an artificial muscle spindle). Stretchable electronics with proprioceptive feedback may inspire the further development of advanced neuromorphic devices for neurorehabilitation.

Activity-dependent plasticity and spinal cord stimulation for motor recovery following spinal cord injury

Spinal cord injuries lead to permanent physical impairment despite most often being anatomically incomplete disruptions of the spinal cord. Remaining connections between the brain and spinal cord create the potential for inducing neural plasticity to improve sensorimotor function, even many years after injury. This narrative review provides an overview of the current evidence for spontaneous motor recovery, activity-dependent plasticity, and interventions for restoring motor control to residual brain and spinal cord networks via spinal cord stimulation. In addition to open-loop spinal cord stimulation to promote long-term neuroplasticity, we also review a more targeted approach: closed-loop stimulation. Lastly, we review mechanisms of spinal cord neuromodulation to promote sensorimotor recovery, with the goal of advancing the field of rehabilitation for physical impairments following spinal cord injury.

Time stability and connectivity analysis with an intracortical 96-channel microelectrode array inserted in human visual cortex

OBJECTIVE

Microstimulation via electrodes that penetrate the visual cortex creates visual perceptions called phosphenes. Besides providing electrical stimulation to induce perceptions, each electrode can be used to record the brain signals from the cortex region under the electrode which contains brain state information. Since the future visual prosthesis interfaces will be implanted chronically in the visual cortex of blind people, it is important to study the long-term stability of the signals acquired from the electrodes. Here, we studied the changes over time and the repercussions of electrical stimulation on the brain signals acquired with an intracortical 96-channel microelectrode array implanted in the visual cortex of a blind volunteer for 6 months.

APPROACH

We used variance, power spectral density, correlation, coherence, and phase coherence to study the brain signals acquired in resting condition before and after the administration of electrical stimulation during a period of 6 months.

MAIN RESULTS

Variance and power spectral density up to 750 Hz do not show any significant trend in the 6 months, but correlation coherence and phase coherence significantly decrease over the implantation time and increase after electrical stimulation.

SIGNIFICANCE

The stability of variance and power spectral density in time is important for long-term clinical applications based on the intracortical signals collected by the electrodes. The decreasing trends of correlation, coherence, and phase coherence might be related to plasticity changes in the visual cortex due to electrical microstimulation.

Epidural electrical stimulation of the cervical dorsal roots restores voluntary upper limb control in paralyzed monkeys

Regaining arm control is a top priority for people with paralysis. Unfortunately, the complexity of the neural mechanisms underlying arm control has limited the effectiveness of neurotechnology approaches. Here, we exploited the neural function of surviving spinal circuits to restore voluntary arm and hand control in three monkeys with spinal cord injury, using spinal cord stimulation. Our neural interface leverages the functional organization of the dorsal roots to convey artificial excitation via electrical stimulation to relevant spinal segments at appropriate movement phases. Stimulation bursts targeting specific spinal segments produced sustained arm movements, enabling monkeys with arm paralysis to perform an unconstrained reach-and-grasp task. Stimulation specifically improved strength, task performances and movement quality. Electrophysiology suggested that residual descending inputs were necessary to produce coordinated movements. The efficacy and reliability of our approach hold realistic promises of clinical translation.

Transhemispheric cortex remodeling promotes forelimb recovery after spinal cord injury

Understanding the reorganization of neural circuits spared after spinal cord injury in the motor cortex and spinal cord would provide insights for developing therapeutics. Using optogenetic mapping, we demonstrated a transhemispheric recruitment of neural circuits in the contralateral cortical M1/M2 area to improve the impaired forelimb function after a cervical 5 right-sided hemisection in mice, a model mimicking the human Brown-Séquard syndrome. This cortical reorganization can be elicited by a selective cortical optogenetic neuromodulation paradigm. Areas of whisker, jaw, and neck, together with the rostral forelimb area, on the motor cortex ipsilateral to the lesion were engaged to control the ipsilesional forelimb in both stimulation and nonstimulation groups 8 weeks following injury. However, significant functional benefits were only seen in the stimulation group. Using anterograde tracing, we further revealed a robust sprouting of the intact corticospinal tract in the spinal cord of those animals receiving optogenetic stimulation. The intraspinal corticospinal axonal sprouting correlated with the forelimb functional recovery. Thus, specific neuromodulation of the cortical neural circuits induced massive neural reorganization both in the motor cortex and spinal cord, constructing an alternative motor pathway in restoring impaired forelimb function.

Restoration of complex movement in the paralyzed upper limb

OBJECTIVE

Functional electrical stimulation (FES) involves artificial activation of skeletal muscles to reinstate motor function in paralyzed individuals. While FES applied to the upper limb has improved the ability of tetraplegics to perform activities of daily living, there are key shortcomings impeding its widespread use. One major limitation is that the range of motor behaviors that can be generated is restricted to a small set of simple, preprogrammed movements. This limitation stems from the substantial difficulty in determining the patterns of stimulation across many muscles required to produce more complex movements. Therefore, the objective of this study was to use machine learning to flexibly identify patterns of muscle stimulation needed to evoke a wide array of multi-joint arm movements.

APPROACH

Arm kinematics and electromyographic activity from 29 muscles were recorded while a 'trainer' monkey made an extensive range of arm movements. Those data were used to train an artificial neural network that predicted patterns of muscle activity associated with a new set of movements. Those patterns were converted into trains of stimulus pulses that were delivered to upper limb muscles in two other temporarily paralyzed monkeys.

RESULTS

Machine-learning based prediction of EMG was good for within-subject predictions but appreciably poorer for across-subject predictions. Evoked responses matched the desired movements with good fidelity only in some cases. Means to mitigate errors associated with FES-evoked movements are discussed.

SIGNIFICANCE

Because the range of movements that can be produced with our approach is virtually unlimited, this system could greatly expand the repertoire of movements available to individuals with high level paralysis.

A Power-Efficient Brain-Machine Interface System With a Sub-mw Feature Extraction and Decoding ASIC Demonstrated in Nonhuman Primates

Intracortical brain-machine interfaces have shown promise for restoring function to people with paralysis, but their translation to portable and implantable devices is hindered by their high power consumption. Recent devices have drastically reduced power consumption compared to standard experimental brain-machine interfaces, but still require wired or wireless connections to computing hardware for feature extraction and inference. Here, we introduce a Neural Recording And Decoding (NeuRAD) application specific integrated circuit (ASIC) in 180 nm CMOS that can extract neural spiking features and predict two-dimensional behaviors in real-time. To reduce amplifier and feature extraction power consumption, the NeuRAD has a hardware accelerator for extracting spiking band power (SBP) from intracortical spiking signals and includes an M0 processor with a fixed-point Matrix Acceleration Unit (MAU) for efficient and flexible decoding. We validated device functionality by recording SBP from a nonhuman primate implanted with a Utah microelectrode array and predicting the one- and two-dimensional finger movements the monkey was attempting to execute in closed-loop using a steady-state Kalman filter (SSKF). Using the NeuRAD's real-time predictions, the monkey achieved 100% success rate and 0.82 s mean target acquisition time to control one-dimensional finger movements using just 581 μW. To predict two-dimensional finger movements, the NeuRAD consumed 588 μW to enable the monkey to achieve a 96% success rate and 2.4 s mean acquisition time. By employing SBP, ASIC brain-machine interfaces can close the gap to enable fully implantable therapies for people with paralysis.

Estimating muscle activation from EMG using deep learning-based dynamical systems models

Objective. To study the neural control of movement, it is often necessary to estimate how muscles are activated across a variety of behavioral conditions. One approach is to try extracting the underlying neural command signal to muscles by applying latent variable modeling methods to electromyographic (EMG) recordings. However, estimating the latent command signal that underlies muscle activation is challenging due to its complex relation with recorded EMG signals. Common approaches estimate each muscle's activation independently or require manual tuning of model hyperparameters to preserve behaviorally-relevant features.Approach. Here, we adapted AutoLFADS, a large-scale, unsupervised deep learning approach originally designed to de-noise cortical spiking data, to estimate muscle activation from multi-muscle EMG signals. AutoLFADS uses recurrent neural networks to model the spatial and temporal regularities that underlie multi-muscle activation.Main results. We first tested AutoLFADS on muscle activity from the rat hindlimb during locomotion and found that it dynamically adjusts its frequency response characteristics across different phases of behavior. The model produced single-trial estimates of muscle activation that improved prediction of joint kinematics as compared to low-pass or Bayesian filtering. We also applied AutoLFADS to monkey forearm muscle activity recorded during an isometric wrist force task. AutoLFADS uncovered previously uncharacterized high-frequency oscillations in the EMG that enhanced the correlation with measured force. The AutoLFADS-inferred estimates of muscle activation were also more closely correlated with simultaneously-recorded motor cortical activity than were other tested approaches.Significance.This method leverages dynamical systems modeling and artificial neural networks to provide estimates of muscle activation for multiple muscles. Ultimately, the approach can be used for further studies of multi-muscle coordination and its control by upstream brain areas, and for improving brain-machine interfaces that rely on myoelectric control signals.

A Pilot Study of Synergy-Based FES for Upper-Extremity Poststroke Rehabilitation

A previous study indicated that synergy-based functional electrical stimulation (FES) may improve instantaneous upper-limb motor performance for stroke survivors. However, it remains unclear whether the improvements will sustain over time to achieve functional gains associated with a task-oriented training (TOT). This pilot study was designed to investigate whether there is any promising sign of functional benefits. A TOT protocol with repeated forward and lateral reaching movements assisted by synergy-based FES was conducted in 16 patients (9 FES, 7 Sham) with post-stroke hemiparesis. FES stimuli were applied to 7 upper-extremity muscles of elbow and shoulder during patient movements. Envelopes of stimuli were individualized by re-composing the muscle synergies extracted from a healthy subject. After a five-day training for one hour each day, synergy-based FES induced higher increases in Fugl-Meyer scores (6.67±5.20) than did the Sham (2.00±2.38, p<0.05). Peak velocity of forward reaching movements increased with a slope 73% steeper in FES group than Sham. In lateral reaching movements, the change in synergy similarity correlated with the change in elbow flexion for the FES group, but not the Sham group. Our results indicate that synergy-based FES therapy induced clinically traceable signs of improvements in poststroke motor performance. The muscle activation in patients also showed promising sign of alteration by FES. Results suggest that a larger scale clinical trial of synergy-based FES may be feasible towards an individualized therapeutic regimen.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Targeting Sensory and Motor Integration for Recovery of Movement After CNS Injury

The central nervous system (CNS) integrates sensory and motor information to acquire skilled movements, known as sensory-motor integration (SMI). The reciprocal interaction of the sensory and motor systems is a prerequisite for learning and performing skilled movement. Injury to various nodes of the sensorimotor network causes impairment in movement execution and learning. Stimulation methods have been developed to directly recruit the sensorimotor system and modulate neural networks to restore movement after CNS injury. Part 1 reviews the main processes and anatomical interactions responsible for SMI in health. Part 2 details the effects of injury on sites critical for SMI, including the spinal cord, cerebellum, and cerebral cortex. Finally, Part 3 reviews the application of activity-dependent plasticity in ways that specifically target integration of sensory and motor systems. Understanding of each of these components is needed to advance strategies targeting SMI to improve rehabilitation in humans after injury.

Cortical Control of Virtual Self-Motion Using Task-Specific Subspaces

Brain-machine interfaces (BMIs) for reaching have enjoyed continued performance improvements, yet there remains significant need for BMIs that control other movement classes. Recent scientific findings suggest that the intrinsic covariance structure of neural activity depends strongly on movement class, potentially necessitating different decode algorithms across classes. To address this possibility, we developed a self-motion BMI based on cortical activity as monkeys cycled a hand-held pedal to progress along a virtual track. Unlike during reaching, we found no high-variance dimensions that directly correlated with to-be-decoded variables. This was due to no neurons having consistent correlations between their responses and kinematic variables. Yet we could decode a single variable-self-motion-by nonlinearly leveraging structure that spanned multiple high-variance neural dimensions. Resulting online BMI-control success rates approached those during manual control. These findings make two broad points regarding how to build decode algorithms that harmonize with the empirical structure of neural activity in motor cortex. First, even when decoding from the same cortical region (e.g., arm-related motor cortex), different movement classes may need to employ very different strategies. Although correlations between neural activity and hand velocity are prominent during reaching tasks, they are not a fundamental property of motor cortex and cannot be counted on to be present in general. Second, although one generally desires a low-dimensional readout, it can be beneficial to leverage a multidimensional high-variance subspace. Fully embracing this approach requires highly nonlinear approaches tailored to the task at hand, but can produce near-native levels of performance.SIGNIFICANCE STATEMENT Many brain-machine interface decoders have been constructed for controlling movements normally performed with the arm. Yet it is unclear how these will function beyond the reach-like scenarios where they were developed. Existing decoders implicitly assume that neural covariance structure, and correlations with to-be-decoded kinematic variables, will be largely preserved across tasks. We find that the correlation between neural activity and hand kinematics, a feature typically exploited when decoding reach-like movements, is essentially absent during another task performed with the arm: cycling through a virtual environment. Nevertheless, the use of a different strategy, one focused on leveraging the highest-variance neural signals, supported high performance real-time brain-machine interface control.

Bayesian optimization of peripheral intraneural stimulation protocols to evoke distal limb movements

Objective.Motor neuroprostheses require the identification of stimulation protocols that effectively produce desired movements. Manual search for these protocols can be very time-consuming and often leads to suboptimal solutions, as several stimulation parameters must be personalized for each subject for a variety of target motor functions. Here, we present an algorithm that efficiently tunes peripheral intraneural stimulation protocols to elicit functionally relevant distal limb movements.Approach.We developed the algorithm using Bayesian optimization (BO) with multi-output Gaussian Processes (GPs) and defined objective functions based on coordinated muscle recruitment. We applied the algorithm offline to data acquired in rats for walking control and in monkeys for hand grasping control and compared different GP models for these two systems. We then performed a preliminary online test in a monkey to experimentally validate the functionality of our method.Main results.Offline, optimal intraneural stimulation protocols for various target motor functions were rapidly identified in both experimental scenarios. Using the model that performed best, the algorithm converged to stimuli that evoked functionally consistent movements with an average number of actions equal to 20% of the search space size in both the rat and monkey animal models. Online, the algorithm quickly guided the observations to stimuli that elicited functional hand gestures, although more selective motor outputs could have been achieved by refining the objective function used.Significance.These results demonstrate that BO can reliably and efficiently automate the tuning of peripheral neurostimulation protocols, establishing a translational framework to configure peripheral motor neuroprostheses in clinical applications. The proposed method can also potentially be applied to optimize motor functions using other stimulation modalities.

Controlling Clinical States Governed by Different Temporal Dynamics With Closed-Loop Deep Brain Stimulation: A Principled Framework

Closed-loop strategies for deep brain stimulation (DBS) are paving the way for improving the efficacy of existing neuromodulation therapies across neurological disorders. Unlike continuous DBS, closed-loop DBS approaches (cl-DBS) optimize the delivery of stimulation in the temporal domain. However, clinical and neurophysiological manifestations exhibit highly diverse temporal properties and evolve over multiple time-constants. Moreover, throughout the day, patients are engaged in different activities such as walking, talking, or sleeping that may require specific therapeutic adjustments. This broad range of temporal properties, along with inter-dependencies affecting parallel manifestations, need to be integrated in the development of therapies to achieve a sustained, optimized control of multiple symptoms over time. This requires an extended view on future cl-DBS design. Here we propose a conceptual framework to guide the development of multi-objective therapies embedding parallel control loops. Its modular organization allows to optimize the personalization of cl-DBS therapies to heterogeneous patient profiles. We provide an overview of clinical states and symptoms, as well as putative electrophysiological biomarkers that may be integrated within this structure. This integrative framework may guide future developments and become an integral part of next-generation precision medicine instruments.

Emergence of flexible technology in developing advanced systems for post-stroke rehabilitation: a comprehensive review

OBJECTIVE

Stroke is one of the most common neural disorders, which causes physical disabilities and motor impairments among its survivors. Several technologies have been developed for providing stroke rehabilitation and to assist the survivors in performing their daily life activities. Currently, the use of flexible technology (FT) for stroke rehabilitation systems is on a rise that allows the development of more compact and lightweight wearable systems, which stroke survivors can easily use for long-term activities.

APPROACH

For stroke applications, FT mainly includes the "flexible/stretchable electronics", "e-textile (electronic textile)" and "soft robotics". Thus, a thorough literature review has been performed to report the practical implementation of FT for post-stroke application.

MAIN RESULTS

In this review, the highlights of the advancement of FT in stroke rehabilitation systems are dealt with. Such systems mainly involve the "biosignal acquisition unit", "rehabilitation devices" and "assistive systems". In terms of biosignals acquisition, electroencephalography (EEG) and electromyography (EMG) are comprehensively described. For rehabilitation/assistive systems, the application of functional electrical stimulation (FES) and robotics units (exoskeleton, orthosis, etc.) have been explained.

SIGNIFICANCE

This is the first review article that compiles the different studies regarding flexible technology based post-stroke systems. Furthermore, the technological advantages, limitations, and possible future implications are also discussed to help improve and advance the flexible systems for the betterment of the stroke community.