Neural control of finger movement via intracortical brain-machine interface

Accurate neural control of a hand prosthesis by posture-related activity in the primate grasping circuit

Brain-computer interfaces (BCIs) have the potential to restore hand movement for people with paralysis, but current devices still lack the fine control required to interact with objects of daily living. Following our understanding of cortical activity during arm reaches, hand BCI studies have focused primarily on velocity control. However, mounting evidence suggests that posture, and not velocity, dominates in hand-related areas. To explore whether this signal can causally control a prosthesis, we developed a BCI training paradigm centered on the reproduction of posture transitions. Monkeys trained with this protocol were able to control a multidimensional hand prosthesis with high accuracy, including execution of the very intricate precision grip. Analysis revealed that the posture signal in the target grasping areas was the main contributor to control. We present, for the first time, neural posture control of a multidimensional hand prosthesis, opening the door for future interfaces to leverage this additional information channel.

Effects of wearable device training on upper limb motor function in patients with stroke: a systematic review and meta-analysis

OBJECTIVE

To evaluate the effect of wearable device training on improving upper limb motor function in patients who experienced strokes.

METHODS

The PubMed, Embase, Cochrane Library, Web of Science, MEDLINE, SCOPUS, China National Knowledge Infrastructure, WanFang, and VIP databases were searched for randomized controlled trials (RCTs) that assessed the effectiveness of wearable device training in improving upper limb motor function in patients with stroke. Two investigators independently screened studies by their titles and abstracts and cross-checked, downloaded, and evaluated the results. Disagreements were resolved by a third highly experienced researcher. Risk of bias was evaluated using the Cochrane risk-of-bias tool. This meta-analysis was registered in PROSPERO (registration No. CRD42023421633).

RESULTS

This study comprised 508 patients from 14 RCTs. The experimental group assessed various wearable devices, including 3D-printed dynamic orthoses, inertial measurement unit (IMU) sensors, electrical stimulation devices, and virtual reality (VR) devices for virtual interactive training. The control group received traditional rehabilitation therapies, including physical and conventional rehabilitation. The experimental group scored better on the Fugl-Meyer Assessment (FMA-UE) scale (standardized mean difference [SMD] 0.26, 95% confidence interval [CI] 0.07, 0.45) and Box and Block Test (BBT) (SMD 0.43, 95% CI 0.17, 0.69) versus controls. No significant intergroup differences were observed in the Action Research Arm Test (SMD 0.20, 95% CI -0.15, 0.55), motor activity log (mean difference [MD] 0.32, 95% CI -0.54, 0.33), and modified Ashworth scale (MD -0.08, 95% CI -0.81, 0.64). The probability rankings of wearable devices that improved FMA-UE scores in patients with stroke were: orthotic devices, with the highest probability ranking of 0.45, followed by sensor devices at 0.23, electrical stimulation devices at 0.21, and VR devices at 0.11.

CONCLUSIONS

Wearable device training was found to significantly improve upper limb motor function in patients with stroke, particularly for large-range movements. Improvements in FMA-UE and BBT scores reflected reduced impairment and enhanced manual dexterity, respectively. However, the training had no significant effect on hand movement frequency, fine motor skills, or spasticity. Among the different wearable devices tested, orthoses produced the most effective results.

Physiological and chaos effect on dynamics of neurological disorder with memory effect of fractional operator: A mathematical study

BACKGROUND AND OBJECTIVE

To study the dynamical system, it is necessary to formulate the mathematical model to understand the dynamics of various diseases that are spread worldwide. The main objective of our work is to examine neurological disorders by early detection and treatment by taking asymptomatic. The central nervous system (CNS) is impacted by the prevalent neurological condition known as multiple sclerosis (MS), which can result in lesions that spread across time and place. It is widely acknowledged that multiple sclerosis (MS) is an unpredictable disease that can cause lifelong damage to the brain, spinal cord, and optic nerves. The use of integral operators and fractional order (FO) derivatives in mathematical models has become popular in the field of epidemiology.

METHOD

The model consists of segments of healthy or barian brain cells, infected brain cells, and damaged brain cells as a result of immunological or viral effectors with novel fractal fractional operator in sight Mittag Leffler function. The stability analysis, positivity, boundedness, existence, and uniqueness are treated for a proposed model with novel fractional operators.

RESULTS

Model is verified the local and global with the Lyapunov function. Chaos Control will use the regulate for linear responses approach to bring the system to stabilize according to its points of equilibrium so that solutions are bounded in the feasible domain. To ensure the existence and uniqueness of the solutions to the suggested model, it makes use of Banach's fixed point and the Leray Schauder nonlinear alternative theorem. For numerical simulation and results the steps Lagrange interpolation method at different fractional order values and the outcomes are compared with those obtained using the well-known FFM method.

CONCLUSION

Overall, by offering a mathematical model that can be used to replicate and examine the behavior of disease models, this research advances our understanding of the course and recurrence of disease. Such type of investigation will be useful to investigate the spread of disease as well as helpful in developing control strategies from our justified outcomes.

Depletion of complement factor 3 delays the neuroinflammatory response to intracortical microelectrodes

The neuroinflammatory response to intracortical microelectrodes (IMEs) used with brain-machine interfacing (BMI) applications is regarded as the primary contributor to poor chronic performance. Recent developments in high-plex gene expression technologies have allowed for an evolution in the investigation of individual proteins or genes to be able to identify specific pathways of upregulated genes that may contribute to the neuroinflammatory response. Several key pathways that are upregulated following IME implantation are involved with the complement system. The complement system is part of the innate immune system involved in recognizing and eliminating pathogens - a significant contributor to the foreign body response against biomaterials. Specifically, we have identified Complement 3 (C3) as a gene of interest because it is the intersection of several key complement pathways. In this study, we investigated the role of C3 in the IME inflammatory response by comparing the neuroinflammatory gene expression at the microelectrode implant site between C3 knockout (C3-/-) and wild-type (WT) mice. We have found that, like in WT mice, implantation of intracortical microelectrodes in C3-/- mice yields a dramatic increase in the neuroinflammatory gene expression at all post-surgery time points investigated. However, compared to WT mice, C3 depletion showed reduced expression of many neuroinflammatory genes pre-surgery and 4 weeks post-surgery. Conversely, depletion of C3 increased the expression of many neuroinflammatory genes at 8 weeks and 16 weeks post-surgery, compared to WT mice. Our results suggest that C3 depletion may be a promising therapeutic target for acute, but not chronic, relief of the neuroinflammatory response to IME implantation. Additional compensatory targets may also be required for comprehensive long-term reduction of the neuroinflammatory response for improved intracortical microelectrode performance.

The effect of a Mn(III)tetrakis(4-benzoic acid)porphyrin (MnTBAP) coating on the chronic recording performance of planar silicon intracortical microelectrode arrays

Intracortical microelectrode arrays (MEAs) are used to record neural activity. However, their implantation initiates a neuroinflammatory cascade, involving the accumulation of reactive oxygen species, leading to interface failure. Here, we coated commercially-available MEAs with Mn(III)tetrakis(4-benzoic acid)porphyrin (MnTBAP), to mitigate oxidative stress. First, we assessed the in vitro cytotoxicity of modified sample substrates. Then, we implanted 36 rats with uncoated, MnTBAP-coated ("Coated"), or (3-Aminopropyl)triethoxysilane (APTES)-coated devices - an intermediate step in the coating process. We assessed electrode performance during the acute (1-5 weeks), sub-chronic (6-11 weeks), and chronic (12-16 weeks) phases after implantation. Three subsets of animals were euthanized at different time points to assess the acute, sub-chronic and chronic immunohistological responses. Results showed that MnTBAP coatings were not cytotoxic in vitro, and their implantation in vivo improved the proportion of electrodes during the sub-chronic and chronic phases; APTES coatings resulted in failure of the neural interface during the chronic phase. In addition, MnTBAP coatings improved the quality of the signal throughout the study and reduced the neuroinflammatory response around the implant as early as two weeks, an effect that remained consistent for months post-implantation. Together, these results suggest that MnTBAP coatings are a potentially useful modification to improve MEA reliability.

On-demand electrically controlled melatonin release from PEDOT/SNP composite improves quality of chronic neural recording

Long-time and high-quality signal acquisition performance from implantable electrodes is the key to establish stable and efficient brain-computer interface (BCI) connections. The chronic performance of implantable electrodes is hindered by the inflammatory response of brain tissue. In order to solve the material limitation of biological interface electrodes, we designed sulfonated silica nanoparticles (SNPs) as the dopant of Poly (3,4-ethylenedioxythiophene) (PEDOT) to modify the implantable electrodes. In this work, melatonin (MT) loaded SNPs were incorporated in PEDOT via electrochemical deposition on nickel-chromium (Ni-Cr) alloy electrode and carbon nanotube (CNT) fiber electrodes, without affecting the acute neural signal recording capacity. After coating with PEDOT/SNP-MT, the charge storage capacity of both electrodes was significantly increased, and the electrochemical impedance at 1 kHz of the Ni-Cr alloy electrodes was significantly reduced, while that of the CNT electrodes was significantly increased. In addition, this study inspected the effect of electrically triggered MT release every other day on the quality and longevity of neural recording from implanted neural electrodes in rat hippocampus for 1 month. Both MT modified Ni-Cr alloy electrodes and CNT electrodes showed significantly higher spike amplitude after 26-day recording. Significantly, the histological studies showed that the number of astrocytes around the implanted Ni-Cr alloy electrodes was significantly reduced after MT release. These results demonstrate the potent outcome of PEDOT/SNP-MT treatment in improving the chronic neural recording quality possibly through its anti-inflammatory property.

Differential expression of genes involved in the chronic response to intracortical microelectrodes

Brain-Machine Interface systems (BMIs) are clinically valuable devices that can provide functional restoration for patients with spinal cord injury or improved integration for patients requiring prostheses. Intracortical microelectrodes can record neuronal action potentials at a resolution necessary for precisely controlling BMIs. However, intracortical microelectrodes have a demonstrated history of progressive decline in the recording performance with time, inhibiting their usefulness. One major contributor to decreased performance is the neuroinflammatory response to the implanted microelectrodes. The neuroinflammatory response can lead to neurodegeneration and the formation of a glial scar at the implant site. Historically, histological imaging of relatively few known cellular and protein markers has characterized the neuroinflammatory response to implanted microelectrode arrays. However, neuroinflammation requires many molecular players to coordinate the response - meaning traditional methods could result in an incomplete understanding. Taking advantage of recent advancements in tools to characterize the relative or absolute DNA/RNA expression levels, a few groups have begun to explore gene expression at the microelectrode-tissue interface. We have utilized a custom panel of ∼813 neuroinflammatory-specific genes developed with NanoString for bulk tissue analysis at the microelectrode-tissue interface. Our previous studies characterized the acute innate immune response to intracortical microelectrodes. Here we investigated the gene expression at the microelectrode-tissue interface in wild-type (WT) mice chronically implanted with nonfunctioning probes. We found 28 differentially expressed genes at chronic time points (4WK, 8WK, and 16WK), many in the complement and extracellular matrix system. Further, the expression levels were relatively stable over time. Genes identified here represent chronic molecular players at the microelectrode implant sites and potential therapeutic targets for the long-term integration of microelectrodes. STATEMENT OF SIGNIFICANCE: Intracortical microelectrodes can record neuronal action potentials at a resolution necessary for the precise control of Brain-Machine Interface systems (BMIs). However, intracortical microelectrodes have a demonstrated history of progressive declines in the recording performance with time, inhibiting their usefulness. One major contributor to the decline in these devices is the neuroinflammatory response against the implanted microelectrodes. Historically, neuroinflammation to implanted microelectrode arrays has been characterized by histological imaging of relatively few known cellular and protein markers. Few studies have begun to develop a more in-depth understanding of the molecular pathways facilitating device-mediated neuroinflammation. Here, we are among the first to identify genetic pathways that could represent targets to improve the host response to intracortical microelectrodes, and ultimately device performance.

Balancing Memorization and Generalization in RNNs for High Performance Brain-Machine Interfaces

Brain-machine interfaces (BMIs) can restore motor function to people with paralysis but are currently limited by the accuracy of real-time decoding algorithms. Recurrent neural networks (RNNs) using modern training techniques have shown promise in accurately predicting movements from neural signals but have yet to be rigorously evaluated against other decoding algorithms in a closed-loop setting. Here we compared RNNs to other neural network architectures in real-time, continuous decoding of finger movements using intracortical signals from nonhuman primates. Across one and two finger online tasks, LSTMs (a type of RNN) outperformed convolutional and transformer-based neural networks, averaging 18% higher throughput than the convolution network. On simplified tasks with a reduced movement set, RNN decoders were allowed to memorize movement patterns and matched able-bodied control. Performance gradually dropped as the number of distinct movements increased but did not go below fully continuous decoder performance. Finally, in a two-finger task where one degree-of-freedom had poor input signals, we recovered functional control using RNNs trained to act both like a movement classifier and continuous decoder. Our results suggest that RNNs can enable functional real-time BMI control by learning and generating accurate movement patterns.

Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex

Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.

Utah array characterization and histological analysis of a multi-year implant in non-human primate motor and sensory cortices

Objective.The Utah array is widely used in both clinical studies and neuroscience. It has a strong track record of safety. However, it is also known that implanted electrodes promote the formation of scar tissue in the immediate vicinity of the electrodes, which may negatively impact the ability to record neural waveforms. This scarring response has been primarily studied in rodents, which may have a very different response than primate brain.Approach.Here, we present a rare nonhuman primate histological dataset (n= 1 rhesus macaque) obtained 848 and 590 d after implantation in two brain hemispheres. For 2 of 4 arrays that remained within the cortex, NeuN was used to stain for neuron somata at three different depths along the shanks. Images were filtered and denoised, with neurons then counted in the vicinity of the arrays as well as a nearby section of control tissue. Additionally, 3 of 4 arrays were imaged with a scanning electrode microscope to evaluate any materials damage that might be present.Main results.Overall, we found a 63% percent reduction in the number of neurons surrounding the electrode shanks compared to control areas. In terms of materials, the arrays remained largely intact with metal and Parylene C present, though tip breakage and cracks were observed on many electrodes.Significance.Overall, these results suggest that the tissue response in the nonhuman primate brain shows similar neuron loss to previous studies using rodents. Electrode improvements, for example using smaller or softer probes, may therefore substantially improve the tissue response and potentially improve the neuronal recording yield in primate cortex.

Real-time brain-machine interface in non-human primates achieves high-velocity prosthetic finger movements using a shallow feedforward neural network decoder

Despite the rapid progress and interest in brain-machine interfaces that restore motor function, the performance of prosthetic fingers and limbs has yet to mimic native function. The algorithm that converts brain signals to a control signal for the prosthetic device is one of the limitations in achieving rapid and realistic finger movements. To achieve more realistic finger movements, we developed a shallow feed-forward neural network to decode real-time two-degree-of-freedom finger movements in two adult male rhesus macaques. Using a two-step training method, a recalibrated feedback intention-trained (ReFIT) neural network is introduced to further improve performance. In 7 days of testing across two animals, neural network decoders, with higher-velocity and more natural appearing finger movements, achieved a 36% increase in throughput over the ReFIT Kalman filter, which represents the current standard. The neural network decoders introduced herein demonstrate real-time decoding of continuous movements at a level superior to the current state-of-the-art and could provide a starting point to using neural networks for the development of more naturalistic brain-controlled prostheses.

A Power-Efficient Brain-Machine Interface System With a Sub-mw Feature Extraction and Decoding ASIC Demonstrated in Nonhuman Primates

Intracortical brain-machine interfaces have shown promise for restoring function to people with paralysis, but their translation to portable and implantable devices is hindered by their high power consumption. Recent devices have drastically reduced power consumption compared to standard experimental brain-machine interfaces, but still require wired or wireless connections to computing hardware for feature extraction and inference. Here, we introduce a Neural Recording And Decoding (NeuRAD) application specific integrated circuit (ASIC) in 180 nm CMOS that can extract neural spiking features and predict two-dimensional behaviors in real-time. To reduce amplifier and feature extraction power consumption, the NeuRAD has a hardware accelerator for extracting spiking band power (SBP) from intracortical spiking signals and includes an M0 processor with a fixed-point Matrix Acceleration Unit (MAU) for efficient and flexible decoding. We validated device functionality by recording SBP from a nonhuman primate implanted with a Utah microelectrode array and predicting the one- and two-dimensional finger movements the monkey was attempting to execute in closed-loop using a steady-state Kalman filter (SSKF). Using the NeuRAD's real-time predictions, the monkey achieved 100% success rate and 0.82 s mean target acquisition time to control one-dimensional finger movements using just 581 μW. To predict two-dimensional finger movements, the NeuRAD consumed 588 μW to enable the monkey to achieve a 96% success rate and 2.4 s mean acquisition time. By employing SBP, ASIC brain-machine interfaces can close the gap to enable fully implantable therapies for people with paralysis.

A low-power communication scheme for wireless, 1000 channel brain-machine interfaces

OBJECTIVE

Brain-machine interfaces (BMIs) have the potential to restore motor function but are currently limited by electrode count and long-term recording stability. These challenges may be solved through the use of free-floating "motes" which wirelessly transmit recorded neural signals, if power consumption can be kept within safe levels when scaling to thousands of motes. Here, we evaluated a pulse-interval modulation (PIM) communication scheme for infrared (IR)-based motes that aims to reduce the wireless data rate and system power consumption.

APPROACH

To test PIM's ability to efficiently communicate neural information, we simulated the communication scheme in a real-time closed-loop BMI with non-human primates. Additionally, we performed circuit simulations of an IR-based 1000-mote system to calculate communication accuracy and total power consumption.

MAIN RESULTS

We found that PIM at 1kb/s per channel maintained strong correlations with true firing rate and matched online BMI performance of a traditional wired system. Closed-loop BMI tests suggest that lags as small as 30 ms can have significant performance effects. Finally, unlike other IR communication schemes, PIM is feasible in terms of power, and neural data can accurately be recovered on a receiver using 3mW for 1000 channels.

SIGNIFICANCE

These results suggest that PIM-based communication could significantly reduce power usage of wireless motes to enable higher channel-counts for high-performance BMIs.

A Light-Tolerant Wireless Neural Recording IC for Motor Prediction With Near-Infrared-Based Power and Data Telemetry

Miniaturized and wireless near-infrared (NIR) based neural recorders with optical powering and data telemetry have been introduced as a promising approach for safe long-term monitoring with the smallest physical dimension among state-of-the-art standalone recorders. However, a main challenge for the NIR based neural recording ICs is to maintain robust operation in the presence of light-induced parasitic short circuit current from junction diodes. This is especially true when the signal currents are kept small to reduce power consumption. In this work, we present a light-tolerant and low-power neural recording IC for motor prediction that can fully function in up to 300 μW/mm2 of light exposure. It achieves best-in-class power consumption of 0.57 μW at 38° C with a 4.1 NEF pseudo-resistorless amplifier, an on-chip neural feature extractor, and individual mote level gain control. Applying the 20-channel pre-recorded neural signals of a monkey, the IC predicts finger position and velocity with correlation coefficient up to 0.870 and 0.569, respectively, with individual mote level gain control enabled. In addition, wireless measurement is demonstrated through optical power and data telemetry using a custom PV/LED GaAs chip wire bonded to the proposed IC.

Real-time linear prediction of simultaneous and independent movements of two finger groups using an intracortical brain-machine interface

Modern brain-machine interfaces can return function to people with paralysis, but current upper extremity brain-machine interfaces are unable to reproduce control of individuated finger movements. Here, for the first time, we present a real-time, high-speed, linear brain-machine interface in nonhuman primates that utilizes intracortical neural signals to bridge this gap. We created a non-prehensile task that systematically individuates two finger groups, the index finger and the middle-ring-small fingers combined. During online brain control, the ReFIT Kalman filter could predict individuated finger group movements with high performance. Next, training ridge regression decoders with individual movements was sufficient to predict untrained combined movements and vice versa. Finally, we compared the postural and movement tuning of finger-related cortical activity to find that individual cortical units simultaneously encode multiple behavioral dimensions. Our results suggest that linear decoders may be sufficient for brain-machine interfaces to execute high-dimensional tasks with the performance levels required for naturalistic neural prostheses.

Restoring upper extremity function with brain-machine interfaces

One of the most exciting advances to emerge in neural interface technologies has been the development of real-time brain-machine interface (BMI) neuroprosthetic devices to restore upper extremity function. BMI neuroprostheses, made possible by synergistic advances in neural recording technologies, high-speed computation and signal processing, and neuroscience, have permitted the restoration of volitional movement to patients suffering the loss of upper-extremity function. In this chapter, we review the scientific and technological advances underlying these remarkable devices. After presenting an introduction to the current state of the field, we provide an accessible technical discussion of the two fundamental requirements of a successful neuroprosthesis: signal extraction from the brain and signal decoding that results in robust prosthetic control. We close with a presentation of emerging technologies that are likely to substantially advance the field.

Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals

Previous literature shows that deep learning is an effective tool to decode the motor intent from neural signals obtained from different parts of the nervous system. However, deep neural networks are often computationally complex and not feasible to work in real-time. Here we investigate different approaches' advantages and disadvantages to enhance the deep learning-based motor decoding paradigm's efficiency and inform its future implementation in real-time. Our data are recorded from the amputee's residual peripheral nerves. While the primary analysis is offline, the nerve data is cut using a sliding window to create a “pseudo-online” dataset that resembles the conditions in a real-time paradigm. First, a comprehensive collection of feature extraction techniques is applied to reduce the input data dimensionality, which later helps substantially lower the motor decoder's complexity, making it feasible for translation to a real-time paradigm. Next, we investigate two different strategies for deploying deep learning models: a one-step (1S) approach when big input data are available and a two-step (2S) when input data are limited. This research predicts five individual finger movements and four combinations of the fingers. The 1S approach using a recurrent neural network (RNN) to concurrently predict all fingers' trajectories generally gives better prediction results than all the machine learning algorithms that do the same task. This result reaffirms that deep learning is more advantageous than classic machine learning methods for handling a large dataset. However, when training on a smaller input data set in the 2S approach, which includes a classification stage to identify active fingers before predicting their trajectories, machine learning techniques offer a simpler implementation while ensuring comparably good decoding outcomes to the deep learning ones. In the classification step, either machine learning or deep learning models achieve the accuracy and F1 score of 0.99. Thanks to the classification step, in the regression step, both types of models result in a comparable mean squared error (MSE) and variance accounted for (VAF) scores as those of the 1S approach. Our study outlines the trade-offs to inform the future implementation of real-time, low-latency, and high accuracy deep learning-based motor decoder for clinical applications.

A Nonlinear Maximum Correntropy Information Filter for High-Dimensional Neural Decoding

Neural signal decoding is a critical technology in brain machine interface (BMI) to interpret movement intention from multi-neural activity collected from paralyzed patients. As a commonly-used decoding algorithm, the Kalman filter is often applied to derive the movement states from high-dimensional neural firing observation. However, its performance is limited and less effective for noisy nonlinear neural systems with high-dimensional measurements. In this paper, we propose a nonlinear maximum correntropy information filter, aiming at better state estimation in the filtering process for a noisy high-dimensional measurement system. We reconstruct the measurement model between the high-dimensional measurements and low-dimensional states using the neural network, and derive the state estimation using the correntropy criterion to cope with the non-Gaussian noise and eliminate large initial uncertainty. Moreover, analyses of convergence and robustness are given. The effectiveness of the proposed algorithm is evaluated by applying it on multiple segments of neural spiking data from two rats to interpret the movement states when the subjects perform a two-lever discrimination task. Our results demonstrate better and more robust state estimation performance when compared with other filters.

Bridging the"Last Millimeter" Gap of Brain-Machine Interfaces via Near-Infrared Wireless Power Transfer and Data Communications

Arrays of floating neural sensors with high channel count that cover an area of square centimeters and larger would be transformative for neural engineering and brain-machine interfaces. Meeting the power and wireless data communications requirements within the size constraints for each neural sensor has been elusive due to the need to incorporate sensing, computing, communications, and power functionality in a package of approximately 100 micrometers on a side. In this work, we demonstrate a near infrared optical power and data communication link for a neural recording system that satisfies size requirements to achieve dense arrays and power requirements to prevent tissue heating. The optical link is demonstrated using an integrated optoelectronic device consisting of a tandem photovoltaic cell and microscale light emitting diode. End-to-end functionality of a wireless neural link within system constraints is demonstrated using a pre-recorded neural signal between a self-powered CMOS integrated circuit and single photon avalanche photodiode.

Nursing effects of finger exercise on cognitive function and others for cerebral ischemic stroke patients

OBJECTIVE

To investigate the nursing effects of finger exercise training on cognitive function and others for patients with cerebral ischemic stroke (CIS).

METHODS

A total of 200 patients with CIS were selected in this prospective study. According to the random number table method, they were divided into control group (n=100, routine nursing) and research group (n=100, routine nursing combined with finger exercise training). Various scales were used to evaluate the cognitive function, hand function, upper limb motor function, wrist flexor muscle tone, degree of neurological impairment and ability of daily living (ADL) in the two groups before and after intervention. And the incidence of mild vascular cognitive impairment (VCI) after intervention was compared.

RESULTS

After intervention, Montreal Cognitive Assessment (MoCA), Mini Mental State Examination (MMSE), hand function, Fugl-meyer Assessment (FMA) and ADL scores in both groups were significantly increased, and those in the research group were significantly higher than those in the control group (all P<0.05). There were opposite trends in the Neurologic Functional Defect (NIHSS) and Modified Ashworth Scale (MAS) for wrist flexor scores (all P<0.05). The incidence of mild VCI in the research group was significantly lower than that in the control group (P<0.05).

CONCLUSION

On the basis of early rehabilitation nursing, combined finger exercise training can improve cognitive function, hand function, upper limb function and ADL for patients with CIS.

Modelling and prediction of the dynamic responses of large-scale brain networks during direct electrical stimulation

Direct electrical stimulation can modulate the activity of brain networks for the treatment of several neurological and neuropsychiatric disorders and for restoring lost function. However, precise neuromodulation in an individual requires the accurate modelling and prediction of the effects of stimulation on the activity of their large-scale brain networks. Here, we report the development of dynamic input-output models that predict multiregional dynamics of brain networks in response to temporally varying patterns of ongoing microstimulation. In experiments with two awake rhesus macaques, we show that the activities of brain networks are modulated by changes in both stimulation amplitude and frequency, that they exhibit damping and oscillatory response dynamics, and that variabilities in prediction accuracy and in estimated response strength across brain regions can be explained by an at-rest functional connectivity measure computed without stimulation. Input-output models of brain dynamics may enable precise neuromodulation for the treatment of disease and facilitate the investigation of the functional organization of large-scale brain networks.

Classification of Individual Finger Movements Using Intracortical Recordings in Human Motor Cortex

BACKGROUND

Intracortical microelectrode arrays have enabled people with tetraplegia to use a brain-computer interface for reaching and grasping. In order to restore dexterous movements, it will be necessary to control individual fingers.

OBJECTIVE

To predict which finger a participant with hand paralysis was attempting to move using intracortical data recorded from the motor cortex.

METHODS

A 31-yr-old man with a C5/6 ASIA B spinal cord injury was implanted with 2 88-channel microelectrode arrays in left motor cortex. Across 3 d, the participant observed a virtual hand flex in each finger while neural firing rates were recorded. A 6-class linear discriminant analysis (LDA) classifier, with 10 × 10-fold cross-validation, was used to predict which finger movement was being performed (flexion/extension of all 5 digits and adduction/abduction of the thumb).

RESULTS

The mean overall classification accuracy was 67% (range: 65%-76%, chance: 17%), which occurred at an average of 560 ms (range: 420-780 ms) after movement onset. Individually, thumb flexion and thumb adduction were classified with the highest accuracies at 92% and 93%, respectively. The index, middle, ring, and little achieved an accuracy of 65%, 59%, 43%, and 56%, respectively, and, when incorrectly classified, were typically marked as an adjacent finger. The classification accuracies were reflected in a low-dimensional projection of the neural data into LDA space, where the thumb-related movements were most separable from the finger movements.

CONCLUSION

Classification of intention to move individual fingers was accurately predicted by intracortical recordings from a human participant with the thumb being particularly independent.

A bioelectric neural interface towards intuitive prosthetic control for amputees

OBJECTIVE

While prosthetic hands with independently actuated digits have become commercially available, state-of-the-art human-machine interfaces (HMI) only permit control over a limited set of grasp patterns, which does not enable amputees to experience sufficient improvement in their daily activities to make an active prosthesis useful.

APPROACH

Here we present a technology platform combining fully-integrated bioelectronics, implantable intrafascicular microelectrodes and deep learning-based artificial intelligence (AI) to facilitate this missing bridge by tapping into the intricate motor control signals of peripheral nerves. The bioelectric neural interface includes an ultra-low-noise neural recording system to sense electroneurography (ENG) signals from microelectrode arrays implanted in the residual nerves, and AI models employing the recurrent neural network (RNN) architecture to decode the subject's motor intention.

MAIN RESULTS

A pilot human study has been carried out on a transradial amputee. We demonstrate that the information channel established by the proposed neural interface is sufficient to provide high accuracy control of a prosthetic hand up to 15 degrees of freedom (DOF). The interface is intuitive as it directly maps complex prosthesis movements to the patient's true intention.

SIGNIFICANCE

Our study layouts the foundation towards not only a robust and dexterous control strategy for modern neuroprostheses at a near-natural level approaching that of the able hand, but also an intuitive conduit for connecting human minds and machines through the peripheral neural pathways. (Clinical trial identifier: NCT02994160).

A low-power band of neuronal spiking activity dominated by local single units improves the performance of brain-machine interfaces

The large power requirement of current brain-machine interfaces is a major hindrance to their clinical translation. In basic behavioural tasks, the downsampled magnitude of the 300-1,000 Hz band of spiking activity can predict movement similarly to the threshold crossing rate (TCR) at 30 kilo-samples per second. However, the relationship between such a spiking-band power (SBP) and neural activity remains unclear, as does the capability of using the SBP to decode complicated behaviour. By using simulations of recordings of neural activity, here we show that the SBP is dominated by local single-unit spikes with spatial specificity comparable to or better than that of the TCR, and that the SBP correlates better with the firing rates of lower signal-to-noise-ratio units than the TCR. With non-human primates, in an online task involving the one-dimensional decoding of the movement of finger groups and in an offline two-dimensional cursor-control task, the SBP performed equally well or better than the TCR. The SBP may enhance the decoding performance of neural interfaces while enabling substantial cuts in power consumption.

The future of upper extremity rehabilitation robotics: research and practice

The loss of upper limb motor function can have a devastating effect on people's lives. To restore upper limb control and functionality, researchers and clinicians have developed interfaces to interact directly with the human body's motor system. In this invited review, we aim to provide details on the peripheral nerve interfaces and brain-machine interfaces that have been developed in the past 30 years for upper extremity control, and we highlight the challenges that still remain to transition the technology into the clinical market. The findings show that peripheral nerve interfaces and brain-machine interfaces have many similar characteristics that enable them to be concurrently developed. Decoding neural information from both interfaces may lead to novel physiological models that may one day fully restore upper limb motor function for a growing patient population.

Intuitive neuromyoelectric control of a dexterous bionic arm using a modified Kalman filter

BACKGROUND

Multi-articulate prostheses are capable of performing dexterous hand movements. However, clinically available control strategies fail to provide users with intuitive, independent and proportional control over multiple degrees of freedom (DOFs) in real-time.

NEW METHOD

We detail the use of a modified Kalman filter (MKF) to provide intuitive, independent and proportional control over six-DOF prostheses such as the DEKA "LUKE" arm. Input features include neural firing rates recorded from Utah Slanted Electrode Arrays and mean absolute value of intramuscular electromyographic (EMG) recordings. Ad-hoc modifications include thresholds and non-unity gains on the output of a Kalman filter.

RESULTS

We demonstrate that both neural and EMG data can be combined effectively. We also highlight that modifications can be optimized to significantly improve performance relative to an unmodified Kalman filter. Thresholds significantly reduced unintended movement and promoted more independent control of the different DOFs. Gains were significantly greater than one and served to ease movement initiation. Optimal modifications can be determined quickly offline and translate to functional improvements online. Using a portable take-home system, participants performed various activities of daily living.

COMPARISON WITH EXISTING METHODS

In contrast to pattern recognition, the MKF allows users to continuously modulate their force output, which is critical for fine dexterity. The MKF is also computationally efficient and can be trained in less than five minutes.

CONCLUSIONS

The MKF can be used to explore the functional and psychological benefits associated with long-term, at-home control of dexterous prosthetic hands.

Spike Rate Estimation Using Bayesian Adaptive Kernel Smoother (BAKS) and Its Application to Brain Machine Interfaces

Brain Machine Interfaces (BMIs) mostly utilise spike rate as an input feature for decoding a desired motor output as it conveys a useful measure to the underlying neuronal activity. The spike rate is typically estimated by a using non-overlap binning method that yields a coarse estimate. There exist several methods that can produce a smooth estimate which could potentially improve the decoding performance. However, these methods are relatively computationally heavy for real-time BMIs. To address this issue, we propose a new method for estimating spike rate that is able to yield a smooth estimate and also amenable to real-time BMIs. The proposed method, referred to as Bayesian adaptive kernel smoother (BAKS), employs kernel smoothing technique that considers the bandwidth as a random variable with prior distribution which is adaptively updated through a Bayesian framework. With appropriate selection of prior distribution and kernel function, an analytical expression can be achieved for the kernel bandwidth. We apply BAKS and evaluate its impact on offline BMI decoding performance using Kalman filter. The results reveal that BAKS can improve the decoding performance compared to the binning method. This suggests the feasibility and the potential use of BAKS for real-time BMIs.

Spike detection and spike sorting with a hidden Markov model improves offline decoding of motor cortical recordings

OBJECTIVE

Detection and sorting (classification) of action potentials from extracellular recordings are two important pre-processing steps for brain-computer interfaces (BCIs) and some neuroscientific studies. Traditional approaches perform these two steps serially, but using shapes of action potential waveforms during detection, i.e. combining the two steps, may lead to better performance, especially during high noise. We propose a hidden Markov model (HMM) based method for combined detecting and sorting of spikes, with the aim of improving the final decoding accuracy of BCIs.

APPROACH

The states of the HMM indicate whether there is a spike, what unit a spike belongs to, and the time course within a waveform. The HMM outputs probabilities of spike detection, and from this we can calculate expectations of spike counts in time bins, which can replace integer spike counts as input to BCI decoders. We evaluate the HMM method on simulated spiking data. We then examine the impact of using this method on decoding real neural data recorded from primary motor cortex of two Rhesus monkeys.

MAIN RESULTS

Our comparisons on simulated data to detection-then-sorting approaches and combined detection-and-sorting algorithms indicate that the HMM method performs more accurately at detection and sorting (0.93 versus 0.73 spike count correlation, 0.73 versus 0.49 adjusted mutual information). On real neural data, the HMM method led to higher adjusted mutual information between spike counts and kinematics (monkey K: 0.034 versus 0.027; monkey M: 0.033 versus 0.022) and better neuron encoding model predictions (K: 0.016 dB improvement; M: 0.056 dB improvement). Lastly, the HMM method facilitated higher offline decoding accuracy (Kalman filter, K: 8.5% mean squared error reduction, M: 18.6% reduction).

SIGNIFICANCE

The HMM spike detection and sorting method offers a new approach to spike pre-processing for BCIs and neuroscientific studies.

Cortical Decoding of Individual Finger Group Motions Using ReFIT Kalman Filter

Objective: To date, many brain-machine interface (BMI) studies have developed decoding algorithms for neuroprostheses that provide users with precise control of upper arm reaches with some limited grasping capabilities. However, comparatively few have focused on quantifying the performance of precise finger control. Here we expand upon this work by investigating online control of individual finger groups.

Approach: We have developed a novel training manipulandum for non-human primate (NHP) studies to isolate the movements of two specific finger groups: index and middle-ring-pinkie (MRP) fingers. We use this device in combination with the ReFIT (Recalibrated Feedback Intention-Trained) Kalman filter to decode the position of each finger group during a single degree of freedom task in two rhesus macaques with Utah arrays in motor cortex. The ReFIT Kalman filter uses a two-stage training approach that improves online control of upper arm tasks with substantial reductions in orbiting time, thus making it a logical first choice for precise finger control.

Results: Both animals were able to reliably acquire fingertip targets with both index and MRP fingers, which they did in blocks of finger group specific trials. Decoding from motor signals online, the ReFIT Kalman filter reliably outperformed the standard Kalman filter, measured by bit rate, across all tested finger groups and movements by 31.0 and 35.2%. These decoders were robust when the manipulandum was removed during online control. While index finger movements and middle-ring-pinkie finger movements could be differentiated from each other with 81.7% accuracy across both subjects, the linear Kalman filter was not sufficient for decoding both finger groups together due to significant unwanted movement in the stationary finger, potentially due to co-contraction.

Significance: To our knowledge, this is the first systematic and biomimetic separation of digits for continuous online decoding in a NHP as well as the first demonstration of the ReFIT Kalman filter improving the performance of precise finger decoding. These results suggest that novel nonlinear approaches, apparently not necessary for center out reaches or gross hand motions, may be necessary to achieve independent and precise control of individual fingers.