Modulation depth estimation and variable selection in state-space models for neural interfaces

Replay of Learned Neural Firing Sequences during Rest in Human Motor Cortex

The offline “replay” of neural firing patterns underlying waking experience, previously observed in non-human animals, is thought to be a mechanism for memory consolidation. Here, we test for replay in the human brain by recording spiking activity from the motor cortex of two participants who had intracortical microelectrode arrays placed chronically as part of a brain-computer interface pilot clinical trial. Participants took a nap before and after playing a neurally controlled sequence-copying game that consists of many repetitions of one “repeated” sequence sparsely interleaved with varying “control” sequences. Both participants performed repeated sequences more accurately than control sequences, consistent with learning. We compare the firing rate patterns that caused the cursor movements when performing each sequence to firing rate patterns throughout both rest periods. Correlations with repeated sequences increase more from pre- to post-task rest than do correlations with control sequences, providing direct evidence of learning-related replay in the human brain.

Eichenlaub et al. show that in the motor cortex of brain-computer interface trial participants, the firing rate patterns corresponding to a previously learned motor sequence are replayed during rest. These findings provide direct evidence of memory replay in the human brain.

Auditory cues reveal intended movement information in middle frontal gyrus neuronal ensemble activity of a person with tetraplegia

Intracortical brain-computer interfaces (iBCIs) allow people with paralysis to directly control assistive devices using neural activity associated with the intent to move. Realizing the full potential of iBCIs critically depends on continued progress in understanding how different cortical areas contribute to movement control. Here we present the first comparison between neuronal ensemble recordings from the left middle frontal gyrus (MFG) and precentral gyrus (PCG) of a person with tetraplegia using an iBCI. As expected, PCG was more engaged in selecting and generating intended movements than in earlier perceptual stages of action planning. By contrast, MFG displayed movement-related information during the sensorimotor processing steps preceding the appearance of the action plan in PCG, but only when the actions were instructed using auditory cues. These results describe a previously unreported function for neurons in the human left MFG in auditory processing contributing to motor control.

Mixed Selectivity in Macaque Medial Parietal Cortex during Eye-Hand Reaching

The activity of neurons of the medial posterior parietal area V6A in macaque monkeys is modulated by many aspects of reach task. In the past, research was mostly focused on modulating the effect of single parameters upon the activity of V6A cells. Here, we used Generalized Linear Models (GLMs) to simultaneously test the contribution of several factors upon V6A cells during a fix-to-reach task. This approach resulted in the definition of a representative “functional fingerprint” for each neuron. We first studied how the features are distributed in the population. Our analysis highlighted the virtual absence of units strictly selective for only one factor and revealed that most cells are characterized by “mixed selectivity.” Then, exploiting our GLM framework, we investigated the dynamics of spatial parameters encoded within V6A. We found that the tuning is not static, but changed along the trial, indicating the sequential occurrence of visuospatial transformations helpful to guide arm movement.

•

The parietal cortex integrates a variety of sensorimotor inputs to guide reaching

•

GLM disentangled the effect of various reaching parameters upon cell activity

•

V6A neurons were not functionally clustered, but characterized by mixed selectivity

•

Spatial selectivity was dynamic and reached its peak during the movement phase

The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models

The Kalman filter provides a simple and efficient algorithm to compute the posterior distribution for state-space models where both the latent state and measurement models are linear and gaussian. Extensions to the Kalman filter, including the extended and unscented Kalman filters, incorporate linearizations for models where the observation model p ( observation | state ) is nonlinear. We argue that in many cases, a model for p ( state | observation ) proves both easier to learn and more accurate for latent state estimation. Approximating p ( state | observation ) as gaussian leads to a new filtering algorithm, the discriminative Kalman filter (DKF), which can perform well even when p ( observation | state ) is highly nonlinear and/or nongaussian. The approximation, motivated by the Bernstein-von Mises theorem, improves as the dimensionality of the observations increases. The DKF has computational complexity similar to the Kalman filter, allowing it in some cases to perform much faster than particle filters with similar precision, while better accounting for nonlinear and nongaussian observation models than Kalman-based extensions. When the observation model must be learned from training data prior to filtering, off-the-shelf nonlinear and nonparametric regression techniques can provide a gaussian model for p ( observation | state ) that cleanly integrates with the DKF. As part of the BrainGate2 clinical trial, we successfully implemented gaussian process regression with the DKF framework in a brain-computer interface to provide real-time, closed-loop cursor control to a person with a complete spinal cord injury. In this letter, we explore the theory underlying the DKF, exhibit some illustrative examples, and outline potential extensions.

Rapid calibration of an intracortical brain-computer interface for people with tetraplegia

OBJECTIVE

Brain-computer interfaces (BCIs) can enable individuals with tetraplegia to communicate and control external devices. Though much progress has been made in improving the speed and robustness of neural control provided by intracortical BCIs, little research has been devoted to minimizing the amount of time spent on decoder calibration.

APPROACH

We investigated the amount of time users needed to calibrate decoders and achieve performance saturation using two markedly different decoding algorithms: the steady-state Kalman filter, and a novel technique using Gaussian process regression (GP-DKF).

MAIN RESULTS

Three people with tetraplegia gained rapid closed-loop neural cursor control and peak, plateaued decoder performance within 3 min of initializing calibration. We also show that a BCI-naïve user (T5) was able to rapidly attain closed-loop neural cursor control with the GP-DKF using self-selected movement imagery on his first-ever day of closed-loop BCI use, acquiring a target 37 s after initiating calibration.

SIGNIFICANCE

These results demonstrate the potential for an intracortical BCI to be used immediately after deployment by people with paralysis, without the need for user learning or extensive system calibration.

Robust Closed-Loop Control of a Cursor in a Person with Tetraplegia using Gaussian Process Regression

Intracortical brain computer interfaces can enable individuals with paralysis to control external devices through voluntarily modulated brain activity. Decoding quality has been previously shown to degrade with signal nonstationarities-specifically, the changes in the statistics of the data between training and testing data sets. This includes changes to the neural tuning profiles and baseline shifts in firing rates of recorded neurons, as well as nonphysiological noise. While progress has been made toward providing long-term user control via decoder recalibration, relatively little work has been dedicated to making the decoding algorithm more resilient to signal nonstationarities. Here, we describe how principled kernel selection with gaussian process regression can be used within a Bayesian filtering framework to mitigate the effects of commonly encountered nonstationarities. Given a supervised training set of (neural features, intention to move in a direction)-pairs, we use gaussian process regression to predict the intention given the neural data. We apply kernel embedding for each neural feature with the standard radial basis function. The multiple kernels are then summed together across each neural dimension, which allows the kernel to effectively ignore large differences that occur only in a single feature. The summed kernel is used for real-time predictions of the posterior mean and variance under a gaussian process framework. The predictions are then filtered using the discriminative Kalman filter to produce an estimate of the neural intention given the history of neural data. We refer to the multiple kernel approach combined with the discriminative Kalman filter as the MK-DKF. We found that the MK-DKF decoder was more resilient to nonstationarities frequently encountered in-real world settings yet provided similar performance to the currently used Kalman decoder. These results demonstrate a method by which neural decoding can be made more resistant to nonstationarities.

Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain-computer interfaces

Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of acursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users' intended movement directions based on their subsequent selections. Here, we extend these methods to allow the click decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to "click" during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as "non-click" those periods that the kinematic decoder's retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of "retrospectively labeled" decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.

Comparing offline decoding performance in physiologically defined neuronal classes

Objective

Recently, several studies have documented the presence of a bimodal distribution of spike waveform widths in primary motor cortex. Although narrow and wide spiking neurons, corresponding to the two modes of the distribution, exhibit different response properties, it remains unknown if these differences give rise to differential decoding performance between these two classes of cells.

Approach

We used a Gaussian mixture model to classify neurons into narrow and wide physiological classes. Using similar-size, random samples of neurons from these two physiological classes, we trained offline decoding models to predict a variety of movement features. We compared offline decoding performance between these two physiologically defined populations of cells.

Main results

We found that narrow spiking neural ensembles decode motor parameters better than wide spiking neural ensembles including kinematics, kinetics, and muscle activity.

Significance

These findings suggest that the utility of neural ensembles in brain machine interfaces may be predicted from their spike waveform widths.

Motor imagery reinforces brain compensation of reach-to-grasp movement after cervical spinal cord injury

Individuals with cervical spinal cord injury (SCI) that causes tetraplegia are challenged with dramatic sensorimotor deficits. However, certain rehabilitation techniques may significantly enhance their autonomy by restoring reach-to-grasp movements. Among others, evidence of motor imagery (MI) benefits for neurological rehabilitation of upper limb movements is growing. This literature review addresses MI effectiveness during reach-to-grasp rehabilitation after tetraplegia. Among articles from MEDLINE published between 1966 and 2015, we selected ten studies including 34 participants with C4 to C7 tetraplegia and 22 healthy controls published during the last 15 years. We found that MI of possible non-paralyzed movements improved reach-to-grasp performance by: (i) increasing both tenodesis grasp capabilities and muscle strength; (ii) decreasing movement time (MT), and trajectory variability; and (iii) reducing the abnormally increased brain activity. MI can also strengthen motor commands by potentiating recruitment and synchronization of motoneurons, which leads to improved recovery. These improvements reflect brain adaptations induced by MI. Furthermore, MI can be used to control brain-computer interfaces (BCI) that successfully restore grasp capabilities. These results highlight the growing interest for MI and its potential to recover functional grasping in individuals with tetraplegia, and motivate the need for further studies to substantiate it.