A muscle-activity-dependent gain between motor cortex and EMG

Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface

Objective

Creating an intracortical brain-computer interface (iBCI) capable of seamless transitions between tasks and contexts would greatly enhance user experience. However, the nonlinearity in neural activity presents challenges to computing a global iBCI decoder. We aimed to develop a method that differs from a globally optimized decoder to address this issue.

Approach

We devised an unsupervised approach that relies on the structure of a low-dimensional neural manifold to implement a piecewise linear decoder. We created a distinctive dataset in which monkeys performed a diverse set of tasks, some trained, others innate, while we recorded neural signals from the motor cortex (M1) and electromyographs (EMGs) from upper limb muscles. We used both linear and nonlinear dimensionality reduction techniques to discover neural manifolds and applied unsupervised algorithms to identify clusters within those spaces. Finally, we fit a linear decoder of EMG for each cluster. A specific decoder was activated corresponding to the cluster each new neural data point belonged to.

Main results

We found clusters in the neural manifolds corresponding with the different tasks or task sub-phases. The performance of piecewise decoding improved as the number of clusters increased and plateaued gradually. With only two clusters it already outperformed a global linear decoder, and unexpectedly, it outperformed even a global recurrent neural network (RNN) decoder with 10-12 clusters.

Significance

This study introduced a computationally lightweight solution for creating iBCI decoders that can function effectively across a broad range of tasks. EMG decoding is particularly challenging, as muscle activity is used, under varying contexts, to control interaction forces and limb stiffness, as well as motion. The results suggest that a piecewise linear decoder can provide a good approximation to the nonlinearity between neural activity and motor outputs, a result of our increased understanding of the structure of neural manifolds in motor cortex.

Dissociative and prioritized modeling of behaviorally relevant neural dynamics using recurrent neural networks

Understanding the dynamical transformation of neural activity to behavior requires new capabilities to nonlinearly model, dissociate and prioritize behaviorally relevant neural dynamics and test hypotheses about the origin of nonlinearity. We present dissociative prioritized analysis of dynamics (DPAD), a nonlinear dynamical modeling approach that enables these capabilities with a multisection neural network architecture and training approach. Analyzing cortical spiking and local field potential activity across four movement tasks, we demonstrate five use-cases. DPAD enabled more accurate neural-behavioral prediction. It identified nonlinear dynamical transformations of local field potentials that were more behavior predictive than traditional power features. Further, DPAD achieved behavior-predictive nonlinear neural dimensionality reduction. It enabled hypothesis testing regarding nonlinearities in neural-behavioral transformation, revealing that, in our datasets, nonlinearities could largely be isolated to the mapping from latent cortical dynamics to behavior. Finally, DPAD extended across continuous, intermittently sampled and categorical behaviors. DPAD provides a powerful tool for nonlinear dynamical modeling and investigation of neural-behavioral data.

Revealing unexpected complex encoding but simple decoding mechanisms in motor cortex via separating behaviorally relevant neural signals

In motor cortex, behaviorally relevant neural responses are entangled with irrelevant signals, which complicates the study of encoding and decoding mechanisms. It remains unclear whether behaviorally irrelevant signals could conceal some critical truth. One solution is to accurately separate behaviorally relevant and irrelevant signals at both single-neuron and single-trial levels, but this approach remains elusive due to the unknown ground truth of behaviorally relevant signals. Therefore, we propose a framework to define, extract, and validate behaviorally relevant signals. Analyzing separated signals in three monkeys performing different reaching tasks, we found neural responses previously considered to contain little information actually encode rich behavioral information in complex nonlinear ways. These responses are critical for neuronal redundancy and reveal movement behaviors occupy a higher-dimensional neural space than previously expected. Surprisingly, when incorporating often-ignored neural dimensions, behaviorally relevant signals can be decoded linearly with comparable performance to nonlinear decoding, suggesting linear readout may be performed in motor cortex. Our findings prompt that separating behaviorally relevant signals may help uncover more hidden cortical mechanisms.

Preparatory activity and the expansive null-space

The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.

Artificial neural network for brain-machine interface consistently produces more naturalistic finger movements than linear methods

Brain-machine interfaces (BMI) aim to restore function to persons living with spinal cord injuries by 'decoding' neural signals into behavior. Recently, nonlinear BMI decoders have outperformed previous state-of-the-art linear decoders, but few studies have investigated what specific improvements these nonlinear approaches provide. In this study, we compare how temporally convolved feedforward neural networks (tcFNNs) and linear approaches predict individuated finger movements in open and closed-loop settings. We show that nonlinear decoders generate more naturalistic movements, producing distributions of velocities 85.3% closer to true hand control than linear decoders. Addressing concerns that neural networks may come to inconsistent solutions, we find that regularization techniques improve the consistency of tcFNN convergence by 194.6%, along with improving average performance, and training speed. Finally, we show that tcFNN can leverage training data from multiple task variations to improve generalization. The results of this study show that nonlinear methods produce more naturalistic movements and show potential for generalizing over less constrained tasks.

Teaser

A neural network decoder produces consistent naturalistic movements and shows potential for real-world generalization through task variations.

Unsupervised learning of stationary and switching dynamical system models from Poisson observations

Objective. Investigating neural population dynamics underlying behavior requires learning accurate models of the recorded spiking activity, which can be modeled with a Poisson observation distribution. Switching dynamical system models can offer both explanatory power and interpretability by piecing together successive regimes of simpler dynamics to capture more complex ones. However, in many cases, reliable regime labels are not available, thus demanding accurate unsupervised learning methods for Poisson observations. Existing learning methods, however, rely on inference of latent states in neural activity using the Laplace approximation, which may not capture the broader properties of densities and may lead to inaccurate learning. Thus, there is a need for new inference methods that can enable accurate model learning.Approach. To achieve accurate model learning, we derive a novel inference method based on deterministic sampling for Poisson observations called the Poisson Cubature Filter (PCF) and embed it in an unsupervised learning framework. This method takes a minimum mean squared error approach to estimation. Terms that are difficult to find analytically for Poisson observations are approximated in a novel way with deterministic sampling based on numerical integration and cubature rules.Main results. PCF enabled accurate unsupervised learning in both stationary and switching dynamical systems and largely outperformed prior Laplace approximation-based learning methods in both simulations and motor cortical spiking data recorded during a reaching task. These improvements were larger for smaller data sizes, showing that PCF-based learning was more data efficient and enabled more reliable regime identification. In experimental data and unsupervised with respect to behavior, PCF-based learning uncovered interpretable behavior-relevant regimes unlike prior learning methods.Significance. The developed unsupervised learning methods for switching dynamical systems can accurately uncover latent regimes and states in population spiking activity, with important applications in both basic neuroscience and neurotechnology.

Pseudo-linear Summation explains Neural Geometry of Multi-finger Movements in Human Premotor Cortex

How does the motor cortex combine simple movements (such as single finger flexion/extension) into complex movements (such hand gestures or playing piano)? Motor cortical activity was recorded using intracortical multi-electrode arrays in two people with tetraplegia as they attempted single, pairwise and higher order finger movements. Neural activity for simultaneous movements was largely aligned with linear summation of corresponding single finger movement activities, with two violations. First, the neural activity was normalized, preventing a large magnitude with an increasing number of moving fingers. Second, the neural tuning direction of weakly represented fingers (e.g. middle) changed significantly as a result of the movement of other fingers. These deviations from linearity resulted in non-linear methods outperforming linear methods for neural decoding. Overall, simultaneous finger movements are thus represented by the combination of individual finger movements by pseudo-linear summation.

Neural decoding reveals specialized kinematic tuning after an abrupt cortical transition

The primary motor cortex (M1) exhibits a protracted period of development, including the development of a sensory representation long before motor outflow emerges. In rats, this representation is present by postnatal day (P) 8, when M1 activity is "discontinuous." Here, we ask how the representation changes upon the transition to "continuous" activity at P12. We use neural decoding to predict forelimb movements from M1 activity and show that a linear decoder effectively predicts limb movements at P8 but not at P12; instead, a nonlinear decoder better predicts limb movements at P12. The altered decoder performance reflects increased complexity and uniqueness of kinematic information in M1. We next show that M1's representation at P12 is more susceptible to "lesioning" of inputs and "transplanting" of M1's encoding scheme from one pup to another. Thus, the emergence of continuous M1 activity signals the developmental onset of more complex, informationally sparse, and individualized sensory representations.

Using adversarial networks to extend brain computer interface decoding accuracy over time

Existing intracortical brain computer interfaces (iBCIs) transform neural activity into control signals capable of restoring movement to persons with paralysis. However, the accuracy of the 'decoder' at the heart of the iBCI typically degrades over time due to turnover of recorded neurons. To compensate, decoders can be recalibrated, but this requires the user to spend extra time and effort to provide the necessary data, then learn the new dynamics. As the recorded neurons change, one can think of the underlying movement intent signal being expressed in changing coordinates. If a mapping can be computed between the different coordinate systems, it may be possible to stabilize the original decoder's mapping from brain to behavior without recalibration. We previously proposed a method based on Generalized Adversarial Networks (GANs), called 'Adversarial Domain Adaptation Network' (ADAN), which aligns the distributions of latent signals within underlying low-dimensional neural manifolds. However, we tested ADAN on only a very limited dataset. Here we propose a method based on Cycle-Consistent Adversarial Networks (Cycle-GAN), which aligns the distributions of the full-dimensional neural recordings. We tested both Cycle-GAN and ADAN on data from multiple monkeys and behaviors and compared them to a third, quite different method based on Procrustes alignment of axes provided by Factor Analysis. All three methods are unsupervised and require little data, making them practical in real life. Overall, Cycle-GAN had the best performance and was easier to train and more robust than ADAN, making it ideal for stabilizing iBCI systems over time.

Translating deep learning to neuroprosthetic control

Advances in deep learning have given rise to neural network models of the relationship between movement and brain activity that appear to far outperform prior approaches. Brain-computer interfaces (BCIs) that enable people with paralysis to control external devices, such as robotic arms or computer cursors, might stand to benefit greatly from these advances. We tested recurrent neural networks (RNNs) on a challenging nonlinear BCI problem: decoding continuous bimanual movement of two computer cursors. Surprisingly, we found that although RNNs appeared to perform well in offline settings, they did so by overfitting to the temporal structure of the training data and failed to generalize to real-time neuroprosthetic control. In response, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously, far outperforming standard linear methods. Our results provide evidence that preventing models from overfitting to temporal structure in training data may, in principle, aid in translating deep learning advances to the BCI setting, unlocking improved performance for challenging applications.

A neural basis of choking under pressure

Incentives tend to drive improvements in performance. But when incentives get too high, we can "choke under pressure" and underperform when it matters most. What neural processes might lead to choking under pressure? We studied Rhesus monkeys performing a challenging reaching task in which they underperform when an unusually large "jackpot" reward is at stake. We observed a collapse in neural information about upcoming movements for jackpot rewards: in the motor cortex, neural planning signals became less distinguishable for different reach directions when a jackpot reward was made available. We conclude that neural signals of reward and motor planning interact in the motor cortex in a manner that can explain why we choke under pressure.

One-Sentence Summary

In response to exceptionally large reward cues, animals can "choke under pressure", and this corresponds to a collapse in the neural information about upcoming movements.

Cortical Representation of Movement Across the Developmental Transition to Continuous Neural Activity

Primary motor cortex (M1) exhibits a protracted period of development that includes the establishment of a somatosensory map long before motor outflow emerges. In rats, the sensory representation is established by postnatal day (P) 8 when cortical activity is still "discontinuous." Here, we ask how the representation survives the sudden transition to noisy "continuous" activity at P12. Using neural decoding to predict forelimb movements based solely on M1 activity, we show that a linear decoder is sufficient to predict limb movements at P8, but not at P12; in contrast, a nonlinear decoder effectively predicts limb movements at P12. The change in decoder performance at P12 reflects an increase in both the complexity and uniqueness of kinematic information available in M1. We next show that the representation at P12 is more susceptible to the deleterious effects of "lesioning" inputs and to "transplanting" M1's encoding scheme from one pup to another. We conclude that the emergence of continuous cortical activity signals the developmental onset in M1 of more complex, informationally sparse, and individualized sensory representations.

A trade-off between kinematic and dynamic control of bimanual reaching in virtual reality

Bimanual coordination is an essential component of human movement. Cooperative bimanual reaching tasks are widely used to assess the optimal control of goal-directed reaching. However, little is known about the neuromuscular mechanisms governing these tasks. Twelve healthy, right-handed participants performed a bimanual reaching task in a three-dimensional virtual reality environment. They controlled a shared cursor, located at the midpoint between the hands, and reached targets located at 80% of full arm extension. Following a baseline of normal reaches, we placed a wrist weight on one arm and measured the change in coordination. Relative contribution (RC) was computed as the displacement of the right hand divided by the sum of displacements of both hands. We used surface electromyography placed over the anterior deltoid and biceps brachii to compute muscle contribution (MC) from root mean squared muscle activity data. We found RC was no different than 50% during baseline, indicating participants reached equal displacements when no weights were applied. Participants systematically altered limb coordination in response to altered limb dynamics. RC increased by 0.91% and MC decreased by 5.3% relative to baseline when the weight was applied to the left arm; RC decreased by 0.94% and MC increased by 6.3% when the weight was applied to the right arm. Participants adopted an optimal control strategy that attempted to minimize both kinematic and muscular asymmetries between limbs. What emerged was a trade-off between these two parameters, and we propose this trade-off as a potential neuromuscular mechanism of cooperative bimanual reaching.NEW & NOTEWORTHY This study is the first to propose a trade-off between kinematic and dynamic control parameters governing goal-directed reaching. We propose a straightforward tool to assess this trade-off without the need for computational modeling. The technologies and techniques developed in this study are discussed in the context of upper extremity rehabilitation.

Real-time linear prediction of simultaneous and independent movements of two finger groups using an intracortical brain-machine interface

Modern brain-machine interfaces can return function to people with paralysis, but current upper extremity brain-machine interfaces are unable to reproduce control of individuated finger movements. Here, for the first time, we present a real-time, high-speed, linear brain-machine interface in nonhuman primates that utilizes intracortical neural signals to bridge this gap. We created a non-prehensile task that systematically individuates two finger groups, the index finger and the middle-ring-small fingers combined. During online brain control, the ReFIT Kalman filter could predict individuated finger group movements with high performance. Next, training ridge regression decoders with individual movements was sufficient to predict untrained combined movements and vice versa. Finally, we compared the postural and movement tuning of finger-related cortical activity to find that individual cortical units simultaneously encode multiple behavioral dimensions. Our results suggest that linear decoders may be sufficient for brain-machine interfaces to execute high-dimensional tasks with the performance levels required for naturalistic neural prostheses.

Selection of Essential Neural Activity Timesteps for Intracortical Brain-Computer Interface Based on Recurrent Neural Network

Intracortical brain–computer interfaces (iBCIs) translate neural activity into control commands, thereby allowing paralyzed persons to control devices via their brain signals. Recurrent neural networks (RNNs) are widely used as neural decoders because they can learn neural response dynamics from continuous neural activity. Nevertheless, excessively long or short input neural activity for an RNN may decrease its decoding performance. Based on the temporal attention module exploiting relations in features over time, we propose a temporal attention-aware timestep selection (TTS) method that improves the interpretability of the salience of each timestep in an input neural activity. Furthermore, TTS determines the appropriate input neural activity length for accurate neural decoding. Experimental results show that the proposed TTS efficiently selects 28 essential timesteps for RNN-based neural decoders, outperforming state-of-the-art neural decoders on two nonhuman primate datasets (R2=0.76±0.05 for monkey Indy and CC=0.91±0.01 for monkey N). In addition, it reduces the computation time for offline training (reducing 5–12%) and online prediction (reducing 16–18%). When visualizing the attention mechanism in TTS, the preparatory neural activity is consecutively highlighted during arm movement, and the most recent neural activity is highlighted during the resting state in nonhuman primates. Selecting only a few essential timesteps for an RNN-based neural decoder provides sufficient decoding performance and requires only a short computation time.

Deep learning multimodal fNIRS and EEG signals for bimanual grip force decoding

Objective.Non-invasive brain-machine interfaces (BMIs) offer an alternative, safe and accessible way to interact with the environment. To enable meaningful and stable physical interactions, BMIs need to decode forces. Although previously addressed in the unimanual case, controlling forces from both hands would enable BMI-users to perform a greater range of interactions. We here investigate the decoding of hand-specific forces.Approach.We maximise cortical information by using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) and developing a deep-learning architecture with attention and residual layers (cnnatt) to improve their fusion. Our task required participants to generate hand-specific force profiles on which we trained and tested our deep-learning and linear decoders.Main results.The use of EEG and fNIRS improved the decoding of bimanual force and the deep-learning models outperformed the linear model. In both cases, the greatest gain in performance was due to the detection of force generation. In particular, the detection of forces was hand-specific and better for the right dominant hand andcnnattwas better at fusing EEG and fNIRS. Consequently, the study ofcnnattrevealed that forces from each hand were differently encoded at the cortical level.Cnnattalso revealed traces of the cortical activity being modulated by the level of force which was not previously found using linear models.Significance.Our results can be applied to avoid hand-cross talk during hand force decoding to improve the robustness of BMI robotic devices. In particular, we improve the fusion of EEG and fNIRS signals and offer hand-specific interpretability of the encoded forces which are valuable during motor rehabilitation assessment.

Restoring upper extremity function with brain-machine interfaces

One of the most exciting advances to emerge in neural interface technologies has been the development of real-time brain-machine interface (BMI) neuroprosthetic devices to restore upper extremity function. BMI neuroprostheses, made possible by synergistic advances in neural recording technologies, high-speed computation and signal processing, and neuroscience, have permitted the restoration of volitional movement to patients suffering the loss of upper-extremity function. In this chapter, we review the scientific and technological advances underlying these remarkable devices. After presenting an introduction to the current state of the field, we provide an accessible technical discussion of the two fundamental requirements of a successful neuroprosthesis: signal extraction from the brain and signal decoding that results in robust prosthetic control. We close with a presentation of emerging technologies that are likely to substantially advance the field.

Estimates of persistent inward currents increase with the level of voluntary drive in low-threshold motor units of plantar flexor muscles

This study tested whether estimates of persistent inward currents (PICs) in the human plantar flexors would increase with the level of voluntary drive. High-density surface electromyograms were collected from soleus and gastrocnemius medialis of 21 participants (29.2 ± 2.6 yr) during ramp-shaped isometric contractions to 10%, 20%, and 30% (torque rise and decline of 2%/s and 30-s duration) of each participant's maximal torque. Motor units identified in all the contraction intensities were included in the paired-motor unit analysis to calculate delta frequency (ΔF) and estimate the PICs. ΔF is the difference in discharge rate of the control unit at the time of recruitment and derecruitment of the test unit. Increases in PICs were observed from 10% to 20% [Δ = 0.6 pulse per second (pps); P < 0.001] and from 20% to 30% (Δ = 0.5 pps; P < 0.001) in soleus and from 10% to 20% (Δ = 1.2 pps; P < 0.001) but not from 20% to 30% (Δ = 0.09 pps; P = 0.724) in gastrocnemius medialis. Maximal discharge rate increased for soleus and gastrocnemius medialis from 10% to 20% [Δ = 1.75 pps (P < 0.001) and Δ = 2.43 pps (P < 0.001), respectively] and from 20% to 30% [Δ = 0.80 pps (P < 0.017) and Δ = 0.92 pps (P = 0.002), respectively]. The repeated-measures correlation identified associations between ΔF and increases in maximal discharge rate for soleus (r = 0.64; P < 0.001) and gastrocnemius medialis (r = 0.77; P < 0.001). An increase in voluntary drive tends to increase PIC strength, which has key implications for the control of force but also for comparisons between muscles or studies when relative force levels might be different. Increases in voluntary descending drive amplify PICs in humans and provide an important spinal mechanism for motor unit discharging, and thus force output modulation.NEW & NOTEWORTHY Animal experiments and computational models have shown that motor neurons can amplify the synaptic input they receive via persistent inward currents. Here we show in humans that this amplification varies proportionally to the magnitude of the voluntary drive to the muscle.

Neural Correlates of Knee Extension and Flexion Force Control: A Kinetically-Instrumented Neuroimaging Study

Background: The regulation of muscle force is a vital aspect of sensorimotor control, requiring intricate neural processes. While neural activity associated with upper extremity force control has been documented, extrapolation to lower extremity force control is limited. Knowledge of how the brain regulates force control for knee extension and flexion may provide insights as to how pathology or intervention impacts central control of movement.

Objectives: To develop and implement a neuroimaging-compatible force control paradigm for knee extension and flexion.

Methods: A magnetic resonance imaging (MRI) safe load cell was used in a customized apparatus to quantify force (N) during neuroimaging (Philips Achieva 3T). Visual biofeedback and a target sinusoidal wave that fluctuated between 0 and 5 N was provided via an MRI-safe virtual reality display. Fifteen right leg dominant female participants (age = 20.3 ± 1.2 years, height = 1.6 ± 0.10 m, weight = 64.8 ± 6.4 kg) completed a knee extension and flexion force matching paradigm during neuroimaging. The force-matching error was calculated based on the difference between the visual target and actual performance. Brain activation patterns were calculated and associated with force-matching error and the difference between quadriceps and hamstring force-matching tasks were evaluated with a mixed-effects model (z > 3.1, p < 0.05, cluster corrected).

Results: Knee extension and flexion force-matching tasks increased BOLD signal among cerebellar, sensorimotor, and visual-processing regions. Increased knee extension force-matching error was associated with greater right frontal cortex and left parietal cortex activity and reduced left lingual gyrus activity. Increased knee flexion force-matching error was associated with reduced left frontal and right parietal region activity. Knee flexion force control increased bilateral premotor, secondary somatosensory, and right anterior temporal activity relative to knee extension. The force-matching error was not statistically different between tasks.

Conclusion: Lower extremity force control results in unique activation strategies depending on if engaging knee extension or flexion, with knee flexion requiring increased neural activity (BOLD signal) for the same level of force and no difference in relative error. These fMRI compatible force control paradigms allow precise behavioral quantification of motor performance concurrent with brain activity for lower extremity sensorimotor function and may serve as a method for future research to investigate how pathologies affect lower extremity neuromuscular function.

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain-computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. We describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

Shared internal models for feedforward and feedback control of arm dynamics in non-human primates

Previous work has shown that humans account for and learn novel properties or the arm's dynamics, and that such learning causes changes in both the predictive (i.e., feedforward) control of reaching and reflex (i.e., feedback) responses to mechanical perturbations. Here we show that similar observations hold in old-world monkeys (Macaca fascicularis). Two monkeys were trained to use an exoskeleton to perform a single-joint elbow reaching and to respond to mechanical perturbations that created pure elbow motion. Both of these tasks engaged robust shoulder muscle activity as required to account for the torques that typically arise at the shoulder when the forearm rotates around the elbow joint (i.e., intersegmental dynamics). We altered these intersegmental arm dynamics by having the monkeys generate the same elbow movements with the shoulder joint either free to rotate, as normal, or fixed by the robotic manipulandum, which eliminates the shoulder torques caused by forearm rotation. After fixing the shoulder joint, we found a systematic reduction in shoulder muscle activity. In addition, after releasing the shoulder joint again, we found evidence of kinematic aftereffects (i.e., reach errors) in the direction predicted if failing to compensate for normal arm dynamics. We also tested whether such learning transfers to feedback responses evoked by mechanical perturbations and found a reduction in shoulder feedback responses, as appropriate for these altered arm intersegmental dynamics. Demonstrating this learning and transfer in non-human primates will allow the investigation of the neural mechanisms involved in feedforward and feedback control of the arm's dynamics.

Machine Learning for Neural Decoding

Despite rapid advances in machine learning tools, the majority of neural decoding approaches still use traditional methods. Modern machine learning tools, which are versatile and easy to use, have the potential to significantly improve decoding performance. This tutorial describes how to effectively apply these algorithms for typical decoding problems. We provide descriptions, best practices, and code for applying common machine learning methods, including neural networks and gradient boosting. We also provide detailed comparisons of the performance of various methods at the task of decoding spiking activity in motor cortex, somatosensory cortex, and hippocampus. Modern methods, particularly neural networks and ensembles, significantly outperform traditional approaches, such as Wiener and Kalman filters. Improving the performance of neural decoding algorithms allows neuroscientists to better understand the information contained in a neural population and can help to advance engineering applications such as brain–machine interfaces. Our code package is available at github.com/kordinglab/neural_decoding.

Cerebral hemodynamics predicts the cortical area and coding scheme in the human brain for force generation by wrist muscles

The goal of this study is to identify the cortical area maximally active over the primary sensorimotor cortex (SM1) and characterize the cortical encoding for force production by wrist muscles in the human brain. The technique of functional near-infrared spectroscopy (fNIRS) was used to continuously monitor the changes in hemoglobin concentrations from the left hemisphere during isometric contractions of wrist flexion muscles over a broad range of load forces (0 ∼ 8 kgf) on the right hand. As previously shown in primate studies, this action produced hemodynamic activity predominantly in the wrist area localized dorsally to the finger region over SM1 and the hemodynamic response was systematically related to the level of load intensity. The coding scheme for force production in terms of hemodynamic signals was characterized defining eight trajectory parameters (four for amplitude coding and four for temporal coding) and analyzed for the area maximally activated over SM1. The trajectory parameter representing the oxygenated hemoglobin concentration change at the end of motor task (amplitude coding) and the timing of maximum change in oxygenated hemoglobin concentration (temporal coding) was most strongly correlated with the load variation in a superliner manner. All these results indicate the applicability of fNIRS to monitor and decode cortical activity that is correlated with low-level motor control such as isometric muscle contractions. This study may provide not only insights into cortical neural control of muscle force but also predictors of muscle force in clinical diagnostics and neural interfaces for the human brain.

Nonlinear Input-Output Functions of Motoneurons

All movements are generated by the activation of motoneurons, and hence their input-output properties define the final step in processing of all motor commands. A major challenge to understanding this transformation has been the striking nonlinear behavior of motoneurons conferred by the activation of persistent inward currents (PICs) mediated by their voltage-gated Na+ and Ca2+ channels. In this review, we focus on the contribution that these PICs make to motoneuronal discharge and how the nonlinearities they engender impede the construction of a comprehensive model of motor control.

Intuitive neuromyoelectric control of a dexterous bionic arm using a modified Kalman filter

BACKGROUND

Multi-articulate prostheses are capable of performing dexterous hand movements. However, clinically available control strategies fail to provide users with intuitive, independent and proportional control over multiple degrees of freedom (DOFs) in real-time.

NEW METHOD

We detail the use of a modified Kalman filter (MKF) to provide intuitive, independent and proportional control over six-DOF prostheses such as the DEKA "LUKE" arm. Input features include neural firing rates recorded from Utah Slanted Electrode Arrays and mean absolute value of intramuscular electromyographic (EMG) recordings. Ad-hoc modifications include thresholds and non-unity gains on the output of a Kalman filter.

RESULTS

We demonstrate that both neural and EMG data can be combined effectively. We also highlight that modifications can be optimized to significantly improve performance relative to an unmodified Kalman filter. Thresholds significantly reduced unintended movement and promoted more independent control of the different DOFs. Gains were significantly greater than one and served to ease movement initiation. Optimal modifications can be determined quickly offline and translate to functional improvements online. Using a portable take-home system, participants performed various activities of daily living.

COMPARISON WITH EXISTING METHODS

In contrast to pattern recognition, the MKF allows users to continuously modulate their force output, which is critical for fine dexterity. The MKF is also computationally efficient and can be trained in less than five minutes.

CONCLUSIONS

The MKF can be used to explore the functional and psychological benefits associated with long-term, at-home control of dexterous prosthetic hands.