Decoding the rat forelimb movement direction from epidural and intracortical field potentials

Predicting lever press in a vibrotactile yes/no detection task from S1 cortex of freely behaving rats by µECoG arrays

AIM OF THE STUDY

Brain-computer interfaces (BCIs) may help patients with severe neurological deficits communicate with the external world. Based on microelectrocorticography (µECoG) data recorded from the primary somatosensory cortex (S1) of unrestrained behaving rats, this study attempts to decode lever presses in a psychophysical detection task by using machine learning algorithms.

MATERIALS AND METHODS

16-channel Pt-Ir microelectrode arrays were implanted on the S1 of two rats, and µECoG was recorded during a vibrotactile yes/no detection task. For this task, the rats were trained to press the right lever when they detected the vibrotactile stimulus and the left lever when they did not. The multichannel µECoG data was analysed offline by time-frequency methods and its features were used for binary classification of the lever press at each trial. Several machine learning algorithms were tested as such.

RESULTS

The psychophysical sensitivities (A') were similar and low for both rats (0.58). Rat 2 (B'': -0.11) had higher bias for the right lever than Rat 1 (B'': - 0.01). The lever presses could be predicted with accuracies over 66% with all the tested algorithms, and the highest average accuracy (78%) was with the support vector machine.

CONCLUSION

According to the recent studies, sensory feedback increases the benefit of the BCIs. The current proof-of-concept study shows that lever presses can be decoded from the S1; therefore, this area may be utilised for a bidirectional BCI in the future.

Electrospinography for non-invasively recording spinal sensorimotor networks in humans

Objective. Currently, few non-invasive measures exist for directly measuring spinal sensorimotor networks. Electrospinography (ESG) is one non-invasive method but is primarily used to measure evoked responses or for monitoring the spinal cord during surgery. Our objectives were to evaluate the feasibility of ESG to measure spinal sensorimotor networks by determining spatiotemporal and functional connectivity changes during single-joint movements at the spinal and cortical levels.Approach. We synchronously recorded electroencephalography (EEG), electromyography, and ESG in ten neurologically intact adults while performing one of three lower-limb tasks (no movement, plantar-flexion and knee flexion) in the prone position. A multi-pronged approach was applied for removing artifacts usingH∞filtering, artifact subspace reconstruction and independent component (IC) analysis. Next, data were segmented by task and ICs of EEG were clustered across participants. Within-participant analysis of ICs and ESG data was conducted, and ESG was characterized in the time and frequency domains. Generalized partial directed coherence analysis was performed within ICs and between ICs and ESG data by participant and task.Results.K-means clustering resulted in five clusters of ICs at Brodmann areas (BAs) 9, BA 8, BA 39, BA 4, and BA 22. Areas associated with motor planning, working memory, visual processing, movement, and attention, respectively. Time-frequency analysis of ESG data found localized changes during movement execution when compared to no movement. Lastly, we found bi-directional changes in functional connectivity (p < 0.05, adjusted for multiple comparisons) within IC's and between IC's and ESG sensors during movement when compared to the no movement condition.Significance. To our knowledge this is the first report using high density ESG for characterizing single joint lower limb movements. Our findings provide support that ESG contains information about efferent and afferent signaling in neurologically intact adults and suggests that we can utilize ESG to directly study the spinal cord.

In Vivo Penetrating Microelectrodes for Brain Electrophysiology

In recent decades, microelectrodes have been widely used in neuroscience to understand the mechanisms behind brain functions, as well as the relationship between neural activity and behavior, perception and cognition. However, the recording of neuronal activity over a long period of time is limited for various reasons. In this review, we briefly consider the types of penetrating chronic microelectrodes, as well as the conductive and insulating materials for microelectrode manufacturing. Additionally, we consider the effects of penetrating microelectrode implantation on brain tissue. In conclusion, we review recent advances in the field of in vivo microelectrodes.

Decoding locomotion speed and slope from local field potentials of rat motor cortex

BACKGROUND AND OBJECTIVE

Local Field Potentials (LFPs) recorded from the primary motor cortex (M1) have been shown to be very informative for decoding movement parameters, and these signals can be used to decode forelimb kinematic and kinetic parameters accurately. Although locomotion is one of the most basic and important motor abilities of humans and animals, the potential of LFPs in decoding abstract hindlimb locomotor parameters has not been investigated. This study investigates the feasibility of decoding speed and slope of locomotion, as two important abstract parameters of walking, using the LFP signals.

METHODS

Rats were trained to walk smoothly on a treadmill with different speeds and slopes. The brain signals were recorded using the microwire arrays chronically implanted in the hindlimb area of M1 while rats walked on the treadmill. LFP channels were spatially filtered using optimal common spatial patterns to increase the discriminability of speeds and slopes of locomotion. Logarithmic wavelet band powers were extracted as basic features, and the best features were selected using the statistical dependency criterion before classification.

RESULTS

Using 5 s LFP trials, the average classification accuracies of four different speeds and seven different slopes reached 90.8% and 86.82%, respectively. The high-frequency LFP band (250-500 Hz) was the most informative band about these parameters and contributed more than other frequency bands in the final decoder model.

CONCLUSIONS

Our results show that the LFP signals in M1 accurately decode locomotion speed and slope, which can be considered as abstract walking parameters needed for designing long-term brain-computer interfaces for hindlimb locomotion control.

Chronic recordings from the marmoset motor cortex reveals modulation of neural firing and local field potentials overlap with macaques

Objective.The common marmoset has been increasingly used in neural interfacing studies due to its smaller size, easier handling, and faster breeding compared to Old World non-human primate (NHP) species. While assessment of cortical anatomy in marmosets has shown strikingly similar layout to macaques, comprehensive assessment of electrophysiological properties underlying forelimb reaching movements in this bridge species does not exist. The objective of this study is to characterize electrophysiological properties of signals recorded from the marmoset primary motor cortex (M1) during a reach task and compare with larger NHP models such that this smaller NHP model can be used in behavioral neural interfacing studies.Approach and main results.Neuronal firing rates and local field potentials (LFPs) were chronically recorded from M1 in three adult, male marmosets. Firing rates, mu + beta and high gamma frequency bands of LFPs were evaluated for modulation with respect to movement. Firing rate and regularity of neurons of the marmoset M1 were similar to that reported in macaques with a subset of neurons showing selectivity to movement direction. Movement phases (rest vs move) was classified from both neural spiking and LFPs. Microelectrode arrays provide the ability to sample small regions of the motor cortex to drive brain-machine interfaces (BMIs). The results demonstrate that marmosets are a robust bridge species for behavioral neuroscience studies with motor cortical electrophysiological signals recorded from microelectrode arrays that are similar to Old World NHPs.Significance. As marmosets represent an interesting step between rodent and macaque models, successful demonstration that neuron modulation in marmoset motor cortex is analogous to reports in macaques illustrates the utility of marmosets as a viable species for BMI studies.

Brain-Computer-Spinal Interface Restores Upper Limb Function After Spinal Cord Injury

Brain-computer interfaces (BCIs) are an emerging strategy for spinal cord injury (SCI) intervention that may be used to reanimate paralyzed limbs. This approach requires decoding movement intention from the brain to control movement-evoking stimulation. Common decoding methods use spike-sorting and require frequent calibration and high computational complexity. Furthermore, most applications of closed-loop stimulation act on peripheral nerves or muscles, resulting in rapid muscle fatigue. Here we show that a local field potential-based BCI can control spinal stimulation and improve forelimb function in rats with cervical SCI. We decoded forelimb movement via multi-channel local field potentials in the sensorimotor cortex using a canonical correlation analysis algorithm. We then used this decoded signal to trigger epidural spinal stimulation and restore forelimb movement. Finally, we implemented this closed-loop algorithm in a miniaturized onboard computing platform. This Brain-Computer-Spinal Interface (BCSI) utilized recording and stimulation approaches already used in separate human applications. Our goal was to demonstrate a potential neuroprosthetic intervention to improve function after upper extremity paralysis.

Monkey V1 epidural field potentials provide detailed information about stimulus location, size, shape, and color

Brain signal recordings with epidural microarrays constitute a low-invasive approach for recording distributed neuronal signals. Epidural field potentials (EFPs) may serve as a safe and highly beneficial signal source for a variety of research questions arising from both basic and applied neuroscience. A wider use of these signals, however, is constrained by a lack of data on their specific information content. Here, we make use of the high spatial resolution and the columnar organization of macaque primary visual cortex (V1) to investigate whether and to what extent EFP signals preserve information about various visual stimulus features. Two monkeys were presented with different feature combinations of location, size, shape, and color, yielding a total of 375 stimulus conditions. Visual features were chosen to access different spatial levels of functional organization. We found that, besides being highly specific for locational information, EFPs were significantly modulated by small differences in size, shape, and color, allowing for high stimulus classification rates even at the single-trial level. The results support the notion that EFPs constitute a low-invasive, highly beneficial signal source for longer-term recordings for medical and basic research by showing that they convey detailed and reliable information about constituent features of activating stimuli.

Force Decoding of Caudal Forelimb Area and Rostral Forelimb Area in Chronic Stroke Rats

Brain machine interfaces (BMIs) used for movement restoration primarily rely on studies of motor decoding. It has been proved that local field potentials (LFPs) from primary motor cortex and premotor cortex of normal rodents could be used for decoding motor signals. However, few studies have explored the decoding performance of these brain areas under motor cortex damage. In this work, we focus on force decoding performance of LFPs spectrum from both ipsilesional caudal forelimb area (CFA) and rostral forelimb area (RFA) of rodents with ischemia over CFA. After three months of ischemia induced by photothrombosis over CFA, the power of high-frequency bands (>120 Hz) from both CFA and RFA can decode force signals by Kalman filters. The fair performance of CFA indicates motor reorganization over penumbra. Further exploration of RFA decoding ability proves that at least four electrodes of RFA should be used on decoding and electrodes far from CFA of stroke rats could achieve almost as good results as those close to CFA of normal rats, which indicates the motor remapping. Experimental results show the long-term stability of PM LFPs decoding performance of stroke rats as the trained Kalman model could be used to accurately decode force some days later which provides a possibility for online decoding system. In conclusion, our work shows that even under CFA ischemia, high-frequency power of LFPs from RFA is still able to accurately decode force signals and has long stability, which provides the possibility of BMIs for motor function reconstruction of chronic stroke patients.

Markerless Rat Behavior Quantification With Cascade Neural Network

Quantifying rat behavior through video surveillance is crucial for medicine, neuroscience, and other fields. In this paper, we focus on the challenging problem of estimating landmark points, such as the rat's eyes and joints, only with image processing and quantify the motion behavior of the rat. Firstly, we placed the rat on a special running machine and used a high frame rate camera to capture its motion. Secondly, we designed the cascade convolution network (CCN) and cascade hourglass network (CHN), which are two structures to extract features of the images. Three coordinate calculation methods—fully connected regression (FCR), heatmap maximum position (HMP), and heatmap integral regression (HIR)—were used to locate the coordinates of the landmark points. Thirdly, through a strict normalized evaluation criterion, we analyzed the accuracy of the different structures and coordinate calculation methods for rat landmark point estimation in various feature map sizes. The results demonstrated that the CCN structure with the HIR method achieved the highest estimation accuracy of 75%, which is sufficient to accurately track and quantify rat joint motion.

Force decoding using local field potentials in primary motor cortex: PLS or Kalman filter regression?

The development of brain-computer interface (BCI) systems is an important approach in brain studies. Control of communication devices and prostheses in real-world scenarios requires complex movement parameters. Decoding a variety of neural signals captured by micro-wire arrays is a potential applicant for extracting movement-related information. The present work was conducted to compare the functionality of partial least square (PLS) regression and Kalman filter to predict the force parameter from local field potential (LFP) signals of the primary motor cortex (M1). The signals were recorded using a 16-channel micro-wire array from the forelimb-related area of the M1 of three rats performing a behavioral task in which the force signal of the rat's forelimb paw was generated. Our results show that PLS regression and Kalman filters with the mean performance of 0.75 and 0.72 in terms of the correlation coefficient (CC) and 0.37 and 0.48 in terms of normalized mean square error (NMSE), respectively, are effective methods for decoding the force parameter from LFPs. Kalman filter underperforms PLS both in performance and speed. Although adding nonlinearity to the Kalman filter results in equally accurate CC performance as PLS, it has even more computational cost. Therefore, it is inferred that nonlinear methods do not necessarily have better functionality than linear ones and PLS, as a simple fast linear method could be an effectively applicable regression technique for BCIs.

Chronic stability of single-channel neurophysiological correlates of gross and fine reaching movements in the rat

While substantial task-related neural activity has been observed during motor tasks in rodent primary motor cortex and premotor cortex, the long-term stability of these responses in healthy rats is uncertain, limiting the interpretability of longitudinal changes in the specific patterns of neural activity associated with learning or motor recovery following injury. This study examined the stability of task-related neural activity associated with execution of two distinct reaching tasks in healthy rodents. A novel automated rodent behavioral apparatus was constructed and rats were trained to perform a reaching task combining a ‘gross’ lever press and a ‘fine’ pellet retrieval. In each animal, two chronic microelectrode arrays were implanted in motor cortex spanning the caudal forelimb area (rodent primary motor cortex) and the rostral forelimb area (rodent premotor cortex). We recorded multiunit spiking and local field potential activity from 10 days to 7–10 weeks post-implantation to characterize the patterns of neural activity observed during each task component and analyzed the consistency of channel-specific task-related neural activity. Task-related changes in neural activity were observed on the majority of channels. While the task-related changes in multi-unit spiking and local field potential spectral power were consistent over several weeks, spectral power changes were more stable, despite the trade-off of decreased spatial and temporal resolution. These results show that neural activity in rodent primary and premotor cortex is associated with specific phases of reaching movements with stable patterns of task-related activity across time, establishing the relevance of the rodent for future studies designed to examine changes in task-related neural activity during recovery from focal cortical lesions.

Visual epidural field potentials possess high functional specificity in single trials

Recordings of epidural field potentials (EFPs) allow neuronal activity to be acquired over a large region of cortical tissue with minimal invasiveness. Because electrodes are placed on top of the dura and do not enter the neuronal tissue, EFPs offer intriguing options for both clinical and basic science research. On the other hand, EFPs represent the integrated activity of larger neuronal populations and possess a higher trial-by-trial variability and a reduced signal-to-noise ratio due the additional barrier of the dura. It is thus unclear whether and to what extent EFPs have sufficient spatial selectivity to allow for conclusions about the underlying functional cortical architecture, and whether single EFP trials provide enough information on the short timescales relevant for many clinical and basic neuroscience purposes. We used the high spatial resolution of primary visual cortex to address these issues and investigated the extent to which very short EFP traces allow reliable decoding of spatial information. We briefly presented different visual objects at one of nine closely adjacent locations and recorded neuronal activity with a high-density epidural multielectrode array in three macaque monkeys. With the use of receiver operating characteristics (ROC) to identify the most informative data, machine-learning algorithms provided close-to-perfect classification rates for all 27 stimulus conditions. A binary classifier applying a simple max function on ROC-selected data further showed that single trials might be classified with 100% performance even without advanced offline classifiers. Thus, although highly variable, EFPs constitute an extremely valuable source of information and offer new perspectives for minimally invasive recording of large-scale networks.NEW & NOTEWORTHY Epidural field potential (EFP) recordings provide a minimally invasive approach to investigate large-scale neural networks, but little is known about whether they possess the required specificity for basic and clinical neuroscience. By making use of the spatial selectivity of primary visual cortex, we show that single-trial information can be decoded with close-to-perfect performance, even without using advanced classifiers and based on very few data. This labels EFPs as a highly attractive and widely usable signal.

Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations

Brain-machine interfaces (BMIs) have exploded in popularity in the past decade. BMIs, also called brain-computer interfaces, provide a direct link between the brain and a computer, usually to control an external device. BMIs have a wide array of potential clinical applications, ranging from restoring communication to people unable to speak due to amyotrophic lateral sclerosis or a stroke, to restoring movement to people with paralysis from spinal cord injury or motor neuron disease, to restoring memory to people with cognitive impairment. Because BMIs are controlled directly by the activity of prespecified neurons or cortical areas, they also provide a powerful paradigm with which to investigate fundamental questions about brain physiology, including neuronal behavior, learning, and the role of oscillations. This article reviews the clinical and neuroscientific applications of BMIs, with a primary focus on motor BMIs.

Long-term recording reliability of liquid crystal polymer µECoG arrays

OBJECTIVE

The clinical use of microsignals recorded over broad cortical regions is largely limited by the chronic reliability of the implanted interfaces.

APPROACH

We evaluated the chronic reliability of novel 61-channel micro-electrocorticographic (µECoG) arrays in rats chronically implanted for over one year and using accelerated aging. Devices were encapsulated with polyimide (PI) or liquid crystal polymer (LCP), and fabricated using commercial manufacturing processes. In vitro failure modes and predicted lifetimes were determined from accelerated soak testing. Successful designs were implanted epidurally over the rodent auditory cortex. Trends in baseline signal level, evoked responses and decoding performance were reported for over one year of implantation.

MAIN RESULTS

Devices fabricated with LCP consistently had longer in vitro lifetimes than PI encapsulation. Our accelerated aging results predicted device integrity beyond 3.4 years. Five implanted arrays showed stable performance over the entire implantation period (247-435 d). Our regression analysis showed that impedance predicted signal quality and information content only in the first 31 d of recordings and had little predictive value in the chronic phase (>31 d). In the chronic phase, site impedances slightly decreased yet decoding performance became statistically uncorrelated with impedance. We also employed an improved statistical model of spatial variation to measure sensitivity to locally varying fields, which is typically concealed in standard signal power calculations.

SIGNIFICANCE

These findings show that µECoG arrays can reliably perform in chronic applications in vivo for over one year, which facilitates the development of a high-density, clinically viable interface.

Differential Representation of Articulatory Gestures and Phonemes in Precentral and Inferior Frontal Gyri

Speech is a critical form of human communication and is central to our daily lives. Yet, despite decades of study, an understanding of the fundamental neural control of speech production remains incomplete. Current theories model speech production as a hierarchy from sentences and phrases down to words, syllables, speech sounds (phonemes), and the actions of vocal tract articulators used to produce speech sounds (articulatory gestures). Here, we investigate the cortical representation of articulatory gestures and phonemes in ventral precentral and inferior frontal gyri in men and women. Our results indicate that ventral precentral cortex represents gestures to a greater extent than phonemes, while inferior frontal cortex represents both gestures and phonemes. These findings suggest that speech production shares a common cortical representation with that of other types of movement, such as arm and hand movements. This has important implications both for our understanding of speech production and for the design of brain-machine interfaces to restore communication to people who cannot speak.SIGNIFICANCE STATEMENT Despite being studied for decades, the production of speech by the brain is not fully understood. In particular, the most elemental parts of speech, speech sounds (phonemes) and the movements of vocal tract articulators used to produce these sounds (articulatory gestures), have both been hypothesized to be encoded in motor cortex. Using direct cortical recordings, we found evidence that primary motor and premotor cortices represent gestures to a greater extent than phonemes. Inferior frontal cortex (part of Broca's area) appears to represent both gestures and phonemes. These findings suggest that speech production shares a similar cortical organizational structure with the movement of other body parts.

Recent Progress on Microelectrodes in Neural Interfaces

Brain‒machine interface (BMI) is a promising technology that looks set to contribute to the development of artificial limbs and new input devices by integrating various recent technological advances, including neural electrodes, wireless communication, signal analysis, and robot control. Neural electrodes are a key technological component of BMI, as they can record the rapid and numerous signals emitted by neurons. To receive stable, consistent, and accurate signals, electrodes are designed in accordance with various templates using diverse materials. With the development of microelectromechanical systems (MEMS) technology, electrodes have become more integrated, and their performance has gradually evolved through surface modification and advances in biotechnology. In this paper, we review the development of the extracellular/intracellular type of in vitro microelectrode array (MEA) to investigate neural interface technology and the penetrating/surface (non-penetrating) type of in vivo electrodes. We briefly examine the history and study the recently developed shapes and various uses of the electrode. Also, electrode materials and surface modification techniques are reviewed to measure high-quality neural signals that can be used in BMI.

Cortical control of object-specific grasp relies on adjustments of both activity and effective connectivity: a common marmoset study

Key points

The cortical mechanisms of grasping have been extensively studied in macaques and humans; here, we investigated whether common marmosets could rely on similar mechanisms despite strong differences in hand morphology and grip diversity.

We recorded electrocorticographic activity over the sensorimotor cortex of two common marmosets during the execution of different grip types, which allowed us to study cortical activity (power spectrum) and physiologically inferred connectivity (phase‐slope index).

Analyses were performed in beta (16–35 Hz) and gamma (75–100 Hz) frequency bands and our results showed that beta power varied depending on grip type, whereas gamma power displayed clear epoch‐related modulation.

Strength and direction of inter‐area connectivity varied depending on grip type and epoch.

These findings suggest that fundamental control mechanisms are conserved across primates and, in future research, marmosets could represent an adequate model to investigate primate brain mechanisms.

Abstract

The cortical mechanisms of grasping have been extensively studied in macaques and humans. Here, we investigated whether common marmosets could rely on similar mechanisms despite striking differences in manual dexterity. Two common marmosets were trained to grasp‐and‐pull three objects eliciting different hand configurations: whole‐hand, finger and scissor grips. The animals were then chronically implanted with 64‐channel electrocorticogram arrays positioned over the left premotor, primary motor and somatosensory cortex. Power spectra, reflecting predominantly cortical activity, and phase‐slope index, reflecting the direction of information flux, were studied in beta (16–35 Hz) and gamma (75–100 Hz) bands. Differences related to grip type, epoch (reach, grasp) and cortical area were statistically assessed. Results showed that whole‐hand and scissor grips triggered stronger beta desynchronization than finger grip. Task epochs clearly modulated gamma power, especially for finger and scissor grips. Considering effective connectivity, finger and scissor grips evoked stronger outflow from primary motor to premotor cortex, whereas whole‐hand grip displayed the opposite pattern. These findings suggest that fundamental control mechanisms, relying on adjustments of cortical activity and connectivity, are conserved across primates. Consistently, marmosets could represent a good model to investigate primate brain mechanisms.

The cortical mechanisms of grasping have been extensively studied in macaques and humans; here, we investigated whether common marmosets could rely on similar mechanisms despite strong differences in hand morphology and grip diversity.

We recorded electrocorticographic activity over the sensorimotor cortex of two common marmosets during the execution of different grip types, which allowed us to study cortical activity (power spectrum) and physiologically inferred connectivity (phase‐slope index).

Analyses were performed in beta (16–35 Hz) and gamma (75–100 Hz) frequency bands and our results showed that beta power varied depending on grip type, whereas gamma power displayed clear epoch‐related modulation.

Strength and direction of inter‐area connectivity varied depending on grip type and epoch.

These findings suggest that fundamental control mechanisms are conserved across primates and, in future research, marmosets could represent an adequate model to investigate primate brain mechanisms.

Physiological properties of brain-machine interface input signals

Brain-machine interfaces (BMIs), also called brain-computer interfaces (BCIs), decode neural signals and use them to control some type of external device. Despite many experimental successes and terrific demonstrations in animals and humans, a high-performance, clinically viable device has not yet been developed for widespread usage. There are many factors that impact clinical viability and BMI performance. Arguably, the first of these is the selection of brain signals used to control BMIs. In this review, we summarize the physiological characteristics and performance-including movement-related information, longevity, and stability-of multiple types of input signals that have been used in invasive BMIs to date. These include intracortical spikes as well as field potentials obtained inside the cortex, at the surface of the cortex (electrocorticography), and at the surface of the dura mater (epidural signals). We also discuss the potential for future enhancements in input signal performance, both by improving hardware and by leveraging the knowledge of the physiological characteristics of these signals to improve decoding and stability.

Continuous decoding of human grasp kinematics using epidural and subdural signals

OBJECTIVE

Restoring or replacing function in paralyzed individuals will one day be achieved through the use of brain-machine interfaces. Regaining hand function is a major goal for paralyzed patients. Two competing prerequisites for the widespread adoption of any hand neuroprosthesis are accurate control over the fine details of movement, and minimized invasiveness. Here, we explore the interplay between these two goals by comparing our ability to decode hand movements with subdural and epidural field potentials (EFPs).

APPROACH

We measured the accuracy of decoding continuous hand and finger kinematics during naturalistic grasping motions in five human subjects. We recorded subdural surface potentials (electrocorticography; ECoG) as well as with EFPs, with both standard- and high-resolution electrode arrays.

MAIN RESULTS

In all five subjects, decoding of continuous kinematics significantly exceeded chance, using either EGoG or EFPs. ECoG decoding accuracy compared favorably with prior investigations of grasp kinematics (mean ± SD grasp aperture variance accounted for was 0.54 ± 0.05 across all subjects, 0.75 ± 0.09 for the best subject). In general, EFP decoding performed comparably to ECoG decoding. The 7-20 Hz and 70-115 Hz spectral bands contained the most information about grasp kinematics, with the 70-115 Hz band containing greater information about more subtle movements. Higher-resolution recording arrays provided clearly superior performance compared to standard-resolution arrays.

SIGNIFICANCE

To approach the fine motor control achieved by an intact brain-body system, it will be necessary to execute motor intent on a continuous basis with high accuracy. The current results demonstrate that this level of accuracy might be achievable not just with ECoG, but with EFPs as well. Epidural placement of electrodes is less invasive, and therefore may incur less risk of encephalitis or stroke than subdural placement of electrodes. Accurately decoding motor commands at the epidural level may be an important step towards a clinically viable brain-machine interface.

Spatial co-adaptation of cortical control columns in a micro-ECoG brain-computer interface

OBJECTIVE

Electrocorticography (ECoG) has been used for a range of applications including electrophysiological mapping, epilepsy monitoring, and more recently as a recording modality for brain-computer interfaces (BCIs). Studies that examine ECoG electrodes designed and implanted chronically solely for BCI applications remain limited. The present study explored how two key factors influence chronic, closed-loop ECoG BCI: (i) the effect of inter-electrode distance on BCI performance and (ii) the differences in neural adaptation and performance when fixed versus adaptive BCI decoding weights are used.

APPROACH

The amplitudes of epidural micro-ECoG signals between 75 and 105 Hz with 300 μm diameter electrodes were used for one-dimensional and two-dimensional BCI tasks. The effect of inter-electrode distance on BCI control was tested between 3 and 15 mm. Additionally, the performance and cortical modulation differences between constant, fixed decoding using a small subset of channels versus adaptive decoding weights using the entire array were explored.

MAIN RESULTS

Successful BCI control was possible with two electrodes separated by 9 and 15 mm. Performance decreased and the signals became more correlated when the electrodes were only 3 mm apart. BCI performance in a 2D BCI task improved significantly when using adaptive decoding weights (80%-90%) compared to using constant, fixed weights (50%-60%). Additionally, modulation increased for channels previously unavailable for BCI control under the fixed decoding scheme upon switching to the adaptive, all-channel scheme.

SIGNIFICANCE

Our results clearly show that neural activity under a BCI recording electrode (which we define as a 'cortical control column') readily adapts to generate an appropriate control signal. These results show that the practical minimal spatial resolution of these control columns with micro-ECoG BCI is likely on the order of 3 mm. Additionally, they show that the combination and interaction between neural adaptation and machine learning are critical to optimizing ECoG BCI performance.

Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control

The human motor system is capable of remarkably precise control of movements--consider the skill of professional baseball pitchers or surgeons. This precise control relies upon stable representations of movements in the brain. Here, we investigated the stability of cortical activity at multiple spatial and temporal scales by recording local field potentials (LFPs) and action potentials (multiunit spikes, MSPs) while two monkeys controlled a cursor either with their hand or directly from the brain using a brain-machine interface. LFPs and some MSPs were remarkably stable over time periods ranging from 3 d to over 3 years; overall, LFPs were significantly more stable than spikes. We then assessed whether the stability of all neural activity, or just a subset of activity, was necessary to achieve stable behavior. We showed that projections of neural activity into the subspace relevant to the task (the "task-relevant space") were significantly more stable than were projections into the task-irrelevant (or "task-null") space. This provides cortical evidence in support of the minimum intervention principle, which proposes that optimal feedback control (OFC) allows the brain to tightly control only activity in the task-relevant space while allowing activity in the task-irrelevant space to vary substantially from trial to trial. We found that the brain appears capable of maintaining stable movement representations for extremely long periods of time, particularly so for neural activity in the task-relevant space, which agrees with OFC predictions.

SIGNIFICANCE STATEMENT

It is unknown whether cortical signals are stable for more than a few weeks. Here, we demonstrate that motor cortical signals can exhibit high stability over several years. This result is particularly important to brain-machine interfaces because it could enable stable performance with infrequent recalibration. Although we can maintain movement accuracy over time, movement components that are unrelated to the goals of a task (such as elbow position during reaching) often vary from trial to trial. This is consistent with the minimum intervention principle of optimal feedback control. We provide evidence that the motor cortex acts according to this principle: cortical activity is more stable in the task-relevant space and more variable in the task-irrelevant space.

A low-cost, multiplexed μECoG system for high-density recordings in freely moving rodents

OBJECTIVE

Micro-electrocorticography (μECoG) offers a minimally invasive neural interface with high spatial resolution over large areas of cortex. However, electrode arrays with many contacts that are individually wired to external recording systems are cumbersome and make recordings in freely behaving rodents challenging. We report a novel high-density 60-electrode system for μECoG recording in freely moving rats.

APPROACH

Multiplexed headstages overcome the problem of wiring complexity by combining signals from many electrodes to a smaller number of connections. We have developed a low-cost, multiplexed recording system with 60 contacts at 406 μm spacing. We characterized the quality of the electrode signals using multiple metrics that tracked spatial variation, evoked-response detectability, and decoding value. Performance of the system was validated both in anesthetized animals and freely moving awake animals.

MAIN RESULTS

We recorded μECoG signals over the primary auditory cortex, measuring responses to acoustic stimuli across all channels. Single-trial responses had high signal-to-noise ratios (SNR) (up to 25 dB under anesthesia), and were used to rapidly measure network topography within ∼10 s by constructing all single-channel receptive fields in parallel. We characterized evoked potential amplitudes and spatial correlations across the array in the anesthetized and awake animals. Recording quality in awake animals was stable for at least 30 days. Finally, we used these responses to accurately decode auditory stimuli on single trials.

SIGNIFICANCE

This study introduces (1) a μECoG recording system based on practical hardware design and (2) a rigorous analytical method for characterizing the signal characteristics of μECoG electrode arrays. This methodology can be applied to evaluate the fidelity and lifetime of any μECoG electrode array. Our μECoG-based recording system is accessible and will be useful for studies of perception and decision-making in rodents, particularly over the entire time course of behavioral training and learning.

Decoding three-dimensional reaching movements using electrocorticographic signals in humans

OBJECTIVE

Electrocorticography (ECoG) signals have emerged as a potential control signal for brain-computer interface (BCI) applications due to balancing signal quality and implant invasiveness. While there have been numerous demonstrations in which ECoG signals were used to decode motor movements and to develop BCI systems, the extent of information that can be decoded has been uncertain. Therefore, we sought to determine if ECoG signals could be used to decode kinematics (speed, velocity, and position) of arm movements in 3D space.

APPROACH

To investigate this, we designed a 3D center-out reaching task that was performed by five epileptic patients undergoing temporary placement of ECoG arrays. We used the ECoG signals within a hierarchical partial-least squares (PLS) regression model to perform offline prediction of hand speed, velocity, and position.

MAIN RESULTS

The hierarchical PLS regression model enabled us to predict hand speed, velocity, and position during 3D reaching movements from held-out test sets with accuracies above chance in each patient with mean correlation coefficients between 0.31 and 0.80 for speed, 0.27 and 0.54 for velocity, and 0.22 and 0.57 for position. While beta band power changes were the most significant features within the model used to classify movement and rest, the local motor potential and high gamma band power changes, were the most important features in the prediction of kinematic parameters.

SIGNIFICANCE

We believe that this study represents the first demonstration that truly three-dimensional movements can be predicted from ECoG recordings in human patients. Furthermore, this prediction underscores the potential to develop BCI systems with multiple degrees of freedom in human patients using ECoG.

Current Challenges Facing the Translation of Brain Computer Interfaces from Preclinical Trials to Use in Human Patients

Current research in brain computer interface (BCI) technology is advancing beyond preclinical studies, with trials beginning in human patients. To date, these trials have been carried out with several different types of recording interfaces. The success of these devices has varied widely, but different factors such as the level of invasiveness, timescale of recorded information, and ability to maintain stable functionality of the device over a long period of time all must be considered in addition to accuracy in decoding intent when assessing the most practical type of device moving forward. Here, we discuss various approaches to BCIs, distinguishing between devices focusing on control of operations extrinsic to the subject (e.g., prosthetic limbs, computer cursors) and those focusing on control of operations intrinsic to the brain (e.g., using stimulation or external feedback), including closed-loop or adaptive devices. In this discussion, we consider the current challenges facing the translation of various types of BCI technology to eventual human application.

Cortical neuroprosthetics from a clinical perspective

Recent pilot clinical studies have demonstrated that subjects with severe disorders of movement and communication can exert direct neural control over assistive devices using invasive Brain-Machine Interface (BMI) technology, also referred to as 'cortical neuroprosthetics'. These important proof-of-principle studies have generated great interest among those with disability and clinicians who provide general medical, neurological and/or rehabilitative care. Taking into account the perspective of providers who may be unfamiliar with the field, we first review the clinical goals and fundamentals of invasive BMI technology, and then briefly summarize the vast body of basic science research demonstrating its feasibility. We emphasize recent translational progress in the target clinical populations and discuss translational challenges and future directions.

Brain-machine interfaces in neurorehabilitation of stroke

Stroke is among the leading causes of long-term disabilities leaving an increasing number of people with cognitive, affective and motor impairments depending on assistance in their daily life. While function after stroke can significantly improve in the first weeks and months, further recovery is often slow or non-existent in the more severe cases encompassing 30-50% of all stroke victims. The neurobiological mechanisms underlying recovery in those patients are incompletely understood. However, recent studies demonstrated the brain's remarkable capacity for functional and structural plasticity and recovery even in severe chronic stroke. As all established rehabilitation strategies require some remaining motor function, there is currently no standardized and accepted treatment for patients with complete chronic muscle paralysis. The development of brain-machine interfaces (BMIs) that translate brain activity into control signals of computers or external devices provides two new strategies to overcome stroke-related motor paralysis. First, BMIs can establish continuous high-dimensional brain-control of robotic devices or functional electric stimulation (FES) to assist in daily life activities (assistive BMI). Second, BMIs could facilitate neuroplasticity, thus enhancing motor learning and motor recovery (rehabilitative BMI). Advances in sensor technology, development of non-invasive and implantable wireless BMI-systems and their combination with brain stimulation, along with evidence for BMI systems' clinical efficacy suggest that BMI-related strategies will play an increasing role in neurorehabilitation of stroke.

Epidural electrocorticography for monitoring of arousal in locked-in state

Electroencephalography (EEG) often fails to assess both the level (i.e., arousal) and the content (i.e., awareness) of pathologically altered consciousness in patients without motor responsiveness. This might be related to a decline of awareness, to episodes of low arousal and disturbed sleep patterns, and/or to distorting and attenuating effects of the skull and intermediate tissue on the recorded brain signals. Novel approaches are required to overcome these limitations. We introduced epidural electrocorticography (ECoG) for monitoring of cortical physiology in a late-stage amytrophic lateral sclerosis patient in completely locked-in state (CLIS). Despite long-term application for a period of six months, no implant-related complications occurred. Recordings from the left frontal cortex were sufficient to identify three arousal states. Spectral analysis of the intrinsic oscillatory activity enabled us to extract state-dependent dominant frequencies at <4, ~7 and ~20 Hz, representing sleep-like periods, and phases of low and elevated arousal, respectively. In the absence of other biomarkers, ECoG proved to be a reliable tool for monitoring circadian rhythmicity, i.e., avoiding interference with the patient when he was sleeping and exploiting time windows of responsiveness. Moreover, the effects of interventions addressing the patient's arousal, e.g., amantadine medication, could be evaluated objectively on the basis of physiological markers, even in the absence of behavioral parameters. Epidural ECoG constitutes a feasible trade-off between surgical risk and quality of recorded brain signals to gain information on the patient's present level of arousal. This approach enables us to optimize the timing of interactions and medical interventions, all of which should take place when the patient is in a phase of high arousal. Furthermore, avoiding low-responsiveness periods will facilitate measures to implement alternative communication pathways involving brain-computer interfaces (BCI).

Extracting kinetic information from human motor cortical signals

Brain machine interfaces (BMIs) have the potential to provide intuitive control of neuroprostheses to restore grasp to patients with paralyzed or amputated upper limbs. For these neuroprostheses to function, the ability to accurately control grasp force is critical. Grasp force can be decoded from neuronal spikes in monkeys, and hand kinematics can be decoded using electrocorticogram (ECoG) signals recorded from the surface of the human motor cortex. We hypothesized that kinetic information about grasping could also be extracted from ECoG, and sought to decode continuously-graded grasp force. In this study, we decoded isometric pinch force with high accuracy from ECoG in 10 human subjects. The predicted signals explained from 22% to 88% (60 ± 6%, mean ± SE) of the variance in the actual force generated. We also decoded muscle activity in the finger flexors, with similar accuracy to force decoding. We found that high gamma band and time domain features of the ECoG signal were most informative about kinetics, similar to our previous findings with intracortical LFPs. In addition, we found that peak cortical representations of force applied by the index and little fingers were separated by only about 4mm. Thus, ECoG can be used to decode not only kinematics, but also kinetics of movement. This is an important step toward restoring intuitively-controlled grasp to impaired patients.

Decoding of visual attention from LFP signals of macaque MT

The local field potential (LFP) has recently been widely used in brain computer interfaces (BCI). Here we used power of LFP recorded from area MT of a macaque monkey to decode where the animal covertly attended. Support vector machines (SVM) were used to learn the pattern of power at different frequencies for attention to two possible positions. We found that LFP power at both low (<9 Hz) and high (31–120 Hz) frequencies contains sufficient information to decode the focus of attention. Highest decoding performance was found for gamma frequencies (31–120 Hz) and reached 82%. In contrast low frequencies (<9 Hz) could help the classifier reach a higher decoding performance with a smaller amount of training data. Consequently, we suggest that low frequency LFP can provide fast but coarse information regarding the focus of attention, while higher frequencies of the LFP deliver more accurate but less timely information about the focus of attention.

Reliability of directional information in unsorted spikes and local field potentials recorded in human motor cortex

OBJECTIVE

Action potentials and local field potentials (LFPs) recorded in primary motor cortex contain information about the direction of movement. LFPs are assumed to be more robust to signal instabilities than action potentials, which makes LFPs, along with action potentials, a promising signal source for brain-computer interface applications. Still, relatively little research has directly compared the utility of LFPs to action potentials in decoding movement direction in human motor cortex.

APPROACH

We conducted intracortical multi-electrode recordings in motor cortex of two persons (T2 and [S3]) as they performed a motor imagery task. We then compared the offline decoding performance of LFPs and spiking extracted from the same data recorded across a one-year period in each participant.

MAIN RESULTS

We obtained offline prediction accuracy of movement direction and endpoint velocity in multiple LFP bands, with the best performance in the highest (200-400 Hz) LFP frequency band, presumably also containing low-pass filtered action potentials. Cross-frequency correlations of preferred directions and directional modulation index showed high similarity of directional information between action potential firing rates (spiking) and high frequency LFPs (70-400 Hz), and increasing disparity with lower frequency bands (0-7, 10-40 and 50-65 Hz). Spikes predicted the direction of intended movement more accurately than any individual LFP band, however combined decoding of all LFPs was statistically indistinguishable from spike-based performance. As the quality of spiking signals (i.e. signal amplitude) and the number of significantly modulated spiking units decreased, the offline decoding performance decreased 3.6[5.65]%/month (for T2 and [S3] respectively). The decrease in the number of significantly modulated LFP signals and their decoding accuracy followed a similar trend (2.4[2.85]%/month, ANCOVA, p = 0.27[0.03]).

SIGNIFICANCE

Field potentials provided comparable offline decoding performance to unsorted spikes. Thus, LFPs may provide useful external device control using current human intracortical recording technology. (

CLINICAL TRIAL REGISTRATION NUMBER

NCT00912041.).

Direct classification of all American English phonemes using signals from functional speech motor cortex

OBJECTIVE

Although brain-computer interfaces (BCIs) can be used in several different ways to restore communication, communicative BCI has not approached the rate or efficiency of natural human speech. Electrocorticography (ECoG) has precise spatiotemporal resolution that enables recording of brain activity distributed over a wide area of cortex, such as during speech production. In this study, we sought to decode elements of speech production using ECoG.

APPROACH

We investigated words that contain the entire set of phonemes in the general American accent using ECoG with four subjects. Using a linear classifier, we evaluated the degree to which individual phonemes within each word could be correctly identified from cortical signal.

MAIN RESULTS

We classified phonemes with up to 36% accuracy when classifying all phonemes and up to 63% accuracy for a single phoneme. Further, misclassified phonemes follow articulation organization described in phonology literature, aiding classification of whole words. Precise temporal alignment to phoneme onset was crucial for classification success.

SIGNIFICANCE

We identified specific spatiotemporal features that aid classification, which could guide future applications. Word identification was equivalent to information transfer rates as high as 3.0 bits s(-1) (33.6 words min(-1)), supporting pursuit of speech articulation for BCI control.

Intra-day signal instabilities affect decoding performance in an intracortical neural interface system

OBJECTIVE

Motor neural interface systems (NIS) aim to convert neural signals into motor prosthetic or assistive device control, allowing people with paralysis to regain movement or control over their immediate environment. Effector or prosthetic control can degrade if the relationship between recorded neural signals and intended motor behavior changes. Therefore, characterizing both biological and technological sources of signal variability is important for a reliable NIS.

APPROACH

To address the frequency and causes of neural signal variability in a spike-based NIS, we analyzed within-day fluctuations in spiking activity and action potential amplitude recorded with silicon microelectrode arrays implanted in the motor cortex of three people with tetraplegia (BrainGate pilot clinical trial, IDE).

MAIN RESULTS

84% of the recorded units showed a statistically significant change in apparent firing rate (3.8 ± 8.71 Hz or 49% of the mean rate) across several-minute epochs of tasks performed on a single session, and 74% of the units showed a significant change in spike amplitude (3.7 ± 6.5 µV or 5.5% of mean spike amplitude). 40% of the recording sessions showed a significant correlation in the occurrence of amplitude changes across electrodes, suggesting array micro-movement. Despite the relatively frequent amplitude changes, only 15% of the observed within-day rate changes originated from recording artifacts such as spike amplitude change or electrical noise, while 85% of the rate changes most likely emerged from physiological mechanisms. Computer simulations confirmed that systematic rate changes of individual neurons could produce a directional 'bias' in the decoded neural cursor movements. Instability in apparent neuronal spike rates indeed yielded a directional bias in 56% of all performance assessments in participant cursor control (n = 2 participants, 108 and 20 assessments over two years), resulting in suboptimal performance in these sessions.

SIGNIFICANCE

We anticipate that signal acquisition and decoding methods that can adapt to the reported instabilities will further improve the performance of intracortically-based NISs.

Decoding stimulus identity from multi-unit activity and local field potentials along the ventral auditory stream in the awake primate: implications for cortical neural prostheses

OBJECTIVE

Hierarchical processing of auditory sensory information is believed to occur in two streams: a ventral stream responsible for stimulus identity and a dorsal stream responsible for processing spatial elements of a stimulus. The objective of the current study is to examine neural coding in this processing stream in the context of understanding the possibility for an auditory cortical neural prosthesis.

APPROACH

We examined the selectivity for species-specific primate vocalizations in the ventral auditory processing stream by applying a statistical classifier to neural data recorded from microelectrode arrays. Multi-unit activity (MUA) and local field potential (LFP) data recorded simultaneously from primary auditory complex (AI) and rostral parabelt (PBr) were decoded on a trial-by-trial basis.

MAIN RESULTS

While decode performance in AI was well above chance, mean performance in PBr did not deviate >15% from chance level. Mean performance levels were similar for MUA and LFP decodes. Increasing the spectral and temporal resolution improved decode performance; while inter-electrode spacing could be as large as 1.14 mm without degrading decode performance.

SIGNIFICANCE

These results serve as preliminary guidance for a human auditory cortical neural prosthesis; instructing interface implementation, microstimulation patterns and anatomical placement.

Accurate decoding of reaching movements from field potentials in the absence of spikes

The recent explosion of interest in brain-machine interfaces (BMIs) has spurred research into choosing the optimal input signal source for a desired application. The signals with highest bandwidth--single neuron action potentials or spikes--typically are difficult to record for more than a few years after implantation of intracortical electrodes. Fortunately, field potentials recorded within the cortex (local field potentials, LFPs), at its surface (electrocorticograms, ECoG) and at the dural surface (epidural, EFPs) have also been shown to contain significant information about movement. However, the relative performance of these signals has not yet been directly compared. Furthermore, while it is widely postulated, it has not yet been demonstrated that these field potential signals are more durable than spike recordings. The aim of this study was to address both of these questions. We assessed the offline decoding performance of EFPs, LFPs and spikes, recorded sequentially, in primary motor cortex (M1) in terms of their ability to decode the target of reaching movements, as well as the endpoint trajectory. We also examined the decoding performance of LFPs on electrodes that are not recording spikes, compared with the performance when they did record spikes. Spikes were still present on some of the other electrodes throughout this study. We showed that LFPs performed nearly as well as spikes in decoding velocity, and slightly worse in decoding position and in target classification. EFP performance was slightly inferior to that reported for ECoG in humans. We also provided evidence demonstrating that movement-related information in the LFP remains high regardless of the ability to record spikes concurrently on the same electrodes. This is the first study to provide evidence that LFPs retain information about movement in the absence of spikes on the same electrodes. These results suggest that LFPs may indeed remain informative after spike recordings are lost, thereby providing a robust, accurate signal source for BMIs.

Optimizing the decoding of movement goals from local field potentials in macaque cortex

The successful development of motor neuroprosthetic devices hinges on the ability to accurately and reliably decode signals from the brain. Motor neuroprostheses are widely investigated in behaving non-human primates, but technical constraints have limited progress in optimizing performance. In particular, the organization of movement-related neuronal activity across cortical layers remains poorly understood due, in part, to the widespread use of fixed-geometry multielectrode arrays. In this study, we use chronically implanted multielectrode arrays with individually movable electrodes to examine how the encoding of movement goals depends on cortical depth. In a series of recordings spanning several months, we varied the depth of each electrode in the prearcuate gyrus of frontal cortex in two monkeys as they performed memory-guided eye movements. We decode eye movement goals from local field potentials (LFPs) and multiunit spiking activity recorded across a range of depths up to 3 mm from the cortical surface. We show that both LFP and multiunit signals yield the highest decoding performance at superficial sites, within 0.5 mm of the cortical surface, while performance degrades substantially at sites deeper than 1 mm. We also analyze performance by varying bandpass filtering characteristics and simulating changes in microelectrode array channel count and density. The results indicate that the performance of LFP-based neuroprostheses strongly depends on recording configuration and that recording depth is a critical parameter limiting system performance.