Single-trial decoding of intended eye movement goals from lateral prefrontal cortex neural ensembles

Mapping cognitive activity from electrocorticography field potentials in humans performing NBack task

Objective. Advancements in data science and assistive technologies have made invasive brain-computer interfaces (iBCIs) increasingly viable for enhancing the quality of life in physically disabled individuals. Intracortical microelectrode implants are a common choice for such a communication system due to their fine temporal and spatial resolution. The small size of these implants makes the implantation plan critical for the successful exfiltration of information, particularly when targeting representations of task goals that lack robust anatomical correlates.Approach. Working memory processes including encoding, retrieval, and maintenance are observed in many areas of the brain. Using human electrocorticography (ECoG) recordings during a working memory experiment, we provide proof that it is possible to localize cognitive activity associated with the task and to identify key locations involved with executive memory functions.Results.From the analysis, we could propose an optimal iBCI implant location with the desired features. The general approach is not limited to working memory but could also be used to map other goal-encoding factors such as movement intentions, decision-making, and visual-spatial attention.Significance. Deciphering the intended action of a BCI user is a complex challenge that involves the extraction and integration of cognitive factors such as movement planning, working memory, visual-spatial attention, and the decision state. Examining field potentials from ECoG electrodes while participants engaged in tailored cognitive tasks can pinpoint location with valuable information related to anticipated actions. This manuscript demonstrates the feasibility of identifying electrodes involved in cognitive activity related to working memory during user engagement in the NBack task. Devoting time in meticulous preparation to identify the optimal brain regions for BCI implant locations will increase the likelihood of rich signal outcomes, thereby improving the overall BCI user experience.

Mapping eye, arm, and reward information in frontal motor cortices using electrocorticography in non-human primates

Goal-directed reaches give rise to dynamic neural activity across the brain as we move our eyes and arms, and process outcomes. High spatiotemporal resolution mapping of multiple cortical areas will improve our understanding of how these neural computations are spatially and temporally distributed across the brain. In this study, we used micro-electrocorticography (μECoG) recordings in two male monkeys performing visually guided reaches to map information related to eye movements, arm movements, and receiving rewards over a 1.37 cm2 area of frontal motor cortices (primary motor cortex, premotor cortex, frontal eye field, and dorsolateral pre-frontal cortex). Time-frequency and decoding analyses revealed that eye and arm movement information shifts across brain regions during a reach, likely reflecting shifts from planning to execution. We then used phase-based analyses to reveal potential overlaps of eye and arm information. We found that arm movement decoding performance was impacted by task-irrelevant eye movements, consistent with the presence of intermixed eye and arm information across much of motor cortices. Phase-based analyses also identified reward-related activity primarily around the principal sulcus in the pre-frontal cortex as well as near the arcuate sulcus in the premotor cortex. Our results demonstrate μECoG's strengths for functional mapping and provide further detail on the spatial distribution of eye, arm, and reward information processing distributed across frontal cortices during reaching. These insights advance our understanding of the overlapping neural computations underlying coordinated movements and reveal opportunities to leverage these signals to enhance future brain-computer interfaces.

Ensembles code for associative learning in the primate lateral prefrontal cortex

The lateral prefrontal cortex (LPFC) of primates is thought to play a role in associative learning. However, it remains unclear how LPFC neuronal ensembles dynamically encode and store memories for arbitrary stimulus-response associations. We recorded the activity of neurons in LPFC of two macaques during an associative learning task using multielectrode arrays. During task trials, the color of a symbolic cue indicated the location of one of two possible targets for a saccade. During a trial block, multiple randomly chosen associations were learned by the subjects. A state-space analysis indicated that LPFC neuronal ensembles rapidly learn new stimulus-response associations mirroring the animals' learning. Multiple associations acquired during training are stored in a neuronal subspace and can be retrieved hours after learning. Finally, knowledge of old associations facilitates learning new, similar associations. These results indicate that neuronal ensembles in the primate LPFC provide a flexible and dynamic substrate for associative learning.

Decoding spatial locations from primate lateral prefrontal cortex neural activity during virtual navigation

Objective. Decoding the intended trajectories from brain signals using a brain-computer interface system could be used to improve the mobility of patients with disabilities.Approach. Neuronal activity associated with spatial locations was examined while macaques performed a navigation task within a virtual environment.Main results.Here, we provide proof of principle that multi-unit spiking activity recorded from the lateral prefrontal cortex (LPFC) of non-human primates can be used to predict the location of a subject in a virtual maze during a navigation task. The spatial positions within the maze that require a choice or are associated with relevant task events can be better predicted than the locations where no relevant events occur. Importantly, within a task epoch of a single trial, multiple locations along the maze can be independently identified using a support vector machine model.Significance. Considering that the LPFC of macaques and humans share similar properties, our results suggest that this area could be a valuable implant location for an intracortical brain-computer interface system used for spatial navigation in patients with disabilities.

Stable Working Memory and Perceptual Representations in Macaque Lateral Prefrontal Cortex during Naturalistic Vision

Primates use perceptual and mnemonic visuospatial representations to perform everyday functions. Neurons in the lateral prefrontal cortex (LPFC) have been shown to encode both of these representations during tasks where eye movements are strictly controlled and visual stimuli are reduced in complexity. This raises the question of whether perceptual and mnemonic representations encoded by LPFC neurons remain robust during naturalistic vision-in the presence of a rich visual scenery and during eye movements. Here we investigate this issue by training macaque monkeys to perform working memory and perception tasks in a visually complex virtual environment that requires navigation using a joystick and allows for free visual exploration of the scene. We recorded the activity of 3950 neurons in the LPFC (areas 8a and 9/46) of two male rhesus macaques using multielectrode arrays, and measured eye movements using video tracking. We found that navigation trajectories to target locations and eye movement behavior differed between the perception and working memory tasks, suggesting that animals used different behavioral strategies. Single neurons were tuned to target location during cue encoding and working memory delay, and neural ensemble activity was predictive of the behavior of the animals. Neural decoding of the target location was stable throughout the working memory delay epoch. However, neural representations of similar target locations differed between the working memory and perception tasks. These findings indicate that during naturalistic vision, LPFC neurons maintain robust and distinct neural codes for mnemonic and perceptual visuospatial representations.SIGNIFICANCE STATEMENT We show that lateral prefrontal cortex neurons encode working memory and perceptual representations during a naturalistic task set in a virtual environment. We show that despite eye movement and complex visual input, neurons maintain robust working memory representations of space, which are distinct from neuronal representations for perception. We further provide novel insight into the use of virtual environments to construct behavioral tasks for electrophysiological experiments.

Decoding the Time Course of Spatial Information from Spiking and Local Field Potential Activities in the Superior Colliculus

Place code representation is ubiquitous in circuits that encode spatial parameters. For visually guided eye movements, neurons in many brain regions emit spikes when a stimulus is presented in their receptive fields and/or when a movement is directed into their movement fields. Crucially, individual neurons respond for a broad range of directions or eccentricities away from the optimal vector, making it difficult to decode the stimulus location or the saccade vector from each cell's activity. We investigated whether it is possible to decode the spatial parameter with a population-level analysis, even when the optimal vectors are similar across neurons. Spiking activity and local field potentials (LFPs) in the superior colliculus (SC) were recorded with a laminar probe as monkeys performed a delayed saccade task to one of eight targets radially equidistant in direction. A classifier was applied offline to decode the spatial configuration as the trial progresses from sensation to action. For spiking activity, decoding performance across all eight directions was highest during the visual and motor epochs and lower but well above chance during the delay period. Classification performance followed a similar pattern for LFP activity too, except the performance during the delay period was limited mostly to the preferred direction. Increasing the number of neurons in the population consistently increased classifier performance for both modalities. Overall, this study demonstrates the power of population activity for decoding spatial information not possible from individual neurons.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Decoding Saccade Intention From Primate Prefrontal Cortical Local Field Potentials Using Spectral, Spatial, and Temporal Dimensionality Reduction

Most invasive Brain Computer Interfaces (iBCIs) use spike and Local Field Potentials (LFPs) from the motor or parietal cortices to decode movement intentions. It has been debated whether harvesting signals from other brain areas that encode global cognitive variables, such as the allocation of attention and eye movement goals in a variety of spatial reference frames, may improve the outcome of iBCIs. Here, we explore the ability of LFP signals, sampled from the lateral prefrontal cortex (LPFC) of macaque monkeys, to encode eye-movement intention during the pre-movement fixation period of a delayed saccade task. We use spectral dimensionality reduction to examine the spatiotemporal properties of the extracted non-rhythmic broadband activity and explore its usefulness in decoding saccade goals. The dynamics of the broadband signal in low spatial dimensions across the pre-movement fixation period uncovered saccade target separation; its discriminative potential was confirmed using support vector machine classifications. These findings reveal that broadband LFP from the LPFC can be used to decode intended saccade target location during pre-movement periods. We further provide a general workflow that can be implemented in iBCIs and it is relatively robust to the loss of spikes in individual electrodes.

A neural network for online spike classification that improves decoding accuracy

Separating neural signals from noise can improve brain-computer interface performance and stability. However, most algorithms for separating neural action potentials from noise are not suitable for use in real time and have shown mixed effects on decoding performance. With the goal of removing noise that impedes online decoding, we sought to automate the intuition of human spike-sorters to operate in real time with an easily tunable parameter governing the stringency with which spike waveforms are classified. We trained an artificial neural network with one hidden layer on neural waveforms that were hand-labeled as either spikes or noise. The network output was a likelihood metric for each waveform it classified, and we tuned the network's stringency by varying the minimum likelihood value for a waveform to be considered a spike. Using the network's labels to exclude noise waveforms, we decoded remembered target location during a memory-guided saccade task from electrode arrays implanted in prefrontal cortex of rhesus macaque monkeys. The network classified waveforms in real time, and its classifications were qualitatively similar to those of a human spike-sorter. Compared with decoding with threshold crossings, in most sessions we improved decoding performance by removing waveforms with low spike likelihood values. Furthermore, decoding with our network's classifications became more beneficial as time since array implantation increased. Our classifier serves as a feasible preprocessing step, with little risk of harm, that could be applied to both off-line neural data analyses and online decoding.NEW & NOTEWORTHY Although there are many spike-sorting methods that isolate well-defined single units, these methods typically involve human intervention and have inconsistent effects on decoding. We used human classified neural waveforms as training data to create an artificial neural network that could be tuned to separate spikes from noise that impaired decoding. We found that this network operated in real time and was suitable for both off-line data processing and online decoding.

Encoding of the Intent to Drink Alcohol by the Prefrontal Cortex Is Blunted in Rats with a Family History of Excessive Drinking

The prefrontal cortex (PFC) plays a central role in guiding decision making, and its function is altered by alcohol use and an individual's innate risk for excessive alcohol drinking. The primary goal of this work was to determine how neural activity in the PFC guides the decision to drink. Towards this goal, the within-session changes in neural activity were measured from medial PFC (mPFC) of rats performing a drinking procedure that allowed them to consume or abstain from alcohol in a self-paced manner. Recordings were obtained from rats that either lacked or expressed an innate risk for excessive alcohol intake, Wistar or alcohol-preferring (P) rats, respectively. Wistar rats exhibited patterns of neural activity consistent with the intention to drink or abstain from drinking, whereas these patterns were blunted or absent in P rats. Collectively, these data indicate that neural activity patterns in mPFC associated with the intention to drink alcohol are influenced by innate risk for excessive alcohol drinking. This observation may indicate a lack of control over the decision to drink by this otherwise well-validated supervisory brain region.

A Normalization Circuit Underlying Coding of Spatial Attention in Primate Lateral Prefrontal Cortex

Lateral prefrontal cortex (LPFC) neurons signal the allocation of voluntary attention; however, the neural computations underlying this function remain unknown. To investigate this, we recorded from neuronal ensembles in the LPFC of two Macaca fascicularis performing a visuospatial attention task. LPFC neural responses to a single stimulus were normalized when additional stimuli/distracters appeared across the visual field and were well-characterized by an averaging computation. Deploying attention toward an individual stimulus surrounded by distracters shifted neural activity from an averaging regime toward a regime similar to that when the attended stimulus was presented in isolation (winner-take-all; WTA). However, attentional modulation is both qualitatively and quantitatively dependent on a neuron's visuospatial tuning. Our results show that during attentive vision, LPFC neuronal ensemble activity can be robustly read out by downstream areas to generate motor commands, and/or fed back into sensory areas to filter out distracter signals in favor of target signals.

Decoding of intended saccade direction in an oculomotor brain-computer interface

OBJECTIVE

To date, invasive brain-computer interface (BCI) research has largely focused on replacing lost limb functions using signals from the hand/arm areas of motor cortex. However, the oculomotor system may be better suited to BCI applications involving rapid serial selection from spatial targets, such as choosing from a set of possible words displayed on a computer screen in an augmentative and alternative communication (AAC) application. Here we aimed to demonstrate the feasibility of a BCI utilizing the oculomotor system.

APPROACH

We developed a chronic intracortical BCI in monkeys to decode intended saccadic eye movement direction using activity from multiple frontal cortical areas.

MAIN RESULTS

Intended saccade direction could be decoded in real time with high accuracy, particularly at contralateral locations. Accurate decoding was evident even at the beginning of the BCI session; no extensive BCI experience was necessary. High-frequency (80-500 Hz) local field potential magnitude provided the best performance, even over spiking activity, thus simplifying future BCI applications. Most of the information came from the frontal and supplementary eye fields, with relatively little contribution from dorsolateral prefrontal cortex.

SIGNIFICANCE

Our results support the feasibility of high-accuracy intracortical oculomotor BCIs that require little or no practice to operate and may be ideally suited for 'point and click' computer operation as used in most current AAC systems.

Motor Intention/Intentionality and Associationism - A conceptual review

Motor intention/intentionality (MI) has been investigated from many different angles. Some researchers focus on the purely physical and mechanical aspects of the human motor system, while others emphasize the subjectivity involved in intentionality. While bridging this seemingly dualistic gap between the two concepts ought to be the researcher's' main task, different schools of thought have instead specialized in stressing one (objective) or the other (subjective) part of this construct. Thus, we find everything from neuroscientific to phenomenologically inspired approaches to MI. The purpose of this article is to review the literature regarding these different approaches to the MI construct. In reviewing the literature, we introduce a broadened conception of associationism. In organizing our data in relation to the laws of association, a lack of methodology clearly manifests itself. Hence, 123 articles out of 143 meet the criteria of our definition of associationism. It seems that this old doctrine sneaks in to a big part of the research rather implicitly through a lack of methodology. To shed light on how this happens in the 123 articles, we develop a continuum to show to which extend associationism operates on a transcendent or substantial level in each article. We find only very few articles that seem to try to gap the bridge between motor and intention/intentionality, and thus we suggest that future MI research reintroduce methodological debates concerning the conceptual character of this construct.

Electrical stimulation of macaque lateral prefrontal cortex modulates oculomotor behavior indicative of a disruption of top-down attention

The lateral prefrontal cortex (lPFC) of primates is hypothesized to be heavily involved in decision-making and selective visual attention. Recent neurophysiological evidence suggests that information necessary for an orchestration of those high-level cognitive factors are indeed represented in the lPFC. However, we know little about the specific contribution of sub-networks within lPFC to the deployment of top-down influences that can be measured in extrastriate visual cortex. Here, we systematically applied electrical stimulations to areas 8Av and 45 of two macaque monkeys performing a concurrent goal-directed saccade task. Despite using currents well above saccadic thresholds of the directly adjacent Frontal Eye Fields (FEF), saccades were only rarely evoked by the stimulation. Instead, two types of behavioral effects were observed: Stimulations of caudal sites in 8Av (close to FEF) shortened or prolonged saccadic reaction times, depending on the task-instructed saccade, while rostral stimulations of 8Av/45 seem to affect the relative attentional weighting of saccade targets as well as saccadic reaction times. These results illuminate important differences in the causal involvement of different sub-networks within the lPFC and are most compatible with a stimulation-induced biasing of stimulus processing that accelerates the detection of saccade targets presented ipsilateral to stimulation through a disruption of contralaterally deployed top-down attention.

Decoding subjective decisions from orbitofrontal cortex

When making a subjective choice, the brain must compute a value for each option and compare those values to make a decision. The orbitofrontal cortex (OFC) is critically involved in this process, but the neural mechanisms remain obscure, in part due to limitations in our ability to measure and control the internal deliberations that can alter the dynamics of the decision process. Here, we tracked the dynamics by recovering temporally precise neural states from multi-dimensional data in OFC. During individual choices, OFC alternated between states associated with the value of two available options, with dynamics that predicted whether a subject would decide quickly or vacillate between the two alternatives. Ensembles of value-encoding neurons contributed to these states, with individual neurons shifting activity patterns as the network evaluated each option. Thus, the mechanism of subjective decision-making involves the dynamic activation of OFC states associated with each choice alternative.