Spike Timing in the Attention Network Predicts Behavioral Outcome Prior to Target Selection

Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space

Primates exploring and exploiting a continuous sensorimotor space rely on dynamic maps in the dorsal stream. Two complementary perspectives exist on how these maps encode rewards. Reinforcement learning models integrate rewards incrementally over time, efficiently resolving the exploration/exploitation dilemma. Working memory buffer models explain rapid plasticity of parietal maps but lack a plausible exploration/exploitation policy. The reinforcement learning model presented here unifies both accounts, enabling rapid, information-compressing map updates and efficient transition from exploration to exploitation. As predicted by our model, activity in human frontoparietal dorsal stream regions, but not in MT+, tracks the number of competing options, as preferred options are selectively maintained on the map, while spatiotemporally distant alternatives are compressed out. When valuable new options are uncovered, posterior β1/α oscillations desynchronize within 0.4 to 0.7 s, consistent with option encoding by competing β1-stabilized subpopulations. Together, outcomes matching locally cached reward representations rapidly update parietal maps, biasing choices toward often-sampled, rewarded options.

Phase of neural oscillations as a reference frame for attention-based routing in visual cortex

Selective attention allows the brain to efficiently process the image projected onto the retina, selectively focusing neural processing resources on behaviorally relevant visual information. While previous studies have documented the crucial role of the action potential rate of single neurons in relaying such information, little is known about how the activity of single neurons relative to their neighboring network contributes to the efficient representation of attended stimuli and transmission of this information to downstream areas. Here, we show in the dorsal visual pathway of monkeys (medial superior temporal area) that neurons fire spikes preferentially at a specific phase of the ongoing population beta (∼20 Hz) oscillations of the surrounding local network. This preferred spiking phase shifts towards a later phase when monkeys selectively attend towards (rather than away from) the receptive field of the neuron. This shift of the locking phase is positively correlated with the speed at which animals report a visual change. Furthermore, our computational modeling suggests that neural networks can manipulate the preferred phase of coupling by imposing differential synaptic delays on postsynaptic potentials. This distinction between the locking phase of neurons activated by the spatially attended stimulus vs. that of neurons activated by the unattended stimulus, may enable the neural system to discriminate relevant from irrelevant sensory inputs and consequently filter out distracting stimuli information by aligning the spikes which convey relevant/irrelevant information to distinct phases linked to periods of better/worse perceptual sensitivity for higher cortices. This strategy may be used to reserve the narrow windows of highest perceptual efficacy to the processing of the most behaviorally relevant information, ensuring highly efficient responses to attended sensory events.

Enhanced behavioral performance through interareal gamma and beta synchronization

Cognitive functioning requires coordination between brain areas. Between visual areas, feedforward gamma synchronization improves behavioral performance. Here, we investigate whether similar principles hold across brain regions and frequency bands, using simultaneous electrocorticographic recordings from 15 areas of two macaque monkeys during performance of a selective attention task. Short behavioral reaction times (RTs), suggesting efficient interareal communication, occurred when occipital areas V1, V2, V4, and DP showed gamma synchronization, and fronto-central areas S1, 5, F1, F2, and F4 showed beta synchronization. For both area clusters and corresponding frequency bands, deviations from the typically observed phase relations increased RTs. Across clusters and frequency bands, good phase relations occurred in a correlated manner specifically when they processed the behaviorally relevant stimulus. Furthermore, the fronto-central cluster exerted a beta-band influence onto the occipital cluster whose strength predicted short RTs. These results suggest that local gamma and beta synchronization and their inter-regional coordination jointly improve behavioral performance.

Top-down control of exogenous attentional selection is mediated by beta coherence in prefrontal cortex

Salience-driven exogenous and goal-driven endogenous attentional selection are two distinct forms of attention that guide selection of task-irrelevant and task-relevant targets in primates. Top-down attentional control mechanisms enable selection of the task-relevant target by limiting the influence of sensory information. Although the lateral prefrontal cortex (LPFC) is known to mediate top-down control, the neuronal mechanisms of top-down control of attentional selection are poorly understood. Here, we trained two rhesus monkeys on a two-target, free-choice luminance-reward selection task. We demonstrate that visual-movement (VM) neurons and nonvisual neurons or movement neurons encode exogenous and endogenous selection. We then show that coherent beta activity selectively modulates mechanisms of exogenous selection specifically during conflict and consequently may support top-down control. These results reveal the VM-neuron-specific network mechanisms of attentional selection and suggest a functional role for beta-frequency coherent neural dynamics in the modulation of sensory communication channels for the top-down control of attentional selection.

Propofol-mediated loss of consciousness disrupts predictive routing and local field phase modulation of neural activity

Predictive coding is a fundamental function of the cortex. The predictive routing model proposes a neurophysiological implementation for predictive coding. Predictions are fed back from deep-layer cortex via alpha/beta (8-30Hz) oscillations. They inhibit the gamma (40-100Hz) and spiking that feed sensory inputs forward. Unpredicted inputs arrive in circuits unprepared by alpha/beta, resulting in enhanced gamma and spiking. To test the predictive routing model and its role in consciousness, we collected data from intracranial recordings of macaque monkeys during passive presentation of auditory oddballs (e.g., AAAAB) before and after propofol-mediated loss of consciousness (LOC). In line with the predictive routing model, alpha/beta oscillations in the awake state served to inhibit the processing of predictable stimuli. Propofol-mediated LOC eliminated alpha/beta modulation by a predictable stimulus in sensory cortex and alpha/beta coherence between sensory and frontal areas. As a result, oddball stimuli evoked enhanced gamma power, late (> 200 ms from stimulus onset) period spiking, and superficial layer sinks in sensory cortex. Therefore, auditory cortex was in a disinhibited state during propofol-mediated LOC. However, despite these enhanced feedforward responses in auditory cortex, there was a loss of differential spiking to oddballs in higher order cortex. This may be a consequence of a loss of within-area and inter-area spike-field coupling in the alpha/beta and gamma frequency bands. These results provide strong constraints for current theories of consciousness.

Significance statement

Neurophysiology studies have found alpha/beta oscillations (8-30Hz), gamma oscillations (40-100Hz), and spiking activity during cognition. Alpha/beta power has an inverse relationship with gamma power/spiking. This inverse relationship suggests that gamma/spiking are under the inhibitory control of alpha/beta. The predictive routing model hypothesizes that alpha/beta oscillations selectively inhibit (and thereby control) cortical activity that is predictable. We tested whether this inhibitory control is a signature of consciousness. We used multi-area neurophysiology recordings in monkeys presented with tone sequences that varied in predictability. We recorded brain activity as the anesthetic propofol was administered to manipulate consciousness. Compared to conscious processing, propofol-mediated unconsciousness disrupted alpha/beta inhibitory control during predictive processing. This led to a disinhibition of gamma/spiking, consistent with the predictive routing model.

A recruitment through coherence theory of working memory

The interactions between prefrontal cortex and other areas during working memory have been studied for decades. Here we outline a conceptual framework describing interactions between these areas during working memory, and review evidence for key elements of this model. We specifically suggest that a top-down signal sent from prefrontal to sensory areas drives oscillations in these areas. Spike timing within sensory areas becomes locked to these working-memory-driven oscillations, and the phase of spiking conveys information about the representation available within these areas. Downstream areas receiving these phase-locked spikes from sensory areas can recover this information via a combination of coherent oscillations and gating of input efficacy based on the phase of their local oscillations. Although the conceptual framework is based on prefrontal interactions with sensory areas during working memory, we also discuss the broader implications of this framework for flexible communication between brain areas in general.

Spike rates of frontal eye field neurons predict reaction times in a spatial attention task

Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.

Dynamic attention signalling in V4: Relation to fast-spiking/non-fast-spiking cell class and population coupling

The computational role of a neuron during attention depends on its firing properties, neurotransmitter expression and functional connectivity. Neurons in the visual cortical area V4 are reliably engaged by selective attention but exhibit diversity in the effect of attention on firing rates and correlated variability. It remains unclear what specific neuronal properties shape these attention effects. In this study, we quantitatively characterised the distribution of attention modulation of firing rates across populations of V4 neurons. Neurons exhibited a continuum of time-varying attention effects. At one end of the continuum, neurons' spontaneous firing rates were slightly depressed with attention (compared to when unattended), whereas their stimulus responses were enhanced with attention. The other end of the continuum showed the converse pattern: attention depressed stimulus responses but increased spontaneous activity. We tested whether the particular pattern of time-varying attention effects that a neuron exhibited was related to the shape of their actions potentials (so-called 'fast-spiking' [FS] neurons have been linked to inhibition) and the strength of their coupling to the overall population. We found an interdependence among neural attention effects, neuron type and population coupling. In particular, we found neurons for which attention enhanced spontaneous activity but suppressed stimulus responses were less likely to be fast-spiking (more likely to be non-fast-spiking) and tended to have stronger population coupling, compared to neurons with other types of attention effects. These results add important information to our understanding of visual attention circuits at the cellular level.

Locus coeruleus and dorsal cingulate morphology contributions to slowed processing speed

Slowed information processing speed is a defining feature of cognitive aging. Nucleus locus coeruleus (LC) and medial prefrontal regions are targets for understanding slowed processing speed because these brain regions influence neural and behavioral response latencies through their roles in optimizing task performance. Although structural measures of medial prefrontal cortex have been consistently related to processing speed, it is unclear if 1) declines in LC structure underlie this association because of reciprocal connections between LC and medial prefrontal cortex, or 2) if LC declines provide a separate explanation for age-related changes in processing speed. LC and medial prefrontal structural measures were predicted to explain age-dependent individual differences in processing speed in a cross-sectional sample of 43 adults (19-79 years; 63% female). Higher turbo-spin echo LC contrast, based on a persistent homology measure, and greater dorsal cingulate cortical thickness were significantly and each uniquely related to faster processing speed. However, only dorsal cingulate cortical thickness appeared to statistically mediate age-related differences in processing speed. The results suggest that individual differences in cognitive processing speed can be attributed, in part, to structural variation in nucleus LC and medial prefrontal cortex, with the latter key to understanding why older adults exhibit slowed processing speed.

Top-down control of exogenous attentional selection is mediated by beta coherence in prefrontal cortex

Salience-driven exogenous and goal-driven endogenous attentional selection are two distinct forms of attention that guide selection of task-irrelevant and task-relevant targets in primates. During conflict i.e, when salience and goal each favor the selection of different targets, endogenous selection of the task-relevant target relies on top-down control. Top-down attentional control mechanisms enable selection of the task-relevant target by limiting the influence of sensory information. Although the lateral prefrontal cortex (LPFC) is known to mediate top-down control, the neuronal mechanisms of top-down control of attentional selection are poorly understood. Here, using a two-target free-choice luminance-reward selection task, we demonstrate that visual-movement neurons and not visual neurons or movement neurons encode exogenous and endogenous selection. We then show that coherent-beta activity selectively modulates mechanisms of exogenous selection specifically during conflict and consequently may support top-down control. These results reveal the VM-neuron-specific network mechanisms of attentional selection and suggest a functional role for beta-frequency coherent neural dynamics in the modulation of sensory communication channels for the top-down control of attentional selection.

Spatiotemporal dynamics in large-scale cortical networks

Investigating links between nervous system function and behavior requires monitoring neuronal activity at a range of spatial and temporal scales. Here, we summarize recent progress in applying two distinct but complementary approaches to the study of network dynamics in the neocortex. Mesoscopic calcium imaging allows simultaneous monitoring of activity across most of the cortex at moderate spatiotemporal resolution. Electrophysiological recordings provide extremely high temporal resolution of neural signals at multiple targeted locations. A number of recent studies have used these tools to reveal novel patterns of activity across distributed cortical subnetworks. This growing body of work strongly supports the hypothesis that the dynamic coordination of spatially distinct regions is a fundamental aspect of cortical function that supports cognition and behavior.

There Is More Evidence of Rhythmic Attention than Can Be Found in Behavioral Studies: Perspective on Brookshire, 2022

Recent research indicates periodicity in attention-related sampling and switching, with some of the initial findings coming from behavioral studies. Brookshire [Brookshire, G. Putative rhythms in attentional switching can be explained by aperiodic temporal structure. Nature Human Behaviour, 2022, https://doi.org/10.1038/s41562-022-01364-0], points out that widely used approaches to testing for rhythms in behavioral times series can misclassify consistent aperiodic patterns in temporal structure as periodic patterns. Evidence for rhythmic attention, however, is not limited to behavioral data. Here, I briefly discuss (i) issues with differentiating periodic and aperiodic structure in both behavioral and neural time series, (ii) findings from neural data that are consistent with rhythmic sampling and switching during attentional deployment, and (iii) whether alternative approaches to establishing periodicity in behavioral time series, recommended by Brookshire are appropriate for this particular research topic.

Reclaiming saliency: Rhythmic precision-modulated action and perception

Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated causes. However, they fail to consider the circular causality between perception and action. In other words, they do not consider where to sample next, given current beliefs. Here, we reclaim salience as an active inference process that relies on two basic principles: uncertainty minimization and rhythmic scheduling. For this, we make a distinction between attention and salience. Briefly, we associate attention with precision control, i.e., the confidence with which beliefs can be updated given sampled sensory data, and salience with uncertainty minimization that underwrites the selection of future sensory data. Using this, we propose a new account of attention based on rhythmic precision-modulation and discuss its potential in robotics, providing numerical experiments that showcase its advantages for state and noise estimation, system identification and action selection for informative path planning.

Cyclic reactivation of distinct feature dimensions in human visual working memory

Several recent behavioral studies have observed 4-10 Hz rhythmic fluctuations in attention-related performance over time. So far, this rhythmic attentional sampling has predominantly been demonstrated with regards to external visual attention, directed toward one single feature dimension. Whether and how attention might sample from concurrent internal representations of different feature dimensions held in working memory (WM) is currently largely unknown. To elucidate this issue, we conducted a human behavioral dense-sampling experiment, in which participants had to hold representations of two distinct feature dimensions (color and orientation) in WM. By querying the contents of WM at 72 time-points after encoding, we estimated the activity time course of the individual feature representations. Our results demonstrate an oscillatory component at 9.4 Hz in the joint time courses of both representations, presumably reflecting a common early perceptual sampling process in the alpha-frequency range. Furthermore, we observed an oscillatory component at 3.5 Hz in the time course difference between the two representations. This likely corresponds to a later attentional sampling process and indicates that internal representations of distinct features are activated in alteration. In summary, we demonstrate the cyclic reactivation of internal WM representations of distinct feature dimensions, as well as the co-occurrence of behavioral fluctuations at distinct frequencies, presumably associated to internal perceptual- and attentional rhythms. In addition, our findings also challenge a model of strict parallel processing in visual search, thus, providing novel input to the ongoing debate on whether search for more than one target feature constitutes a parallel- or a sequential mechanism.

Pop-out search instigates beta-gated feature selectivity enhancement across V4 layers

Visual search is a workhorse for investigating how attention interacts with processing of sensory information. Attentional selection has been linked to altered cortical sensory responses and feature preferences (i.e., tuning). However, attentional modulation of feature selectivity during search is largely unexplored. Here we map the spatiotemporal profile of feature selectivity during singleton search. Monkeys performed a search where a pop-out feature determined the target of attention. We recorded laminar neural responses from visual area V4. We first identified "feature columns" which showed preference for individual colors. In the unattended condition, feature columns were significantly more selective in superficial relative to middle and deep layers. Attending a stimulus increased selectivity in all layers but not equally. Feature selectivity increased most in the deep layers, leading to higher selectivity in extragranular layers as compared to the middle layer. This attention-induced enhancement was rhythmically gated in phase with the beta-band local field potential. Beta power dominated both extragranular laminar compartments, but current source density analysis pointed to an origin in superficial layers, specifically. While beta-band power was present regardless of attentional state, feature selectivity was only gated by beta in the attended condition. Neither the beta oscillation nor its gating of feature selectivity varied with microsaccade production. Importantly, beta modulation of neural activity predicted response times, suggesting a direct link between attentional gating and behavioral output. Together, these findings suggest beta-range synaptic activation in V4's superficial layers rhythmically gates attentional enhancement of feature tuning in a way that affects the speed of attentional selection.

Global, Low-Amplitude Cortical State Predicts Response Outcomes in a Selective Detection Task in Mice

Spontaneous neuronal activity strongly impacts stimulus encoding and behavioral responses. We sought to determine the effects of neocortical prestimulus activity on stimulus detection. We trained mice in a selective whisker detection task, in which they learned to respond (lick) to target stimuli in one whisker field and ignore distractor stimuli in the contralateral whisker field. During expert task performance, we used widefield Ca2+ imaging to assess prestimulus and post-stimulus neuronal activity broadly across frontal and parietal cortices. We found that lower prestimulus activity correlated with enhanced stimulus detection: lower prestimulus activity predicted response versus no response outcomes and faster reaction times. The activity predictive of trial outcome was distributed through dorsal neocortex, rather than being restricted to whisker or licking regions. Using principal component analysis, we demonstrate that response trials are associated with a distinct and less variable prestimulus neuronal subspace. For single units, prestimulus choice probability was weak yet distributed broadly, with lower than chance choice probability correlating with stronger sensory and motor encoding. These findings support low amplitude and low variability as an optimal prestimulus cortical state for stimulus detection that presents globally and predicts response outcomes for both target and distractor stimuli.

Differential Contributions of Inhibitory Subnetwork to Visual Cortical Modulations Identified via Computational Model of Working Memory

Extrastriate visual neurons show no firing rate change during a working memory (WM) task in the absence of sensory input, but both αβ oscillations and spike phase locking are enhanced, as is the gain of sensory responses. This lack of change in firing rate is at odds with many models of WM, or attentional modulation of sensory networks. In this article we devised a computational model in which this constellation of results can be accounted for via selective activation of inhibitory subnetworks by a top-down working memory signal. We confirmed the model prediction of selective inhibitory activation by segmenting cells in the experimental neural data into putative excitatory and inhibitory cells. We further found that this inhibitory activation plays a dual role in influencing excitatory cells: it both modulates the inhibitory tone of the network, which underlies the enhanced sensory gain, and also produces strong spike-phase entrainment to emergent network oscillations. Using a phase oscillator model we were able to show that inhibitory tone is principally modulated through inhibitory network gain saturation, while the phase-dependent efficacy of inhibitory currents drives the phase locking modulation. The dual contributions of the inhibitory subnetwork to oscillatory and non-oscillatory modulations of neural activity provides two distinct ways for WM to recruit sensory areas, and has relevance to theories of cortical communication.

Coupling between the phase of a neural oscillation or bodily rhythm with behavior: Evaluation of different statistical procedures

•

Circular tests are differentially sensitive to different coupling modes.

•

The Watson test is a good all-rounder method.

•

Phase Opposition Sum is robust to imbalances in relative trial number.

•

Modulation Index detects more complex phase-behavior relationships.

Growing experimental evidence points at relationships between the phase of a cortical or bodily oscillation and behavior, using various circular statistical tests. Here, we systematically compare the performance (sensitivity, False Positive rate) of four circular statistical tests (some commonly used, i.e. Phase Opposition Sum, Circular Logistic Regression, others less common, i.e., Watson test, Modulation Index). We created semi-artificial datasets mimicking real two-alternative forced choice experiments with 30 participants, where we imposed a link between a simulated binary behavioral outcome with the phase of a physiological oscillation. We systematically varied the strength of phase-outcome coupling, the coupling mode (1:1 to 4:1), the overall number of trials and the relative number of trials in the two outcome conditions. We evaluated different strategies to estimate phase-outcome coupling chance level, as well as significance at the individual or group level. The results show that the Watson test, although seldom used in the experimental literature, is an excellent first intention test, with a good sensitivity and low False Positive rate, some sensitivity to 2:1 coupling mode and low computational load. Modulation Index, initially designed for continuous variables but that we find useful to estimate coupling between phase and a binary outcome, should be preferred if coupling mode is higher than 2:1. Phase Opposition Sum, coupled with a resampling procedure, is the only test retaining a good sensitivity in the case of a large unbalance in the number of occurrences of the two behavioral outcomes.

Translating Expectation into Visual Selection through a Beta-Synchronous Fronto-Parietal Neural Subnetwork

Top-down expectancy critically determines how fast sensory inputs are processed. Fiebelkorn & Kastner show that translating expectancy into fast stimulus processing is mediated by a subnetwork of beta-synchronized neurons across the fronto-parietal attention network. This finding suggests that precise spike timing determines how efficient fronto-parietal activity selects visual inputs.