Spatial Attention and Temporal Expectation Under Timed Uncertainty Predictably Modulate Neuronal Responses in Monkey V1

Locus coeruleus norepinephrine contributes to visual-spatial attention by selectively enhancing perceptual sensitivity

Selectively focusing on a behaviorally relevant stimulus while ignoring irrelevant stimuli improves perception. Enhanced neuronal response gain is thought to support attention-related improvements in detection and discrimination. However, understanding of the neuronal pathways regulating perceptual sensitivity remains limited. Here, we report that responses of norepinephrine (NE) neurons in the locus coeruleus (LC) of non-human primates to behaviorally relevant sensory stimuli promote visual discrimination in a spatially selective way. LC-NE neurons spike in response to a visual stimulus appearing in the contralateral hemifield only when that stimulus is attended. This spiking is associated with enhanced behavioral sensitivity, is independent of motor control, and is absent on error trials. Furthermore, optogenetically activating LC-NE neurons selectively improves monkeys' contralateral stimulus detection without affecting motor criteria, supporting NE's causal role in granular cognitive control of selective attention at a cellular level, beyond its known diffuse and non-selective functions.

Rapid emergence of latent knowledge in the sensory cortex drives learning

Rapid learning confers significant advantages to animals in ecological environments. Despite the need for speed, animals appear to only slowly learn to associate rewarded actions with predictive cues1-4. This slow learning is thought to be supported by a gradual expansion of predictive cue representation in the sensory cortex2,5. However, evidence is growing that animals learn more rapidly than classical performance measures suggest6-8, challenging the prevailing model of sensory cortical plasticity. Here, we investigated the relationship between learning and sensory cortical representations. We trained mice on an auditory go/no-go task that dissociated the rapid acquisition of task contingencies (learning) from its slower expression (performance)7. Optogenetic silencing demonstrated that the auditory cortex (AC) drives both rapid learning and slower performance gains but becomes dispensable at expert. Rather than enhancement or expansion of cue representations9, two-photon calcium imaging of AC excitatory neurons throughout learning revealed two higher-order signals that were causal to learning and performance. First, a reward prediction (RP) signal emerged rapidly within tens of trials, was present after action-related errors only early in training, and faded at expert levels. Strikingly, silencing at the time of the RP signal impaired rapid learning, suggesting it serves an associative and teaching role. Second, a distinct cell ensemble encoded and controlled licking suppression that drove the slower performance improvements. These two ensembles were spatially clustered but uncoupled from underlying sensory representations, indicating a higher-order functional segregation within AC. Our results reveal that the sensory cortex manifests higher-order computations that separably drive rapid learning and slower performance improvements, reshaping our understanding of the fundamental role of the sensory cortex.

Spike rates of frontal eye field neurons predict reaction times in a spatial attention task

Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

Suppression of top-down influence decreases both behavioral and V1 neuronal response sensitivity to stimulus orientations in cats

How top-down influence affects behavioral detection of visual signals and neuronal response sensitivity in the primary visual cortex (V1) remains poorly understood. This study examined both behavioral performance in stimulus orientation identification and neuronal response sensitivity to stimulus orientations in the V1 of cat before and after top-down influence of area 7 (A7) was modulated by non-invasive transcranial direct current stimulation (tDCS). Our results showed that cathode (c) but not sham (s) tDCS in A7 significantly increased the behavioral threshold in identifying stimulus orientation difference, which effect recovered after the tDCS effect vanished. Consistently, c-tDCS but not s-tDCS in A7 significantly decreased the response selectivity bias of V1 neurons for stimulus orientations, which effect could recover after withdrawal of the tDCS effect. Further analysis showed that c-tDCS induced reduction of V1 neurons in response selectivity was not resulted from alterations of neuronal preferred orientation, nor of spontaneous activity. Instead, c-tDCS in A7 significantly lowered the visually-evoked response, especially the maximum response of V1 neurons, which caused a decrease in response selectivity and signal-to-noise ratio. By contrast, s-tDCS exerted no significant effect on the responses of V1 neurons. These results indicate that top-down influence of A7 may enhance behavioral identification of stimulus orientations by increasing neuronal visually-evoked response and response selectivity in the V1.

The effect of temporal expectation on the correlations of frontal neural activity with alpha oscillation and sensory-motor latency

In a dynamic environment, we seek to enhance behavioral responses by anticipating future events. Previous studies have shown that the probability distribution of the timing of future events could shape our expectation of event timing; furthermore, the modulation of alpha oscillation is known to be a critical neural factor. However, a link between the modulation of alpha oscillation by temporal expectation and single neural activity is missing. In this study, we investigated how temporal expectation modulated frontal neural activities and behavioral reaction time by recording neural activity from the frontal eye field smooth pursuit eye movement region of monkeys while they performed a smooth pursuit eye movement task. We found that the temporal expectation reduced the coherence between the neural spiking and alpha frequency of the local field potential, along with the trial-by-trial correlation between the neural spiking activity and pursuit latency. This result suggests that the desynchronization of alpha oscillation by temporal expectation would be related to the decorrelation of population neural activity, which could be the neural source of reaction time enhancement by temporal expectation.

Two sources of uncertainty independently modulate temporal expectancy

The environment is shaped by two sources of temporal uncertainty: the discrete probability of whether an event will occur and-if it does-the continuous probability of when it will happen. These two types of uncertainty are fundamental to every form of anticipatory behavior including learning, decision-making, and motor planning. It remains unknown how the brain models the two uncertainty parameters and how they interact in anticipation. It is commonly assumed that the discrete probability of whether an event will occur has a fixed effect on event expectancy over time. In contrast, we first demonstrate that this pattern is highly dynamic and monotonically increases across time. Intriguingly, this behavior is independent of the continuous probability of when an event will occur. The effect of this continuous probability on anticipation is commonly proposed to be driven by the hazard rate (HR) of events. We next show that the HR fails to account for behavior and propose a model of event expectancy based on the probability density function of events. Our results hold for both vision and audition, suggesting independence of the representation of the two uncertainties from sensory input modality. These findings enrich the understanding of fundamental anticipatory processes and have provocative implications for many aspects of behavior and its neural underpinnings.

No Evidence that Predictions and Attention Modulate the First Feedforward Sweep of Cortical Information Processing

Predictive coding models propose that predictions (stimulus likelihood) reduce sensory signals as early as primary visual cortex (V1), and that attention (stimulus relevance) can modulate these effects. Indeed, both prediction and attention have been shown to modulate V1 activity, albeit with fMRI, which has low temporal resolution. This leaves it unclear whether these effects reflect a modulation of the first feedforward sweep of visual information processing and/or later, feedback-related activity. In two experiments, we used electroencephalography and orthogonally manipulated spatial predictions and attention to address this issue. Although clear top-down biases were found, as reflected in pre-stimulus alpha-band activity, we found no evidence for top-down effects on the earliest visual cortical processing stage (<80 ms post-stimulus), as indexed by the amplitude of the C1 event-related potential component and multivariate pattern analyses. These findings indicate that initial visual afferent activity may be impenetrable to top-down influences by spatial prediction and attention.

Dissociating cholinergic influence on alertness and temporal attention in primates in a simple reaction time paradigm

The ability to promptly respond to behaviourally relevant events depends on both general alertness and phasic changes in attentional state driven by temporal expectations. Using a variable foreperiod simple reaction time (RT) task in four adult male rhesus macaques, we investigated the role of the cholinergic system in alertness and temporal expectation. Foreperiod effects on RT reflect temporal expectation, while alertness is quantified as overall response speed. We measured these RT parameters under vehicle treatment and systemic administration of the muscarinic receptor antagonist scopolamine. We also investigated whether and to what extent the effects of scopolamine were reversed by donepezil, a cholinesterase inhibitor widely used for the treatment of dementia. In the control condition, RT showed a continuous decrease as the foreperiod duration increased, which clearly indicated the effect of temporal expectation on RT. This foreperiod effect was mainly detectable on the faster tail of the RT distribution and was eliminated by scopolamine. Furthermore, scopolamine treatment slowed down the average RT. Donepezil treatment was efficient on the slower tail of the RT distribution and improved scopolamine-induced impairments only on the average RT reflecting a general beneficial effect on alertness without any improvement in temporal expectation. The present results highlight the role of the cholinergic system in temporal expectation and alertness in primates and help delineate the efficacy and scope of donepezil and other cholinomimetic agents as cognitive enhancers in present and future clinical practice.

Sustained Visual Priming Effects Can Emerge from Attentional Oscillation and Temporal Expectation

Priming refers to the influence that a previously encountered object exerts on future responses to similar objects. For many years, visual priming has been known as a facilitation and sometimes an inhibition effect that lasts for an extended period of time. It contrasts with the recent finding of an oscillated priming effect where facilitation and inhibition alternate over time periodically. Here we developed a computational model of visual priming that combines rhythmic sampling of the environment (attentional oscillation) with active preparation for future events (temporal expectation). Counterintuitively, it shows that both the sustained and oscillated priming effects can emerge from an interaction between attentional oscillation and temporal expectation. The interaction also leads to novel predictions, such as the change of visual priming effects with temporal expectation and attentional oscillation. Reanalysis of two published datasets and the results of two new experiments of visual priming tasks with male and female human participants provide support for the model's relevance to human behavior. More generally, our model offers a new perspective that may unify the increasing findings of behavioral and neural oscillations with the classic findings in visual perception and attention.

SIGNIFICANCE STATEMENT There is increasing behavioral and neural evidence that visual attention is a periodic process that sequentially samples different alternatives in the theta frequency range. It contrasts with the classic findings of sustained facilitatory or inhibitory attention effects. How can an oscillatory perceptual process give rise to sustained attention effects? Here we make this connection by proposing a computational model for a “fruit fly” visual priming task and showing both the sustained and oscillated priming effects can have the same origin: an interaction between rhythmic sampling of the environment and active preparation for future events. One unique contribution of our model is to predict how temporal contexts affects priming. It also opens up the possibility of reinterpreting other attention-related classic phenomena.

The anticipation of events in time

Humans anticipate events signaled by sensory cues. It is commonly assumed that two uncertainty parameters modulate the brain's capacity to predict: the hazard rate (HR) of event probability and the uncertainty in time estimation which increases with elapsed time. We investigate both assumptions by presenting event probability density functions (PDFs) in each of three sensory modalities. We show that perceptual systems use the reciprocal PDF and not the HR to model event probability density. We also demonstrate that temporal uncertainty does not necessarily grow with elapsed time but can also diminish, depending on the event PDF. Previous research identified neuronal activity related to event probability in multiple levels of the cortical hierarchy (sensory (V4), association (LIP), motor and other areas) proposing the HR as an elementary neuronal computation. Our results-consistent across vision, audition, and somatosensation-suggest that the neurobiological implementation of event anticipation is based on a different, simpler and more stable computation than HR: the reciprocal PDF of events in time.

Temporal cueing enhances neuronal and behavioral discrimination performance in rat whisker system

Since sensory systems operate with a finite quantity of processing resources, an animal would benefit from prioritizing processing of sensory stimuli within a time window that is expected to provide key information. This behavioral manifestation of such prioritization is known as attention. Here, we investigate attention with temporal cueing and its neuronal correlates in the rat primary vibrissal somatosensory (vS1) cortex. Rats were trained in a simple whisker vibration detection task. A vibration was presented at one of two spatial locations (left or right), sometimes after an unknown time interval and sometimes after receiving an auditory cue. The auditory cue provided temporal but not spatial information about the vibration. We found that for all rats ( n = 6), the auditory cue consistently enhanced detection of the vibration stimulus. Neuronal activity in vS1 cortex reflected the observed behavioral enhancement from temporal cueing with single units responded differentially to the whisker vibration stimulus when it was temporally predicted by the auditory cue, exhibiting an enhanced signal-to-noise ratio. Our findings indicate that rats are capable of prioritizing processing within a specified time window and provide evidence that the primary sensory cortex may participate in the temporal allocation of resources.

NEW & NOTEWORTHY We demonstrate a novel paradigm of temporal cueing in rats. In a two-alternative whisker detection task, an auditory cue provided information about the timing of the stimulus but not the correct choice. In the presence of cue, detection was faster and more accurate, and neuronal activity from the primary somatosensory cortex revealed enhanced representation of vibrations. These results thus establish the rat as an alternative model organism to primates for studying temporal attention.

Directing Voluntary Temporal Attention Increases Fixational Stability

Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

The Timing of Reward-Seeking Action Tracks Visually Cued Theta Oscillations in Primary Visual Cortex

An emerging body of work challenges the view that primary visual cortex (V1) represents the visual world faithfully. Theta oscillations in the local field potential (LFP) of V1 have been found to convey temporal expectations and, specifically, to express the delay between a visual stimulus and the reward that it portends. We extend this work by showing how these oscillatory states in male, wild-type rats can even relate to the timing of a visually cued reward-seeking behavior. In particular, we show that, with training, high precision and accuracy in behavioral timing tracks the power of these oscillations and the time of action execution covaries with their duration. These LFP oscillations are also intimately related to spiking responses at the single-unit level, which themselves carry predictive timing information. Together, these observations extend our understanding of the role of cortical oscillations in timing generally and the role of V1 in the timing of visually cued behaviors specifically.SIGNIFICANCE STATEMENT Traditionally, primary visual cortex (V1) has been regarded as playing a purely perceptual role in stimulus-driven behaviors. Recent work has challenged that view by showing that theta oscillations in rodent V1 may come to convey timed expectations. Here, we show that these theta oscillations carry predictive information about timed reward-seeking actions, thus elucidating a behavioral role for theta oscillations in V1 and extending our understanding of the role of V1 in decision making.

A Trial-by-Trial Window into Sensorimotor Transformations in the Human Motor Periphery

The appearance of a novel visual stimulus generates a rapid stimulus-locked response (SLR) in the motor periphery within 100 ms of stimulus onset. Here, we recorded SLRs from an upper limb muscle while humans reached toward (pro-reach) or away (anti-reach) from a visual stimulus. The SLR on anti-reaches encoded the location of the visual stimulus rather than the movement goal. Further, SLR magnitude was attenuated when subjects reached away from rather than toward the visual stimulus. Remarkably, SLR magnitudes also correlated with reaction times on both pro-reaches and anti-reaches, but did so in opposite ways: larger SLRs preceded shorter latency pro-reaches but longer latency anti-reaches. Although converging evidence suggests that the SLR is relayed via a tectoreticulospinal pathway, our results show that task-related signals modulate visual signals feeding into this pathway. The SLR therefore provides a trial-by-trial window into how visual information is integrated with cognitive control in humans.

SIGNIFICANCE STATEMENT

The presentation of a visual stimulus elicits a trial-by-trial stimulus-locked response (SLR) on the human limb within 100 ms. Here, we show that the SLR continues to reflect stimulus location even when subjects move in the opposite direction (an anti-reach). Remarkably, the attenuation of SLR magnitude reflected the cognitive control required to generate a correct anti-reach, with greater degrees of attenuation preceding shorter-latency anti-reaches and no attenuation preceding error trials. Our results are strikingly similar to neurophysiological recordings in the superior colliculus of nonhuman primates generating anti-saccades, implicating the tectoreticulospinal pathway. Measuring SLR magnitude therefore provides an unprecedented trial-by-trial opportunity to assess the influence of cognitive control on the initial processing of a visual stimulus in humans.

Attentional Modulation of Neuronal Activity Depends on Neuronal Feature Selectivity

Attention exerts a powerful influence on visual perception. The impact of attention on neuronal activity manifests at early visual information processing stages and progressively increases throughout the visual cortical hierarchy. However, the neuronal mechanisms of attention are unresolved. In particular, the rules governing attentional modulation of individual neurons, whether they are facilitated by or suppressed by attention, are not known. To obtain a more granular or neuron- and circuit-level understanding of the mechanisms of attention and to directly test the feature similarity gain model in V1, we compared attentional modulation with neuronal feature selectivity across a large population of V1 neurons in alert and behaving macaque monkeys trained on an attention-demanding contrast-change detection task. We utilized emerging multi-electrode array technology to record simultaneously from V1 neurons spanning all six cortical layers so that we could characterize the laminar position and physiological response properties of diverse V1 neuronal populations. We found significant relationships between attentional modulation and neuronal position within the cortical hierarchy, neuronal physiology, and neuronal feature selectivity. Our results support the feature similarity gain model and further suggest that attentional modulation depends critically upon the match between neuronal feature selectivity and the features required for the task.

Does spatial attention modulate the earliest component of the visual evoked potential?

Whether visual spatial attention can modulate feedforward input to human primary visual cortex (V1) is debated. A prominent and long-standing hypothesis is that visual spatial attention can influence processing in V1, but only at delayed latencies suggesting a feedback-mediated mechanism and a lack of modulation during the initial afferent volley. The most promising challenge to this hypothesis comes from an event-related potential (ERP) study that showed an amplitude enhancement of the earliest visual ERP component, called the 'C1', in response to spatially attended relative to spatially unattended stimuli. In the Kelly et al. study, several important experimental design modifications were introduced, including tailoring the stimulus locations and recording electrodes to each individual subject. In the current study, we employed the same methodological procedures and tested for attentional enhancements of the C1 component in each quadrant of the visual field. Using the same analysis strategies as Kelly et al., we found no evidence for an attention-based modulation of the C1 (measured from 50-80 ms). Attention-based amplitude enhancements were clear and robust for the subsequent P1 component (90-140 ms). Thus, despite using methods specifically designed to reveal C1 attention effects, the current study provided no confirmatory evidence for such effects.

Dynamics of excitatory and inhibitory networks are differentially altered by selective attention

Inhibition and excitation form two fundamental modes of neuronal interaction, yet we understand relatively little about their distinct roles in service of perceptual and cognitive processes. We developed a multidimensional waveform analysis to identify fast-spiking (putative inhibitory) and regular-spiking (putative excitatory) neurons in vivo and used this method to analyze how attention affects these two cell classes in visual area V4 of the extrastriate cortex of rhesus macaques. We found that putative inhibitory neurons had both greater increases in firing rate and decreases in correlated variability with attention compared with putative excitatory neurons. Moreover, the time course of attention effects for putative inhibitory neurons more closely tracked the temporal statistics of target probability in our task. Finally, the session-to-session variability in a behavioral measure of attention covaried with the magnitude of this effect. Together, these results suggest that selective targeting of inhibitory neurons and networks is a critical mechanism for attentional modulation.

Social Suppressive Behavior Is Organized by the Spatiotemporal Integration of Multiple Cortical Regions in the Japanese Macaque

Under social conflict, monkeys develop hierarchical positions through social interactions. Once the hierarchy is established, the dominant monkey dominates the space around itself and the submissive monkey tries not to violate this space. Previous studies have shown the contributions of the frontal and parietal cortices in social suppression, but the contributions of other cortical areas to suppressive functions remain elusive. We recorded neural activity in large cortical areas using electrocorticographic (ECoG) arrays while monkeys performed a social food-grab task in which a target monkey was paired with either a dominant or a submissive monkey. If the paired monkey was dominant, the target monkey avoided taking food in the shared conflict space, but not in other areas. By contrast, when the paired monkey was submissive, the target monkey took the food freely without hesitation. We applied decoding analysis to the ECoG data to see when and which cortical areas contribute to social behavioral suppression. Neural information discriminating the social condition was more evident when the conflict space was set in the area contralateral to the recording hemisphere. We found that the information increased as the social pressure increased during the task. Before food presentation, when the pressure was relatively low, the parietal and somatosensory-motor cortices showed sustained discrimination of the social condition. After food presentation, when the monkey faced greater pressure to make a decision as to whether it should take the food, the prefrontal and visual cortices started to develop buildup responses. The social representation was found in a sustained form in the parietal and somatosensory-motor regions, followed by additional buildup form in the visual and prefrontal cortices. The representation was less influenced by reward expectation. These findings suggest that social adaptation is achieved by a higher-order self-regulation process (incorporating motor preparation/execution processes) in accordance with the embodied social contexts.