Modulation of Neuronal Responses by Exogenous Attention in Macaque Primary Visual Cortex

Peripheral vision is mainly for looking rather than seeing

Vision includes looking and seeing. Looking, mainly via gaze shifts, selects a fraction of visual input information for passage through the brain's information bottleneck. The selected input is placed within the attentional spotlight, typically in the central visual field. Seeing decodes, i.e., recognizes and discriminates, the selected inputs. Hence, peripheral vision should be mainly devoted to looking, in particular, deciding where to shift the gaze. Looking is often guided exogenously by a saliency map created by the primary visual cortex (V1), and can be effective with no seeing and limited awareness. In seeing, peripheral vision not only suffers from poor spatial resolution, but is also subject to crowding and is more vulnerable to illusions by misleading, ambiguous, and impoverished visual inputs. Central vision, mainly for seeing, enjoys the top-down feedback that aids seeing in light of the bottleneck which is hypothesized to starts from V1 to higher areas. This feedback queries for additional information from lower visual cortical areas such as V1 for ongoing recognition. Peripheral vision is deficient in this feedback according to the Central-peripheral Dichotomy (CPD) theory. The saccades engendered by peripheral vision allows looking to combine with seeing to give human observers the impression of seeing the whole scene clearly despite inattentional blindness.

Intracortical recordings reveal vision-to-action cortical gradients driving human exogenous attention

Exogenous attention, the process that makes external salient stimuli pop-out of a visual scene, is essential for survival. How attention-capturing events modulate human brain processing remains unclear. Here we show how the psychological construct of exogenous attention gradually emerges over large-scale gradients in the human cortex, by analyzing activity from 1,403 intracortical contacts implanted in 28 individuals, while they performed an exogenous attention task. The timing, location and task-relevance of attentional events defined a spatiotemporal gradient of three neural clusters, which mapped onto cortical gradients and presented a hierarchy of timescales. Visual attributes modulated neural activity at one end of the gradient, while at the other end it reflected the upcoming response timing, with attentional effects occurring at the intersection of visual and response signals. These findings challenge multi-step models of attention, and suggest that frontoparietal networks, which process sequential stimuli as separate events sharing the same location, drive exogenous attention phenomena such as inhibition of return.

Precise Spatial Tuning of Visually Driven Alpha Oscillations in Human Visual Cortex

Neuronal oscillations at about 10 Hz, called alpha oscillations, are often thought to arise from synchronous activity across occipital cortex, reflecting general cognitive states such as arousal and alertness. However, there is also evidence that modulation of alpha oscillations in visual cortex can be spatially specific. Here, we used intracranial electrodes in human patients to measure alpha oscillations in response to visual stimuli whose location varied systematically across the visual field. We separated the alpha oscillatory power from broadband power changes. The variation in alpha oscillatory power with stimulus position was then fit by a population receptive field (pRF) model. We find that the alpha pRFs have similar center locations to pRFs estimated from broadband power (70-180 Hz), but are several times larger. The results demonstrate that alpha suppression in human visual cortex can be precisely tuned. Finally, we show how the pattern of alpha responses can explain several features of exogenous visual attention.

Significance Statement

The alpha oscillation is the largest electrical signal generated by the human brain. An important question in systems neuroscience is the degree to which this oscillation reflects system-wide states and behaviors such as arousal, alertness, and attention, versus much more specific functions in the routing and processing of information. We examined alpha oscillations at high spatial precision in human patients with intracranial electrodes implanted over visual cortex. We discovered a surprisingly high spatial specificity of visually driven alpha oscillations, which we quantified with receptive field models. We further use our discoveries about properties of the alpha response to show a link between these oscillations and the spread of visual attention.

The role of temporal cortex in the control of attention

Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.

Exogenous attention generalizes location transfer of perceptual learning in adults with amblyopia

Visual perceptual learning (VPL) is a behavioral manifestation of brain neuroplasticity. However, its practical effectiveness is limited because improvements are often specific to the trained conditions and require significant time and effort. It is critical to understand the conditions that promote learning and transfer. Covert endogenous (voluntary) and exogenous (involuntary) spatial attention help overcome VPL location specificity in neurotypical adults, but whether they also do so for people with atypical visual development is unknown. This study investigates the role of exogenous attention during VPL in adults with amblyopia, an ideal population given their asymmetrically developed, but highly plastic, visual cortex. Here we show that training on a discrimination task leads to improvements in foveal contrast sensitivity, acuity, and stereoacuity. Notably, exogenous attention helps generalize learning beyond trained spatial locations. Future large-scale studies can verify the extent to which attention enhances the effectiveness of perceptual learning during rehabilitation of visual disorders.

•

Contrast sensitivity (CS)-based VPL in amblyopes improves CS, acuity and stereoacuity

•

Similar improvement in trained amblyopic eye and untrained fellow eye

•

Exogenous spatial attention facilitates location transfer of VPL in amblyopic adults

An image-computable model of how endogenous and exogenous attention differentially alter visual perception

Attention alters perception across the visual field. Typically, endogenous (voluntary) and exogenous (involuntary) attention similarly improve performance in many visual tasks, but they have differential effects in some tasks. Extant models of visual attention assume that the effects of these two types of attention are identical and consequently do not explain differences between them. Here, we develop a model of spatial resolution and attention that distinguishes between endogenous and exogenous attention. We focus on texture-based segmentation as a model system because it has revealed a clear dissociation between both attention types. For a texture for which performance peaks at parafoveal locations, endogenous attention improves performance across eccentricity, whereas exogenous attention improves performance where the resolution is low (peripheral locations) but impairs it where the resolution is high (foveal locations) for the scale of the texture. Our model emulates sensory encoding to segment figures from their background and predict behavioral performance. To explain attentional effects, endogenous and exogenous attention require separate operating regimes across visual detail (spatial frequency). Our model reproduces behavioral performance across several experiments and simultaneously resolves three unexplained phenomena: 1) the parafoveal advantage in segmentation, 2) the uniform improvements across eccentricity by endogenous attention, and 3) the peripheral improvements and foveal impairments by exogenous attention. Overall, we unveil a computational dissociation between each attention type and provide a generalizable framework for predicting their effects on perception across the visual field.

A Direct Comparison of Spatial Attention and Stimulus-Response Compatibility between Mice and Humans

Mice are becoming an increasingly popular model for investigating the neural substrates of visual processing and higher cognitive functions. To validate the translation of mouse visual attention and sensorimotor processing to humans, we compared their performance in the same visual task. Mice and human participants judged the orientation of a grating presented on either the right or left side in the visual field. To induce shifts of spatial attention, we varied the stimulus probability on each side. As expected, human participants showed faster RTs and a higher accuracy for the side with a higher probability, a well-established effect of visual attention. The attentional effect was only present in mice when their response was slow. Although the task demanded a judgment of grating orientation, the accuracy of the mice was strongly affected by whether the side of the stimulus corresponded to the side of the behavioral response. This stimulus-response compatibility (Simon) effect was much weaker in humans and only significant for their fastest responses. Both species exhibited a speed-accuracy trade-off in their responses, because slower responses were more accurate than faster responses. We found that mice typically respond very fast, which contributes to the stronger stimulus-response compatibility and weaker attentional effects, which were only apparent in the trials with slowest responses. Humans responded slower and had stronger attentional effects, combined with a weak influence of stimulus-response compatibility, which was only apparent in trials with fast responses. We conclude that spatial attention and stimulus-response compatibility influence the responses of humans and mice but that strategy differences between species determine the dominance of these effects.

Differential impact of endogenous and exogenous attention on activity in human visual cortex

How do endogenous (voluntary) and exogenous (involuntary) attention modulate activity in visual cortex? Using ROI-based fMRI analysis, we measured fMRI activity for valid and invalid trials (target at cued/un-cued location, respectively), pre- or post-cueing endogenous or exogenous attention, while participants performed the same orientation discrimination task. We found stronger modulation in contralateral than ipsilateral visual regions, and higher activity in valid- than invalid-trials. For endogenous attention, modulation of stimulus-evoked activity due to a pre-cue increased along the visual hierarchy, but was constant due to a post-cue. For exogenous attention, modulation of stimulus-evoked activity due to a pre-cue was constant along the visual hierarchy, but was not modulated due to a post-cue. These findings reveal that endogenous and exogenous attention distinctly modulate activity in visuo-occipital areas during orienting and reorienting; endogenous attention facilitates both the encoding and the readout of visual information whereas exogenous attention only facilitates the encoding of information.

Relation Between Event-Related Potential Latency and Saccade Latency in Overt Shifts of Attention

Controlled shifts of attention between competing stimuli are crucial for effective everyday visual behaviour. While these typically involve overt shifts of fixation, many past studies used covert attention shifts in which fixation is unchanged, meaning that some response components may result from the inhibition of eye movements. In this study, the neural events in the human brain when making overt shifts of attention are studied through the combination of event-related potential recording with simultaneous eye tracking. Fixation shifts under competition (central target remains visible when a peripheral target appears) were compared with noncompetition (central target disappears). A longer latency for competition compared with noncompetition, which is found in the saccadic response, is already present in the early occipital positivity when a single target is presented for the fixation shift. These results indicate that the requirement to disengage from a current target affects the time course of neural processing at an early level. However, the relation is more complex when the participant is required to choose which of two targets to fixate.

Electrophysiological evidence supports the role of sustained visuospatial attention in maintaining visual WM contents

Recent empirical and theoretical work suggests that there is a close relationship between visual working memory (WM) and visuospatial attention. Here, we investigated whether visuospatial attention was involved in maintaining object representations in visual WM. To this end, the alpha lateralization and contralateral delay activity (CDA) were analyzed as neural markers for visuospatial attention and visual WM storage, respectively. In the single-task condition, participants performed a grating change-detection task. To probe the role of visuospatial attention in maintaining WM contents, two color squares were presented above and below the fixation point during the retention interval, which remained visible until the detection display was present. In the dual-task condition, participants were required to maintain lateralized gratings while staring at the center-presented color squares, to detect possible subsequent color change. With this task, sustained visuospatial attention that guided to individual memory representations was disrupted. The behavioral data showed that, the insertion of secondary task significantly deteriorated WM performance. For electrophysiological data, we divided the retention interval into two stages, the early stage and late stage, bounded by the onset of the secondary task. We found that CDA amplitude was lower under the dual-task condition than the single-task condition during the late stage, but not the early stage, and the extent to which CDA reduced tracked the impaired memory performance at the individual level. Also, alpha lateralization only could be observed in the single-task condition of the late stage, and completely disappeared in the dual-task condition, indicating the disruption of visuospatial attention directed to memory representations. Individuals who experienced greater visuospatial attention disruption, as indicated by the alpha lateralization, had lower maintenance-associated neural activity (CDA), and suffered greater impairment of memory performance. These findings confirm that sustained visuospatial attention continues improving visual WM processing after the initial encoding phase, and most likely participates in this process by supporting the maintenance of representations in an active state.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

Cue predictability does not modulate bottom-up attentional capture

Attention can be involuntarily captured by physically salient stimuli, a phenomenon known as bottom-up attention. Typically, these salient stimuli occur unpredictably in time and space. Therefore, in a series of three behavioural experiments, we investigated the extent to which such bottom-up attentional capture is a function of one's prior expectations. In the context of an exogenous cueing task, we systematically manipulated participants' spatial (Experiment 1) or temporal (Experiments 2 and 3) expectations about an uninformative cue and examined the amount of attentional capture by the cue. We anticipated larger attentional capture for unexpected compared to expected cues. However, while we observed attentional capture, we did not find any evidence for a modulation of attentional capture by prior expectation. This suggests that bottom-up attentional capture does not appear modulated by the degree to which the cue is expected or surprising.

Effect of Visual Attention on Binocular Fusion Limits

We examined the effect of visual attention on binocular fusion limits by using Posner's spatial cueing paradigm that entails cued shifts of attentional focus. Results showed that attention decreases the fusion limit. Observers perceived diplopia of a binocular line within +/-26.5 arcmin disparity (+/- correspond to uncrossed and crossed, respectively) more frequently when it was oriented to the line than when cued attention was directed elsewhere. We discuss the results in terms of attention increasing spatial resolution and contrast sensitivity.

Using Expectancy Theory to quantitatively dissociate the neural representation of motivation from its influential factors in the human brain: An fMRI study

Researchers have yet to apply a formal operationalized theory of motivation to neurobiology that would more accurately and precisely define neural activity underlying motivation. We overcome this challenge with the novel application of the Expectancy Theory of Motivation to human fMRI to identify brain activity that explicitly reflects motivation. Expectancy Theory quantitatively describes how individual constructs determine motivation by defining motivation force as the product of three variables: expectancy - belief that effort will better performance; instrumentality - belief that successful performance leads to particular outcome, and valence - outcome desirability. Here, we manipulated information conveyed by reward-predicting cues such that relative cue-evoked activity patterns could be statistically mapped to individual Expectancy Theory variables. The variable associated with activity in any voxel is only reported if it replicated between two groups of healthy participants. We found signals in midbrain, ventral striatum, sensorimotor cortex, and visual cortex that specifically map to motivation itself, rather than other factors. This is important because, for the first time, it empirically clarifies approach motivation neural signals during reward anticipation. It also highlights the effectiveness of the application of Expectancy Theory to neurobiology to more precisely and accurately probe motivation neural correlates than has been achievable previously.

Visual Responses in FEF, Unlike V1, Primarily Reflect When the Visual Context Renders a Receptive Field Salient

When light falls within a neuronal visual receptive field (RF) the resulting activity is referred to as the visual response. Recent work suggests this activity is in response to both the visual stimulation and the abrupt appearance, or salience, of the presentation. Here we present a novel method for distinguishing the two, based on the timing of random and nonrandom presentations. We examined these contributions in frontal eye field (FEF; N = 51) and as a comparison, an early stage in the primary visual cortex (V1; N = 15) of male monkeys (Macaca mulatta). An array of identical stimuli was presented within and outside the neuronal RF while we manipulated salience by varying the time between stimulus presentations. We hypothesized that the rapid presentation would reduce salience (the sudden appearance within the visual field) of a stimulus at any one location, and thus decrease responses driven by salience in the RF. We found that when the interstimulus interval decreased from 500 to 16 ms there was an approximate 79% reduction in the FEF response compared with an estimated 17% decrease in V1. This reduction in FEF response for rapid presentation was evident even when the random sequence preceding a stimulus did not stimulate the RF for 500 ms. The time course of these response changes in FEF suggest that salience is represented much earlier (<100 ms following stimulus onset) than previously estimated. Our results suggest that the contribution of salience dominates at higher levels of the visual system.SIGNIFICANCE STATEMENT The neuronal responses in early visual processing [e.g., primary visual cortex (V1)] reflect primarily the retinal stimulus. Processing in higher visual areas is modulated by a combination of the visual stimulation and contextual factors, such as salience, but identifying these components separately has been difficult. Here we quantified these contributions at a late stage of visual processing [frontal eye field (FEF)] and as a comparison, an early stage in V1. Our results suggest that as visual information continues through higher levels of processing the neural responses are no longer driven primarily by the visual stimulus in the receptive field, but by the broader context that stimulus defines-very different from current views about visual signals in FEF.

Attention model of binocular rivalry

When the corresponding retinal locations in the two eyes are presented with incompatible images, a stable percept gives way to perceptual alternations in which the two images compete for perceptual dominance. As perceptual experience evolves dynamically under constant external inputs, binocular rivalry has been used for studying intrinsic cortical computations and for understanding how the brain regulates competing inputs. Converging behavioral and EEG results have shown that binocular rivalry and attention are intertwined: binocular rivalry ceases when attention is diverted away from the rivalry stimuli. In addition, the competing image in one eye suppresses the target in the other eye through a pattern of gain changes similar to those induced by attention. These results require a revision of the current computational theories of binocular rivalry, in which the role of attention is ignored. Here, we provide a computational model of binocular rivalry. In the model, competition between two images in rivalry is driven by both attentional modulation and mutual inhibition, which have distinct selectivity (feature vs. eye of origin) and dynamics (relatively slow vs. relatively fast). The proposed model explains a wide range of phenomena reported in rivalry, including the three hallmarks: (i) binocular rivalry requires attention; (ii) various perceptual states emerge when the two images are swapped between the eyes multiple times per second; (iii) the dominance duration as a function of input strength follows Levelt's propositions. With a bifurcation analysis, we identified the parameter space in which the model's behavior was consistent with experimental results.

Does spatial attention modulate the earliest component of the visual evoked potential?

Whether visual spatial attention can modulate feedforward input to human primary visual cortex (V1) is debated. A prominent and long-standing hypothesis is that visual spatial attention can influence processing in V1, but only at delayed latencies suggesting a feedback-mediated mechanism and a lack of modulation during the initial afferent volley. The most promising challenge to this hypothesis comes from an event-related potential (ERP) study that showed an amplitude enhancement of the earliest visual ERP component, called the 'C1', in response to spatially attended relative to spatially unattended stimuli. In the Kelly et al. study, several important experimental design modifications were introduced, including tailoring the stimulus locations and recording electrodes to each individual subject. In the current study, we employed the same methodological procedures and tested for attentional enhancements of the C1 component in each quadrant of the visual field. Using the same analysis strategies as Kelly et al., we found no evidence for an attention-based modulation of the C1 (measured from 50-80 ms). Attention-based amplitude enhancements were clear and robust for the subsequent P1 component (90-140 ms). Thus, despite using methods specifically designed to reveal C1 attention effects, the current study provided no confirmatory evidence for such effects.

Linking ADHD to the Neural Circuitry of Attention

Attention deficit hyperactivity disorder (ADHD) is a complex condition with a heterogeneous presentation. Current diagnosis is primarily based on subjective experience and observer reports of behavioral symptoms - an approach that has significant limitations. Many studies show that individuals with ADHD exhibit poorer performance on cognitive tasks than neurotypical controls, and at least seven main functional domains appear to be implicated in ADHD. We discuss the underlying neural mechanisms of cognitive functions associated with ADHD, with emphasis on the neural basis of selective attention, demonstrating the feasibility of basic research approaches for further understanding cognitive behavioral processes as they relate to human psychopathology. The study of circuit-level mechanisms underlying executive functions in nonhuman primates holds promise for advancing our understanding, and ultimately the treatment, of ADHD.

Orientation Probability and Spatial Exogenous Cuing Improve Perceptual Precision and Response Speed by Different Mechanisms

We are faster and more accurate at detecting frequently occurring objects than infrequent ones, just as we are faster and more accurate at detecting objects that have been spatially cued. Does this behavioral similarity reflect similar processes? To evaluate this question we manipulated orientation probability and exogenous spatial cuing within a single perceptual estimation task. Both increased target probability and spatial cuing led to shorter response initiation times and more precise perceptual reports, but these effects were additive. Further, target probability changed the shape of the distribution of errors while spatial cuing did not. Different routes and independent mechanisms could lead to changes in behavioral measures that look similar to each other and to ‘attentional’ effects.

Neural Mechanisms of Selective Visual Attention

Selective visual attention describes the tendency of visual processing to be confined largely to stimuli that are relevant to behavior. It is among the most fundamental of cognitive functions, particularly in humans and other primates for whom vision is the dominant sense. We review recent progress in identifying the neural mechanisms of selective visual attention. We discuss evidence from studies of different varieties of selective attention and examine how these varieties alter the processing of stimuli by neurons within the visual system, current knowledge of their causal basis, and methods for assessing attentional dysfunctions. In addition, we identify some key questions that remain in identifying the neural mechanisms that give rise to the selective processing of visual information.

From the optic tectum to the primary visual cortex: migration through evolution of the saliency map for exogenous attentional guidance

Recent data have supported the hypothesis that, in primates, the primary visual cortex (V1) creates a saliency map from visual input. The exogenous guidance of attention is then realized by means of monosynaptic projections to the superior colliculus, which can select the most salient location as the target of a gaze shift. V1 is less prominent, or is even absent in lower vertebrates such as fish; whereas the superior colliculus, called optic tectum in lower vertebrates, also receives retinal input. I review the literature and propose that the saliency map has migrated from the tectum to V1 over evolution. In addition, attentional benefits manifested as cueing effects in humans should also be present in lower vertebrates.