Control of eye movements and spatial attention

Voluntary and Involuntary Control of Attention in Adolescents Born Very Preterm: A Study of Eye Movements

Very preterm birth is associated with attention deficits that interfere with academic performance. A better understanding of attention processes is necessary to support very preterm born children. This study examined voluntary and involuntary attentional control in very preterm born adolescents by measuring saccadic eye movements. Additionally, these control processes were related to symptoms of inattention, intelligence, and academic performance. Participants included 47 very preterm and 61 full-term born 13-years-old adolescents. Oculomotor control was assessed using the antisaccade and oculomotor capture paradigm. Very preterm born adolescents showed deficits in antisaccade but not in oculomotor capture performance, indicating impairments in voluntary but not involuntary attentional control. These impairments mediated the relation between very preterm birth and inattention, intelligence, and academic performance.

The computational pharmacology of oculomotion

Many physiological and pathological changes in brain function manifest in eye-movement control. As such, assessment of oculomotion is an invaluable part of a clinical examination and affords a non-invasive window on several key aspects of neuronal computation. While oculomotion is often used to detect deficits of the sort associated with vascular or neoplastic events; subtler (e.g. pharmacological) effects on neuronal processing also induce oculomotor changes. We have previously framed oculomotor control as part of active vision, namely, a process of inference comprising two distinct but related challenges. The first is inferring where to look, and the second is inferring how to implement the selected action. In this paper, we draw from recent theoretical work on the neuromodulatory control of active inference. This allows us to simulate the sort of changes we would expect in oculomotor behaviour, following pharmacological enhancement or suppression of key neuromodulators-in terms of deciding where to look and the ensuing trajectory of the eye movement itself. We focus upon the influence of cholinergic and GABAergic agents on the speed of saccades, and consider dopaminergic and noradrenergic effects on more complex, memory-guided, behaviour. In principle, a computational approach to understanding the relationship between pharmacology and oculomotor behaviour affords the opportunity to estimate the influence of a given pharmaceutical upon neuronal function, and to use this to optimise therapeutic interventions on an individual basis.

Voluntary and involuntary contributions to perceptually guided saccadic choices resolved with millisecond precision

In the antisaccade task, which is considered a sensitive assay of cognitive function, a salient visual cue appears and the participant must look away from it. This requires sensory, motor-planning, and cognitive neural mechanisms, but what are their unique contributions to performance, and when exactly are they engaged? Here, by manipulating task urgency, we generate a psychophysical curve that tracks the evolution of the saccadic choice process with millisecond precision, and resolve the distinct contributions of reflexive (exogenous) and voluntary (endogenous) perceptual mechanisms to antisaccade performance over time. Both progress extremely rapidly, the former driving the eyes toward the cue early on (∼100 ms after cue onset) and the latter directing them away from the cue ∼40 ms later. The behavioral and modeling results provide a detailed, dynamical characterization of attentional and oculomotor capture that is not only qualitatively consistent across participants, but also indicative of their individual perceptual capacities.

Unraveling Causal Mechanisms of Top-Down and Bottom-Up Visuospatial Attention with Non-invasive Brain Stimulation

Attention is a process of selection that allows us to intelligently navigate the abundance of information in our world. Attention can be either directed voluntarily based on internal goals-"top-down" or goal-directed attention-or captured automatically, by salient stimuli-"bottom-up" or stimulus-driven attention. Do these two modes of attention control arise from same or different brain circuits? Do they share similar or distinct neural mechanisms? In this review, we explore this dichotomy between the neural bases of top-down and bottom-up attention control, with a special emphasis on insights gained from non-invasive neurostimulation techniques, specifically, transcranial magnetic stimulation (TMS). TMS enables spatially focal and temporally precise manipulation of brain activity. We explore a significant literature devoted to investigating the role of fronto-parietal brain regions in top-down and bottom-up attention with TMS, and highlight key areas of convergence and debate. We also discuss recent advances in combinatorial paradigms that combine TMS with other imaging modalities, such as functional magnetic resonance imaging or electroencephalography. These paradigms are beginning to bridge essential gaps in our understanding of the neural pathways by which TMS affects behavior, and will prove invaluable for unraveling mechanisms of attention control, both in health and in disease.

Updating spatial working memory in a dynamic visual environment

The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.

The Puzzling Relationship between Attention and Motivation: Do Motor Biases Matter?

The relationship between attention and incentive motivation has been mostly examined by administering Posner style cueing tasks in humans and varying monetary stakes. These studies found that higher incentives improved performance independently of spatial attention. However, the ability of the cueing task to measure actual attentional orienting has been debated by several groups that have highlighted the function of the motor system in affecting the behavioral features that are commonly attributed to spatial attention. To determine the impact of motor influences on the interplay between attention and motivation, we administered 2 reaching versions of a cueing task to monkeys in various motor scenarios. In both tasks, a central stimulus indicated the reward stake and predicted the stimulus target location in 80% of trials. In Experiment 1, subjects were requested to report the detection of a target stimulus in each trial. In Experiment 2, the task was modified to fit a paradigm of Go/NoGo target identification. We found that attention and motivation interacted exclusively in Experiment 2, wherein anticipated motor activation was discouraged and more demanding visual processing was imposed. Consequently, we suggest a protocol that provides novel insights into the study of the relationship between spatial attention and motivation and highlights the influence of the arm motor system in the estimation of the deployment of spatial attention.

Spatial and temporal dynamics of presaccadic attentional facilitation before pro- and antisaccades

The premotor theory of attention and the visual attention model make different predictions about the temporal and spatial allocation of presaccadic attentional facilitation. The current experiment investigated the spatial and temporal dynamics of presaccadic attentional facilitation during pro- and antisaccade planning; we investigated whether attention shifts only to the saccade goal location or to the target location or elsewhere, and when. Participants performed a dual-task paradigm with blocks of either anti- or prosaccades and also discriminated symbols appearing at different locations before saccade onset (measure of attentional allocation). In prosaccades blocks, correct prosaccade discrimination was best at the target location, while during errors, discrimination was best at the location opposite to the target location. This pattern was inversed in antisaccades blocks, although discrimination remained high opposite to the target location. In addition, we took the benefit of a large range of saccadic landing positions and showed that performance across both types of saccades was best at the actual saccade goal location (where the eye will actually land) rather than at the instructed position. Finally, temporal analyses showed that discrimination remained highest at the saccade goal location, from long before to closer to saccade onset, increasing slightly for antisaccades closer to saccade onset. These findings are in line with the premises of the premotor theory of attention, showing that attentional allocation is primarily linked both temporally and spatially to the saccade goal location.

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

Both a Gauge and a Filter: Cognitive Modulations of Pupil Size

Over 50 years of research have established that cognitive processes influence pupil size. This has led to the widespread use of pupil size as a peripheral measure of cortical processing in psychology and neuroscience. However, the function of cortical control over the pupil remains poorly understood. Why does visual attention change the pupil light reflex? Why do mental effort and surprise cause pupil dilation? Here, we consider these functional questions as we review and synthesize two literatures on cognitive effects on the pupil: how cognition affects pupil light response and how cognition affects pupil size under constant luminance. We propose that cognition may have co-opted control of the pupil in order to filter incoming visual information to optimize it for particular goals. This could complement other cortical mechanisms through which cognition shapes visual perception.

The neural instantiation of a priority map

The term priority map is commonly used to describe a map of the visual scene, in which objects and locations are represented by their attentional priority, which itself is a combination of low-level salience and top-down control. The aim of this review is to examine how such a map may be represented at the neuronal level. We propose that there is not a single, common map in the brain, but that a number of cortical areas work together to generate the resultant behavior. Specifically, we suggest that the lateral intraparietal area (LIP) of posterior parietal cortex provides a simple representation of attentional priority, which remaps across saccades, so that there is an apparent allocentric map in a region with retinocentric encoding scheme. We propose that the frontal eye field (FEF) of prefrontal cortex receives the responses from LIP, but can suppress them to control the flow of eye movement behavior, and that the intermediate layers of the superior colliculus (SCi) reflect the final saccade goal. Together, these areas function to guide eye movements and may play a similar role in allocating covert visual attention.

Learned feature variance is encoded in the target template and drives visual search

Real world visual search targets are frequently imperfect perceptual matches to our internal target templates. For example, the same friend on different occasions is likely to wear different clothes, hairstyles, and accessories, but some of these may be more likely to vary than others. The ability to deal with template-to-target variability is important to visual search in natural environments, but we know relatively little about how feature variability is handled by the attentional system. In these studies, we test the hypothesis that top-down attentional biases are sensitive to the variance of target feature dimensions over time and prioritize information from less-variable dimensions. On each trial, subjects were shown a target cue composed of colored dots moving in a specific direction followed by a working memory probe (30%) or visual search display (70%). Critically, the target features in the visual search display differed from the cue, with one feature drawn from a distribution narrowly centered over the cued feature (low-variance dimension), and the other sampled from a broader distribution (high-variance dimension). The results demonstrate that subjects used knowledge of the likely cue-to-target variance to set template precision and bias attentional selection. Moreover, an individual's working memory precision for each feature predicted search performance. Our results suggest that observers are sensitive to the variance of feature dimensions within a target and use this information to weight mechanisms of attentional selection.

The Relationship Between Spatial Attention and Eye Movements

The nature of the relationship between spatial attention and eye movements has been the subject of intense debate for more than 40 years. Two ideas have dominated this debate. First is the idea that spatial attention shares common neural mechanisms with eye movement programming, characterizing attention as an eye movement that has been prepared but not executed. Second, based on the observation that attention shifts to saccade targets, several theories have proposed that saccade programming necessarily recruits attentional resources. In this chapter, we review the evidence for each of these ideas and discuss some of the limitations and challenges in confirming their predictions. Although they are clearly dependent under some circumstances, dissociations between spatial attention and eye movements, and clear differences in their basic functions, point to the existence of two interconnected, but separate, systems.

A Rhythmic Theory of Attention

Recent evidence has demonstrated that environmental sampling is a fundamentally rhythmic process. Both perceptual sensitivity during covert spatial attention and the probability of overt exploratory movements are tethered to theta-band activity (3-8Hz) in the attention network. The fronto-parietal part of this network is positioned at the nexus of sensory and motor functions, directing two tightly coupled processes related to environmental exploration: preferential routing of sensory input and saccadic eye movements. We propose that intrinsic theta rhythms temporally resolve potential functional conflicts by periodically reweighting functional connections between higher-order brain regions and either sensory or motor regions. This rhythmic reweighting alternately promotes either sampling at a behaviorally relevant location (i.e., sensory functions) or shifting to another location (i.e., motor functions).

Covert attention beyond the range of eye-movements: Evidence for a dissociation between exogenous and endogenous orienting

The relationship between covert shift of attention and the oculomotor system has been the subject of numerous studies. A widely held view, known as Premotor Theory, is that covert attention depends upon activation of the oculomotor system. However, recent work has argued that Premotor Theory is only true for covert, exogenous orienting of attention and that covert endogenous orienting is largely independent of the oculomotor system. To address this issue we examined how endogenous and exogenous covert orienting of attention was affected when stimuli were presented at a location outside the range of saccadic eye movements. Results from Experiment 1 showed that exogenous covert orienting was abolished when stimuli were presented beyond the range of saccadic eye movements, but preserved when stimuli were presented within this range. In contrast, in Experiment 2 endogenous covert orienting was preserved when stimuli appeared beyond the saccadic range. Finally, Experiment 3 confirmed the observations of Exp.1 and 2. Our results demonstrate that exogenous, covert orienting is limited to the range of overt saccadic eye movements, whereas covert endogenous orienting is not. These results are consistent with a weak, exogenous-only version of Premotor Theory.

Detectability of stop-signal determines magnitude of deceleration in saccade planning

An inhibitory control is exerted when the context in which a movement has been planned changes abruptly making the impending movement inappropriate. Neurons in the frontal eye field and superior colliculus steadily increase activity before a saccadic eye movement, but cease the rise below a threshold when an impending saccade is withheld in response to an unexpected stop-signal. This type of neural modulation has been majorly considered as an outcome of a race between preparatory and inhibitory processes ramping up to reach a decision criterion. An alternative model claims that the rate of saccade planning is diminished exclusively when the stop-signal is detected within a stipulated period. However, due to a dearth of empirical evidence in support of the latter model, it remains unclear how the detectability of the stop-signal influences saccade inhibition. In our study, human participants selected a visual target to look at by discriminating a go-cue. Infrequently they cancelled saccade and reported whether they saw the stop-signal. The go-cue and stop-signal both were embedded in a stream of irrelevant stimuli presented in rapid succession. Participants exhibited difficulty in detection of the stop-signal when presented almost immediately after the go-cue. We found a robust relationship between the detectability of the stop-signal and the odds of saccade inhibition. Saccade latency increased exponentially with the maximum time available for processing the stop-signal before gaze shifted. A model in which the stop-signal onset spontaneously decelerated progressive saccade planning with the magnitude proportional to its detectability accounted for the data.

Attention or salience?

While attention is widely recognised as central to perception, the term is often used to mean very different things. Prominent theories of attention - notably the premotor theory - relate it to planned or executed eye movements. This contrasts with the notion of attention as a gain control process that weights the information carried by different sensory channels. We draw upon recent advances in theoretical neurobiology to argue for a distinction between attentional gain mechanisms and salience attribution. The former depends upon estimating the precision of sensory data, while the latter is a consequence of the need to actively engage with the sensorium. Having established this distinction, we consider the intimate relationship between attention and salience.

Brain regions modulated during covert visual attention in the macaque

Neurophysiological studies of covert visual attention in monkeys have emphasized the modulation of sensory neural responses in the visual cortex. At the same time, electrophysiological correlates of attention have been reported in other cortical and subcortical structures, and recent fMRI studies have identified regions across the brain modulated by attention. Here we used fMRI in two monkeys performing covert attention tasks to reproduce and extend these findings in order to help establish a more complete list of brain structures involved in the control of attention. As expected from previous studies, we found attention-related modulation in frontal, parietal and visual cortical areas as well as the superior colliculus and pulvinar. We also found significant attention-related modulation in cortical regions not traditionally linked to attention - mid-STS areas (anterior FST and parts of IPa, PGa, TPO), as well as the caudate nucleus. A control experiment using a second-order orientation stimulus showed that the observed modulation in a subset of these mid-STS areas did not depend on visual motion. These results identify the mid-STS areas (anterior FST and parts of IPa, PGa, TPO) and caudate nucleus as potentially important brain regions in the control of covert visual attention in monkeys.

Comparing frontal eye field and superior colliculus contributions to covert spatial attention

The causal roles of the frontal eye fields (FEF) and superior colliculus (SC) in spatial selective attention have not been directly compared. Reversible inactivation is an established method for testing causality but comparing results between FEF and SC is complicated by differences in size and morphology of the two brain regions. Here we exploited the fact that inactivation of FEF and SC also changes the metrics of saccadic eye movements, providing an independent benchmark for the strength of the causal manipulation. Using monkeys trained to covertly perform a visual motion-change detection task, we found that inactivation of either FEF or SC could cause deficits in attention task performance. However, SC-induced attention deficits were found with saccade changes half the size needed to get FEF-induced attention deficits. Thus, performance in visual attention tasks is vulnerable to loss of signals from either structure, but suppression of SC activity has a more devastating effect.

Distinct roles of prefrontal and parietal areas in the encoding of attentional priority

When searching for an object in a crowded scene, information about the similarity of stimuli to the target object is thought to be encoded in spatial priority maps, which are subsequently used to guide shifts of attention and gaze to likely targets. Two key cortical areas that have been described as holding priority maps are the frontal eye field (FEF) and the lateral intraparietal area (LIP). However, little is known about their distinct contributions in priority encoding. Here, we compared neuronal responses in FEF and LIP during free-viewing visual search. Although saccade selection signals emerged earlier in FEF, information about the target emerged at similar latencies in distinct populations within the two areas. Notably, however, effects in FEF were more pronounced. Moreover, LIP neurons encoded the similarity of stimuli to the target independent of saccade selection, whereas in FEF, encoding of target similarity was strongly modulated by saccade selection. Taken together, our findings suggest hierarchical processing of saccade selection signals and parallel processing of feature-based attention signals within the parietofrontal network with FEF having a more prominent role in priority encoding. Furthermore, they suggest discrete roles of FEF and LIP in the construction of priority maps.

Neural mechanisms of sensorimotor transformation and action selection

Ray Guillery made major contributions to our understanding of the development and function of the brain. One of his principal conceptual insights, developed together with Murray Sherman [S.M. Sherman & R.W. Guillery (2001) Exploring the Thalamus. Elsevier, Amstrerdam; S. Sherman & R. Guillery (2006) Exploring the Thalamus and Its Role in Cortical Functioning. Academic Press, New York, NY; S.M. Sherman & R.W. Guillery (2013) Functional Connections of Cortical Areas: A New View from the Thalamus. MIT Press, Cambridge, MA and then in his last book (R. Guillery (2017) The Brain as a Tool: A Neuroscientist's Account. Oxford University Press, Oxford, UK)], was that the brain is a 'tool' to understand the world. In this view, the brain does not passively process sensory information and use the result to inform motor outputs. Rather, sensory and motor signals are widely broadcast and inextricably linked, with ongoing sensorimotor transformations serving as the basis for interaction with the outside world. Here, we describe recent studies from our laboratory and others which demonstrate this astute framing of the link among sensation, perception, and action postulated by Guillery and others [G. Deco & E.T. Rolls (2005) Prog Neurobiol, 76, 236-256; P. Cisek & J.F. Kalaska (2010) Annu Rev Neurosci, 33, 269-298]. Guillery situated his understanding in the deeply intertwined relationship between the thalamus and cortex, and importantly in the feedback from cortex to thalamus which in turn influences feed-forward drive to cortex [S.M. Sherman & R.W. Guillery (2001) Exploring the Thalamus. Elsevier, Amstrerdam; S. Sherman & R. Guillery (2006) Exploring the Thalamus and Its Role in Cortical Functioning. Academic Press, New York, NY]. We extend these observations to argue that brain mechanisms for sensorimotor transformations involve cortical and subcortical circuits that create internal models as a substrate for action, that a key role of sensory inputs is to update such models, and that a major function of sensorimotor processing underlying cognition is to enable action selection and execution.

Habitual versus goal-driven attention

Recent research has expanded the list of factors that control spatial attention. Beside current goals and perceptual salience, statistical learning, reward, motivation and emotion also affect attention. But do these various factors influence spatial attention in the same manner, as suggested by the integrated framework of attention, or do they target different aspects of spatial attention? Here I present evidence that the control of attention may be implemented in two ways. Whereas current goals typically modulate where in space attention is prioritized, search habits affect how one moves attention in space. Using the location probability learning paradigm, I show that a search habit forms when people frequently find a visual search target in one region of space. Attentional cuing by probability learning differs from that by current goals. Probability cuing is implicit and persists long after the probability cue is no longer valid. Whereas explicit goal-driven attention codes space in an environment-centered reference frame, probability cuing is viewer-centered and is insensitive to secondary working memory load and aging. I propose a multi-level framework that separates the source of attentional control from its implementation. Similar to the integrated framework, the multi-level framework considers current goals, perceptual salience, and selection history as major sources of attentional control. However, these factors are implemented in two ways, controlling where spatial attention is allocated and how one shifts attention in space.

Building on a Solid Baseline: Anticipatory Biases in Attention

A brain-imaging paper by Kastner and colleagues in 1999 was the first to demonstrate that merely focusing attention at a spatial location changed the baseline activity level in various regions of human visual cortex even before any stimuli appeared. The study provided a touchstone for investigating cognitive–sensory interactions and understanding the proactive endogenous signals that shape perception.

Visual Selective Attention in Mice

Visual selective attention is a fundamental cognitive ability that allows us to process relevant visual stimuli while ignoring irrelevant distracters and has been extensively studied in human and non-human primate subjects. Mice have emerged as a powerful animal model for studying aspects of the visual system but have not yet been shown to exhibit visual selective attention. Differences in the organization of the visual systems of primates and mice raise the possibility that selective visual attention might not be present in mice, at least not in the forms that are well established in primates. Here, we tested for selective visual attention in mice by using three behavioral paradigms adapted from classic studies of attention. In a Posner-style cueing task, a spatial cue indicated the probable location of the relevant visual event, and we found that accuracy was higher and reaction times were shorter on validly cued trials. In a cue versus no-cue task, an informative spatial cue was provided on half the trials, and mice had higher accuracy and shorter reaction times with spatial cues and also lower detection thresholds measured from psychometric curves. In a filter task, the spatial cue indicated the location of the relevant visual event, and we found that mice could be trained to ignore irrelevant but otherwise identical visual events at uncued locations. Together, these results demonstrate that mice exhibit visual selective attention, paving the way to use classic attention paradigms in mice to study the genetic and neuronal circuit mechanisms of selective attention.

Perceptual Color Space Representations in the Oculomotor System Are Modulated by Surround Suppression and Biased Selection

The oculomotor system utilizes color extensively for planning saccades. Therefore, we examined how the oculomotor system actually encodes color and several factors that modulate these representations: attention-based surround suppression and inherent biases in selecting and encoding color categories. We measured saccade trajectories while human participants performed a memory-guided saccade task with color targets and distractors and examined whether oculomotor target selection processing was functionally related to the CIE (x,y) color space distances between color stimuli and whether there were hierarchical differences between color categories in the strength and speed of encoding potential saccade goals. We observed that saccade planning was modulated by the CIE (x,y) distances between stimuli thus demonstrating that color is encoded in perceptual color space by the oculomotor system. Furthermore, these representations were modulated by (1) cueing attention to a particular color thereby eliciting surround suppression in oculomotor color space and (2) inherent selection and encoding biases based on color category independent of cueing and perceptual discriminability. Since surround suppression emerges from recurrent feedback attenuation of sensory projections, observing oculomotor surround suppression suggested that oculomotor encoding of behavioral relevance results from integrating sensory and cognitive signals that are pre-attenuated based on task demands and that the oculomotor system therefore does not functionally contribute to this process. Second, although perceptual discriminability did partially account for oculomotor processing differences between color categories, we also observed preferential processing of the red color category across various behavioral metrics. This is consistent with numerous previous studies and could not be simply explained by perceptual discriminability. Since we utilized a memory-guided saccade task, this indicates that the biased processing of the red color category does not rely on sustained sensory input and must therefore involve cortical areas associated with the highest levels of visual processing involved in visual working memory.

Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex

In uncertain environments, decision-makers must balance two goals: they must "exploit" rewarding options but also "explore" in order to discover rewarding alternatives. Exploring and exploiting necessarily change how the brain responds to identical stimuli, but little is known about how these states, and transitions between them, change how the brain transforms sensory information into action. To address this question, we recorded neural activity in a prefrontal sensorimotor area while monkeys naturally switched between exploring and exploiting rewarding options. We found that exploration profoundly reduced spatially selective, choice-predictive activity in single neurons and delayed choice-predictive population dynamics. At the same time, reward learning was increased in brain and behavior. These results indicate that exploration is related to sudden disruptions in prefrontal sensorimotor control and rapid, reward-dependent reorganization of control dynamics. This may facilitate discovery through trial and error.

Electrical stimulation of macaque lateral prefrontal cortex modulates oculomotor behavior indicative of a disruption of top-down attention

The lateral prefrontal cortex (lPFC) of primates is hypothesized to be heavily involved in decision-making and selective visual attention. Recent neurophysiological evidence suggests that information necessary for an orchestration of those high-level cognitive factors are indeed represented in the lPFC. However, we know little about the specific contribution of sub-networks within lPFC to the deployment of top-down influences that can be measured in extrastriate visual cortex. Here, we systematically applied electrical stimulations to areas 8Av and 45 of two macaque monkeys performing a concurrent goal-directed saccade task. Despite using currents well above saccadic thresholds of the directly adjacent Frontal Eye Fields (FEF), saccades were only rarely evoked by the stimulation. Instead, two types of behavioral effects were observed: Stimulations of caudal sites in 8Av (close to FEF) shortened or prolonged saccadic reaction times, depending on the task-instructed saccade, while rostral stimulations of 8Av/45 seem to affect the relative attentional weighting of saccade targets as well as saccadic reaction times. These results illuminate important differences in the causal involvement of different sub-networks within the lPFC and are most compatible with a stimulation-induced biasing of stimulus processing that accelerates the detection of saccade targets presented ipsilateral to stimulation through a disruption of contralaterally deployed top-down attention.

Overt and covert attention to location-based reward

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities.

Top-Down Control of Visual Attention by the Prefrontal Cortex. Functional Specialization and Long-Range Interactions

The ability to select information that is relevant to current behavioral goals is the hallmark of voluntary attention and an essential part of our cognition. Attention tasks are a prime example to study at the neuronal level, how task related information can be selectively processed in the brain while irrelevant information is filtered out. Whereas, numerous studies have focused on elucidating the mechanisms of visual attention at the single neuron and population level in the visual cortices, considerably less work has been devoted to deciphering the distinct contribution of higher-order brain areas, which are known to be critical for the employment of attention. Among these areas, the prefrontal cortex (PFC) has long been considered a source of top-down signals that bias selection in early visual areas in favor of the attended features. Here, we review recent experimental data that support the role of PFC in attention. We examine the existing evidence for functional specialization within PFC and we discuss how long-range interactions between PFC subregions and posterior visual areas may be implemented in the brain and contribute to the attentional modulation of different measures of neural activity in visual cortices.

Memory-guided saccades show effect of a perceptual illusion whereas visually guided saccades do not

The double-drift stimulus (a drifting Gabor with orthogonal internal motion) generates a large discrepancy between its physical and perceived path. Surprisingly, saccades directed to the double-drift stimulus land along the physical, and not perceived, path (Lisi M, Cavanagh P. Curr Biol 25: 2535-2540, 2015). We asked whether memory-guided saccades exhibited the same dissociation from perception. Participants were asked to keep their gaze centered on a fixation dot while the double-drift stimulus moved back and forth on a linear path in the periphery. The offset of the fixation was the go signal to make a saccade to the target. In the visually guided saccade condition, the Gabor kept moving on its trajectory after the go signal but was removed once the saccade began. In the memory conditions, the Gabor disappeared before or at the same time as the go-signal (0- to 1,000-ms delay) and participants made a saccade to its remembered location. The results showed that visually guided saccades again targeted the physical rather than the perceived location. However, memory saccades, even with 0-ms delay, had landing positions shifted toward the perceived location. Our result shows that memory- and visually guided saccades are based on different spatial information. NEW & NOTEWORTHY We compared the effect of a perceptual illusion on two types of saccades, visually guided vs. memory-guided saccades, and found that whereas visually guided saccades were almost unaffected by the perceptual illusion, memory-guided saccades exhibited a strong effect of the illusion. Our result is the first evidence in the literature to show that visually and memory-guided saccades use different spatial representations.

The active construction of the visual world

What we see is fundamentally dependent on where we look. Despite this seemingly obvious statement, many accounts of the neurobiology underpinning visual perception fail to consider the active nature of how we sample our sensory world. This review offers an overview of the neurobiology of visual perception, which begins with the control of saccadic eye movements. Starting from here, we can follow the anatomy backwards, to try to understand the functional architecture of neuronal networks that support the interrogation of a visual scene. Many of the principles encountered in this exercise are equally applicable to other perceptual modalities. For example, the somatosensory system, like the visual system, requires the sampling of data through mobile receptive epithelia. Analysis of a somatosensory scene depends on what is palpated, in much the same way that visual analysis relies on what is foveated. The discussion here is structured around the anatomical systems involved in active vision and visual scene construction, but will use these systems to introduce some general theoretical considerations. We will additionally highlight points of contact between the biology and the pathophysiology that has been proposed to cause a clinical disorder of scene construction - spatial hemineglect.

Effector-based attention systems

Visual processing is known to be enhanced at the end point of eye movements. Feedback within the oculomotor system has been shown to drive these alterations in visual processing. However, we do not simply view the world; we also reach out and interact using our hands. Consequently, it is not surprising that visual processing has also been shown to be altered in near-hand space. A growing body of work documents a myriad of alterations in near-hand visual processing, with little consensus on the neural underpinnings of the effect of the hand. Since movement of the eyes and hands is governed by parallel frontoparietal networks and since within the oculomotor system feedback from these motor control regions has been shown to drive enhanced visual processing at saccade end points, it is plausible that a similar feedback mechanism is at play in near-hand improvements in visual processing. Here, we compare and contrast oculomotor-driven and hand-driven changes in visual processing and provide support for the hypothesis that feedback within the reaching and grasping systems enhances visual processing near the hand in a novel way.

Transcranial ultrasonic stimulation modulates single-neuron discharge in macaques performing an antisaccade task

BACKGROUND

Low intensity transcranial ultrasonic stimulation (TUS) has been demonstrated to non-invasively and transiently stimulate the nervous system. Although US neuromodulation has appeared robust in rodent studies, the effects of US in large mammals and humans have been modest at best. In addition, there is a lack of direct recordings from the stimulated neurons in response to US. Our study investigates the magnitude of the US effects on neuronal discharge in awake behaving monkeys and thus fills the void on both fronts.

OBJECTIVE/HYPOTHESIS

In this study, we demonstrate the feasibility of recording action potentials in the supplementary eye field (SEF) as TUS is applied simultaneously to the frontal eye field (FEF) in macaques performing an antisaccade task.

RESULTS

We show that compared to a control stimulation in the visual cortex, SEF activity is significantly modulated shortly after TUS onset. Among all cell types 40% of neurons significantly changed their activity after TUS. Half of the neurons showed a transient increase of activity induced by TUS.

CONCLUSION

Our study demonstrates that the neuromodulatory effects of non-invasive focused ultrasound can be assessed in real time in awake behaving monkeys by recording discharge activity from a brain region reciprocally connected with the stimulated region. The study opens the door for further parametric studies for fine-tuning the ultrasonic parameters. The ultrasonic effect could indeed be quantified based on the direct measurement of the intensity of the modulation induced on a single neuron in a freely performing animal. The technique should be readily reproducible in other primate laboratories studying brain function, both for exploratory and therapeutic purposes and to facilitate the development of future clinical TUS devices.

Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments

Little is known about the relationship between attention and learning during decision making. Using eye tracking and multivariate pattern analysis of fMRI data, we measured participants' dimensional attention as they performed a trial-and-error learning task in which only one of three stimulus dimensions was relevant for reward at any given time. Analysis of participants' choices revealed that attention biased both value computation during choice and value update during learning. Value signals in the ventromedial prefrontal cortex and prediction errors in the striatum were similarly biased by attention. In turn, participants' focus of attention was dynamically modulated by ongoing learning. Attentional switches across dimensions correlated with activity in a frontoparietal attention network, which showed enhanced connectivity with the ventromedial prefrontal cortex between switches. Our results suggest a bidirectional interaction between attention and learning: attention constrains learning to relevant dimensions of the environment, while we learn what to attend to via trial and error.

Changes in perceptual sensitivity related to spatial cues depends on subcortical activity

Spatial cues allow animals to selectively attend to relevant visual stimuli while ignoring distracters. This process depends on a distributed neuronal network, and an important current challenge is to understand the functional contributions made by individual brain regions within this network and how these contributions interact. Recent findings point to a possible anatomical segregation, with cortical and subcortical brain regions contributing to different functional components of selective attention. Cortical areas, especially visual cortex, may be responsible for implementing changes in perceptual sensitivity by changing the signal-to-noise ratio, whereas other regions, such as the superior colliculus, may be involved in processes that influence selection between competing stimuli without regulating perceptual sensitivity. Such a segregation of function would predict that when activity in the superior colliculus is suppressed by reversible inactivation, animals should still show changes in perceptual sensitivity mediated by the intact cortical circuits. Contrary to this prediction, here we report that inactivation of the primate superior colliculus eliminates the changes in perceptual sensitivity made possible by spatial cues. These findings demonstrate changes in perceptual sensitivity depend not only on neuronal activity in cortex but also require interaction with signals from the superior colliculus.

Spatial working memory alters the efficacy of input to visual cortex

Prefrontal cortex modulates sensory signals in extrastriate visual cortex, in part via its direct projections from the frontal eye field (FEF), an area involved in selective attention. We find that working memory-related activity is a dominant signal within FEF input to visual cortex. Although this signal alone does not evoke spiking responses in areas V4 and MT during memory, the gain of visual responses in these areas increases, and neuronal receptive fields expand and shift towards the remembered location, improving the stimulus representation by neuronal populations. These results provide a basis for enhancing the representation of working memory targets and implicate persistent FEF activity as a basis for the interdependence of working memory and selective attention.

Frontal eye field (FEF) is a visual prefrontal area involved in top-down attention. Here the authors report that FEF neurons projecting to V4/MT are persistently active during spatial working memory, and V4/MT neurons show changes in receptive field and gain at the location held in working memory.

Response Inhibition Is Facilitated by a Change to Red Over Green in the Stop Signal Paradigm

Actions are informed by the complex interactions of response execution and inhibition networks. These networks integrate sensory information with internal states and behavioral goals to produce an appropriate action or to update an ongoing action. Recent investigations have shown that, behaviorally, attention is captured through a hierarchy of colors. These studies showed how the color hierarchy affected visual processing. To determine whether the color hierarchy can be extended to higher level executive functions such as response execution and inhibition, we conducted several experiments using the stop-signal task (SST). In the first experiment, we modified the classic paradigm so that the go signals could vary in task-irrelevant color, with an auditory stop signal. We found that the task-irrelevant color of the go signals did not differentially affect response times. In the second experiment we determined that making the color of the go signal relevant for response selection still did not affect reaction times(RTs) and, thus, execution. In the third experiment, we modified the paradigm so that the stop signal was a task relevant change in color of the go signal. The mean RT to the red stop signal was approximately 25 ms faster than to the green stop signal. In other words, red stop signals facilitated response inhibition more than green stop signals, however, there was no comparative facilitation of response execution. These findings suggest that response inhibition, but not execution, networks are sensitive to differences in color salience. They also suggest that the color hierarchy is based on attentional networks and not simply on early sensory processing.

Neural Mechanisms of Selective Visual Attention

Selective visual attention describes the tendency of visual processing to be confined largely to stimuli that are relevant to behavior. It is among the most fundamental of cognitive functions, particularly in humans and other primates for whom vision is the dominant sense. We review recent progress in identifying the neural mechanisms of selective visual attention. We discuss evidence from studies of different varieties of selective attention and examine how these varieties alter the processing of stimuli by neurons within the visual system, current knowledge of their causal basis, and methods for assessing attentional dysfunctions. In addition, we identify some key questions that remain in identifying the neural mechanisms that give rise to the selective processing of visual information.

Laminar Organization of Attentional Modulation in Macaque Visual Area V4

Attention is critical to perception, serving to select behaviorally relevant information for privileged processing. To understand the neural mechanisms of attention, we must discern how attentional modulation varies by cell type and across cortical layers. Here, we test whether attention acts non-selectively across cortical layers or whether it engages the laminar circuit in specific and selective ways. We find layer- and cell-class-specific differences in several different forms of attentional modulation in area V4. Broad-spiking neurons in the superficial layers exhibit attention-mediated increases in firing rate and decreases in variability. Spike count correlations are highest in the input layer and attention serves to reduce these correlations. Superficial and input layer neurons exhibit attention-dependent decreases in low-frequency (<10 Hz) coherence, but deep layer neurons exhibit increases in coherence in the beta and gamma frequency ranges. Our study provides a template for attention-mediated laminar information processing that might be applicable across sensory modalities.

Saccadic Adaptation Alters the Attentional Field

It is currently unknown whether changes to the oculomotor system can induce changes to the distribution of spatial attention around a fixated target. Previous studies have used perceptual performance tasks to show that adaptation of saccadic eye movements affects dynamic properties of visual attention, in particular, attentional shifts to a cued location. In this study, we examined the effects of saccadic adaptation on the static distribution of visual attention around fixation (attentional field). We used the classic double step adaptation procedure and a flanker task to test for differences in the attentional field after forward and backward adaptation. Reaction time (RT) measures revealed that the shape of the attentional field changed significantly after backward adaptation as shown through altered interference from distracters at different eccentricities but not after forward adaptation. This finding reveals that modification of saccadic amplitudes can affect metrics of not only dynamic properties of attention but also its static properties. A major implication is that the neural mechanisms underlying fundamental selection mechanisms and the oculomotor system can reweight each other.

Functional coupling between frontoparietal and occipitotemporal pathways during action and perception

Several lines of evidence point to areas in the occipitotemporal pathway as being critical in the processes of visual perception and object recognition. Much less appreciated, however, is the role that this pathway plays in object-related processing for the purposes of visually guided action. Here, using functional MRI (fMRI) and functional connectivity (FC) measures, we examined interactions between areas in frontoparietal cortex (FPC) involved in grasping, reaching, eye movements, and tool use and areas in occipitotemporal cortex (OTC) involved in object-, face-, scene-, body-, tool-, and motion-related processing, both during the performance of sensorimotor and visual-perceptual tasks, as well as during passive fixation (resting-state). Cluster analysis of regional time course data identified correspondence in the patterns of FPC and OTC connectivity during the visual-perceptual tasks and rest that both tended to segregate regions along traditional dorsal/ventral pathway boundaries. During the sensorimotor tasks, however, we observed a notable separation in functional coupling between ventral-medial and ventral-lateral regions of OTC, with several of the latter areas often being clustered together with sensorimotor-defined areas in parietal cortex. These findings indicate that the functional coupling of ventral-lateral OTC areas to dorsal parietal and ventral-medial structures is flexible and task-dependent, and suggests that regions in lateral occipital cortex, in particular, may play an important role in mediating interactions between the dorsal and ventral pathways during tasks involving sensorimotor control.

Action Enhances Acoustic Cues for 3-D Target Localization by Echolocating Bats

Under natural conditions, animals encounter a barrage of sensory information from which they must select and interpret biologically relevant signals. Active sensing can facilitate this process by engaging motor systems in the sampling of sensory information. The echolocating bat serves as an excellent model to investigate the coupling between action and sensing because it adaptively controls both the acoustic signals used to probe the environment and movements to receive echoes at the auditory periphery. We report here that the echolocating bat controls the features of its sonar vocalizations in tandem with the positioning of the outer ears to maximize acoustic cues for target detection and localization. The bat’s adaptive control of sonar vocalizations and ear positioning occurs on a millisecond timescale to capture spatial information from arriving echoes, as well as on a longer timescale to track target movement. Our results demonstrate that purposeful control over sonar sound production and reception can serve to improve acoustic cues for localization tasks. This finding also highlights the general importance of movement to sensory processing across animal species. Finally, our discoveries point to important parallels between spatial perception by echolocation and vision.

As an echolocating bat tracks a moving target, it produces head waggles and adjusts the separation of the tips of its ears to enhance cues for target detection and localization. These findings suggest parallels in active sensing between echolocation and vision.

As animals operate in the natural environment, they must detect and process relevant sensory information embedded in complex and noisy signals. One strategy to overcome this challenge is to use active sensing or behavioral adjustments to extract sensory information from a selected region of the environment. We studied one of nature’s champions in auditory active sensing—the echolocating bat—to understand how this animal extracts task-relevant acoustic cues to detect and track a moving target. The bat produces high-frequency vocalizations and processes information carried by returning echoes to navigate and catch prey. This animal serves as an excellent model of active sensing because both sonar signal transmission and echo reception are under the animal’s active control. We used high-speed stereo video images of the bat’s head and ear movements, along with synchronized audio recordings, to study how the bat coordinates adaptive motor behaviors when detecting and tracking moving prey. We found that the bat synchronizes changes in sonar vocal production with changes in the movements of the head and ears to enhance acoustic cues for target detection and localization.

Eye fixation during multiple object attention is based on a representation of discrete spatial foci

We often look at and attend to several objects at once. How the brain determines where to point our eyes when we do this is poorly understood. Here we devised a novel paradigm to discriminate between different models of spatial selection guiding fixation. In contrast to standard static attentional tasks where the eye remains fixed at a predefined location, observers selected their own preferred fixation position while they tracked static targets that were arranged in specific geometric configurations and which changed identity over time. Fixations were best predicted by a representation of discrete spatial foci, not a polygonal grouping, simple 2-foci division of attention or a circular spotlight. Moreover, attentional performance was incompatible with serial selection. Together with previous studies, our findings are compatible with a view that attentional selection and fixation rely on shared spatial representations and suggest a more nuanced definition of overt vs. covert attention.

A Causal Role for the Cortical Frontal Eye Fields in Microsaccade Deployment

Microsaccades aid vision by helping to strategically sample visual scenes. Despite the importance of these small eye movements, no cortical area has ever been implicated in their generation. Here, we used unilateral and bilateral reversible inactivation of the frontal eye fields (FEF) to identify a cortical drive for microsaccades. Unexpectedly, FEF inactivation altered microsaccade metrics and kinematics. Such inactivation also impaired microsaccade deployment following peripheral cue onset, regardless of cue side or inactivation configuration. Our results demonstrate that the FEF provides critical top-down drive for microsaccade generation, particularly during the recovery of microsaccades after disruption by sensory transients. Our results constitute the first direct evidence, to our knowledge, for the contribution of any cortical area to microsaccade generation, and they provide a possible substrate for how cognitive processes can influence the strategic deployment of microsaccades.

Our eyes are constantly in motion. This study shows that the frontal eye fields (an area of the frontal cortex) contribute to the strategic deployment of microsaccades, which aid vision by precisely translating retinal images by a few photoreceptors.

Microsaccades are small, fixational eye movements that precisely relocate the visual axis. Despite evidence that microsaccades can be strategically controlled in high-acuity visual tasks, impacting visual processing, and considerable knowledge about how microsaccades are generated by the oculomotor brainstem, little is known about the cortical substrates that control microsaccades. To address this gap, we examined microsaccades generated by non-human primates before, during, and after large-volume reversible unilateral or bilateral inactivation of the frontal eye fields, a key oculomotor area in the frontal cortex. In support of a role for the frontal eye fields in microsaccades, microsaccade metrics and kinematics were altered during frontal eye fields inactivation. More surprisingly, frontal eye fields inactivation also impaired the generation of microsaccades following presentation of peripheral cues, regardless of the side of the cue or inactivation configuration. To our knowledge, our results constitute the first direct evidence for the contribution of any cortical area to microsaccade generation and suggest that the frontal eye fields can provide the top-down signals to the oculomotor brainstem needed to strategically guide microsaccades.

What single-cell stimulation has told us about neural coding

In recent years, single-cell stimulation experiments have resulted in substantial progress towards directly linking single-cell activity to movement and sensation. Recent advances in electrical recording and stimulation techniques have enabled control of single neuron spiking in vivo and have contributed to our understanding of neuronal coding schemes in the brain. Here, we review single neuron stimulation effects in different brain structures and how they vary with artificially inserted spike patterns. We briefly compare single neuron stimulation with other brain stimulation techniques. A key advantage of single neuron stimulation is the precise control of the evoked spiking patterns. Systematically varying spike patterns and measuring evoked movements and sensations enables 'decoding' of the single-cell spike patterns and provides insights into the readout mechanisms of sensory and motor cortical spikes.