Using auditory and visual stimuli to investigate the behavioral and neuronal consequences of reflexive covert orienting

Inhibitory tagging in the superior colliculus during visual search

Inhibitory tagging is an important feature of many models of saccade target selection, in particular those that are based on the notion of a neural priority map. The superior colliculus (SC) has been suggested as a potential site of such a map, yet it is unknown whether inhibitory tagging is represented in the SC during visual search. In this study, we tested the hypothesis that SC neurons represent inhibitory tagging during search, as might be expected if they contribute to a priority map. To do so, we recorded the activity of SC neurons in a multisaccade visual-search task. On each trial, a single reward-bearing target was embedded in an array of physically identical, potentially reward-bearing targets and physically distinct, non-reward-bearing distractors. The task was to fixate the reward-bearing target. We found that, in the context of this task, the activity of many SC neurons was greater when their response field stimulus was a target than when it was a distractor and was reduced when it had been previously fixated relative to when it had not. Moreover, we found that the previous-fixation-related reduction of activity was larger for targets than for distractors and decreased with increasing time (or number of saccades) since fixation. Taken together, the results suggest that fixated stimuli are transiently inhibited in the SC during search, consistent with the notion that inhibitory tagging plays an important role in visual search and that SC neurons represent this inhibition as part of a priority map used for saccade target selection.NEW & NOTEWORTHY Searching a cluttered scene for an object of interest is a ubiquitous task in everyday life, which we often perform relatively quickly and efficiently. It has been suggested that to achieve such speed and efficiency an inhibitory-tagging mechanism inhibits saccades to objects in the scene once they have been searched and rejected. Here, we demonstrate that the superior colliculus represents this type of inhibition during search, consistent with its role in saccade target selection.

The effect of seasonality and weather conditions on human perception of the urban-rural transitional landscape

Landscape perception research into the impact of seasonally changing landscape characteristics with the simultaneous influence of the weather are rare. Therefore, eye-tracking metrics were calculated (fixation and saccades) for the whole tested landscape, while its areas of interest (AOIs) were established based on clustering methods. Moreover, the gaze pattern was analysed using the Voronoi cells method. To identify significant differences in landscape perception according to various weather and seasonality, nonparametric tests were applied. The significant influence of weather/seasonality and their synergistic influence is noticed. The results indicate a rather complex influence of the types of weather in warmer and cooler seasons. Regardless of the weather type, seasonal changes cause greater visual span and shorter fixations in the warmer season. The fixations and saccades are shorter in the warmer season in two AOI's during positive weather, but are longer in negative weather during the colder season in most AOI's. The main reasons for the influence of weather and seasonality on the visual perception include seasonal changes in the landscape, resulting in the appearance of the landscape from more urban to natural and vice versa (phenological changes) as well as lighting changes (due to seasonality and type of weather).

Attention to Stimuli of Learned versus Innate Biological Value Relies on Separate Neural Systems

The neural bases of attention, a set of neural processes that promote behavioral selection, is a subject of intense investigation. In humans, rewarded cues influence attention, even when those cues are irrelevant to the current task. Because the amygdala plays a role in reward processing, and the activity of amygdala neurons has been linked to spatial attention, we reasoned that the amygdala may be essential for attending to rewarded images. To test this possibility, we used an attentional capture task, which provides a quantitative measure of attentional bias. Specifically, we compared reaction times (RTs) of adult male rhesus monkeys with bilateral amygdala lesions and unoperated controls as they made a saccade away from a high- or low-value rewarded image to a peripheral target. We predicted that: (1) RTs will be longer for high- compared with low-value images, revealing attentional capture by rewarded stimuli; and (2) relative to controls, monkeys with amygdala lesions would exhibit shorter RT for high-value images. For comparison, we assessed the same groups of monkeys for attentional capture by images of predators and conspecifics, categories thought to have innate biological value. In performing the attentional capture task, all monkeys were slowed more by high-value relative to low-value rewarded images. Contrary to our prediction, amygdala lesions failed to disrupt this effect. When presented with images of predators and conspecifics, however, monkeys with amygdala lesions showed significantly diminished attentional capture relative to controls. Thus, separate neural pathways are responsible for allocating attention to stimuli with learned versus innate value.SIGNIFICANCE STATEMENT Valuable objects attract attention. The amygdala is known to contribute to reward processing and the encoding of object reward value. We therefore examined whether the amygdala is necessary for allocating attention to rewarded objects. For comparison, we assessed the amygdala's contribution to attending to objects with innate biological value: predators and conspecifics. We found that the macaque amygdala is necessary for directing attention to images with innate biological value, but not for directing attention to recently learned reward-predictive images. These findings indicate that the amygdala makes selective contributions to attending to valuable objects. The data are relevant to mental health disorders, such as social anxiety disorders and small animal phobias, that arise from biased attention to select categories of objects.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

An inferior-superior colliculus circuit controls auditory cue-directed visual spatial attention

Selective attention modulates neuronal activity in multiple brain regions, but the origins of attention signals remain unclear. We show that, during a visual task requiring spatial attention directed by an auditory cue, an inferior-superior colliculus circuit provides the key attention signal. In mice performing a task based on a visual stimulus in the cued hemifield while ignoring a conflicting stimulus on the uncued side, the visual cortex (V1) and superior colliculus (SC) showed strong attentional modulation, with a shorter latency in the SC. The nucleus of the brachium of the inferior colliculus (nBIC), which provides auditory inputs to the SC, was activated not only at auditory cue onset but also during the delay period before the visual stimulus. The delay activity, but not cue onset activity, was crucial for task performance and attentional modulation in the SC and V1. These results establish a new behavioral paradigm for studying visual attention in mice and identify a midbrain signal controlling auditory cue-directed spatial attention.

Delayed Onset of Inhibition of Return in Visual Snow Syndrome

Visual snow syndrome (VSS) is a complex, sensory processing disorder. We have previously shown that visual processing changes manifest in significantly faster eye movements toward a suddenly appearing visual stimulus and difficulty inhibiting an eye movement toward a non-target visual stimulus. We propose that these changes reflect poor attentional control and occur whether attention is directed exogenously by a suddenly appearing event, or endogenously as a function of manipulating expectation surrounding an upcoming event. Irrespective of how attention is captured, competing facilitatory and inhibitory processes prioritise sensory information that is important to us, filtering out that which is irrelevant. A well-known feature of this conflict is the alteration to behaviour that accompanies variation in the temporal relationship between competing sensory events that manipulate facilitatory and inhibitory processes. A classic example of this is the “Inhibition of Return” (IOR) phenomenon that describes the relative slowing of a response to a validly cued location compared to invalidly cued location with longer cue/target intervals. This study explored temporal changes in the allocation of attention using an ocular motor version of Posner's IOR paradigm, manipulating attention exogenously by varying the temporal relationship between a non-predictive visual cue and target stimulus. Forty participants with VSS (20 with migraine) and 20 controls participated. Saccades were generated to both validly cued and invalidly cued targets with 67, 150, 300, and 500 ms cue/target intervals. VSS participants demonstrated delayed onset of IOR. Unlike controls, who exhibited IOR with 300 and 500 ms cue/target intervals, VSS participants only exhibited IOR with 500 ms cue/target intervals. These findings provide further evidence that attention is impacted in VSS, manifesting in a distinct saccadic behavioural profile, and delayed onset of IOR. Whether IOR is perceived as the build-up of an inhibitory bias against returning attention to an already inspected location or a consequence of a stronger attentional orienting response elicited by the cue, our results are consistent with the proposal that in VSS, a shift of attention elicits a stronger increase in saccade-related activity than healthy controls. This work provides a more refined saccadic behavioural profile of VSS that can be interrogated further using sophisticated neuroimaging techniques and may, in combination with other saccadic markers, be used to monitor the efficacy of any future treatments.

Factors Influencing Saccadic Reaction Time: Effect of Task Modality, Stimulus Saliency, Spatial Congruency of Stimuli, and Pupil Size

It is often assumed that the reaction time of a saccade toward visual and/or auditory stimuli reflects the sensitivities of our oculomotor-orienting system to stimulus saliency. Endogenous factors, as well as stimulus-related factors, would also affect the saccadic reaction time (SRT). However, it was not clear how these factors interact and to what extent visual and auditory-targeting saccades are accounted for by common mechanisms. The present study examined the effect of, and the interaction between, stimulus saliency and audiovisual spatial congruency on the SRT for visual- and for auditory-target conditions. We also analyzed pre-target pupil size to examine the relationship between saccade preparation and pupil size. Pupil size is considered to reflect arousal states coupling with locus-coeruleus (LC) activity during a cognitive task. The main findings were that (1) the pattern of the examined effects on the SRT varied between visual- and auditory-auditory target conditions, (2) the effect of stimulus saliency was significant for the visual-target condition, but not significant for the auditory-target condition, (3) Pupil velocity, not absolute pupil size, was sensitive to task set (i.e., visual-targeting saccade vs. auditory-targeting saccade), and (4) there was a significant correlation between the pre-saccade absolute pupil size and the SRTs for the visual-target condition but not for the auditory-target condition. The discrepancy between target modalities for the effect of pupil velocity and between the absolute pupil size and pupil velocity for the correlation with SRT may imply that the pupil effect for the visual-target condition was caused by a modality-specific link between pupil size modulation and the SC rather than by the LC-NE (locus coeruleus-norepinephrine) system. These results support the idea that different threshold mechanisms in the SC may be involved in the initiation of saccades toward visual and auditory targets.

Asymmetrical Pseudo-Extinction Phenomenon in the Illusory Line Motion

Illusory Line Motion (i.e., a static line, presented after a lateral cue, is perceived as movement in the opposite direction to the cue) has been used to study a phenomenon of perceptual asymmetry. We have demonstrated the presence of an illusion of leftward movement, even in the presence of bilateral symmetrical cues. We have classified this phenomenon as one of pseudo-extinction. The paradigm of the four experiments performed was always the same: a white line, briefly presented alone or preceded by one or two lateral cues (150 ms), was judged by a group of young participants to be moving either to one side or the other. The asymmetrical effect in the bilateral cue condition was observed with horizontal lines (Experiment 1 and 4), and not with vertical or oblique (Experiment 2 and 3). These results suggest that the effect is linked to the asymmetry of the horizontal spatial planum and the mechanisms of spatial attention. Experiment 4 verified whether the Illusory Line Motion involves the collicular pathway by using blue stimuli for the cues, which activate less the Superior Colliculus (SC), with negative results. We interpreted the asymmetrical pseudo-extinction phenomenon in terms of a right-space exogenous attention advantage.

Inhibitory and Facilitatory Cueing Effects: Competition between Exogenous and Endogenous Mechanisms

Inhibition of return is characterized by delayed responses to previously attended locations when the cue-target onset asynchrony (CTOA) is long enough. However, when cues are predictive of a target’s location, faster reaction times to cued as compared to uncued targets are normally observed. In this series of experiments investigating saccadic reaction times, we manipulated the cue predictability to 25% (counterpredictive), 50% (nonpredictive), and 75% (predictive) to investigate the interaction between predictive endogenous facilitatory (FCEs) and inhibitory cueing effects (ICEs). Overall, larger ICEs were seen in the counterpredictive condition than in the nonpredictive condition, and no ICE was found in the predictive condition. Based on the hypothesized additivity of FCEs and ICEs, we reasoned that the null ICEs observed in the predictive condition are the result of two opposing mechanisms balancing each other out, and the large ICEs observed with counterpredictive cueing can be attributed to the combination of endogenous facilitation at uncued locations with inhibition at cued locations. Our findings suggest that the endogenous activity contributed by cue predictability can reduce the overall inhibition observed when the mechanisms occur at the same location, or enhance behavioral inhibition when the mechanisms occur at opposite locations.

The gap effect reduces both manual and saccadic inhibition of return (IOR)

Inhibition of return (IOR) is the effect of slower responses to validly than invalidly cued targets. The discovery of IOR raised controversy as to whether it has two “flavors”, i.e., attentional/perceptual and motoric, or whether it is a homogeneous visual-motor phenomenon that should be understood in terms of the preparation of different effectors (mainly eye movement). Since manipulation of fixation offset (0 and 200 ms gap) is believed to affect the latency of saccades, we measured its influence on saccadic and manual IOR with a simple keypress response when eye movements were forbidden. In the two experiments which we carried out, the fixation offset decreased IOR in both the saccadic and the manual conditions. The results suggest the limitations of the attentional hypothesis, which assumes that manual IOR is independent of the motoric component; they are also in line with the tenets of the oculomotor hypothesis of IOR.

Bimodal-divided attention attenuates visually induced inhibition of return with audiovisual targets

Inhibition of return (IOR) refers to the slower response to a target appearing at a previously attended location in a cue-target paradigm. It has been greatly explored in the visual or auditory modality. This study investigates differences between the IOR of audiovisual targets and the IOR of visual targets under conditions of modality-specific selective attention (Experiment 1) and divided-modalities attention (Experiment 2). We employed an exogenous spatial cueing paradigm and manipulated the modalities of targets, including visual, auditory, or audiovisual modalities. The participants were asked to detect targets in visual modality or both visual and auditory modalities, which were presented on the same (cued) or opposite (uncued) side as the preceding visual peripheral cues. In Experiment 1, we found the comparable IOR with visual and audiovisual targets when participants were asked to selectively focus on visual modality. In Experiment 2, however, there was a smaller magnitude of IOR with audiovisual targets as compared with visual targets when paying attention to both visual and auditory modalities. We also observed a reduced multisensory response enhancement effect and race model inequality violation at cued locations relative to uncued locations. These results provide the first evidence of the IOR with audiovisual targets. Furthermore, IOR with audiovisual targets decreases when paying attention to both modalities. The interaction between exogenous spatial attention and audiovisual integration is discussed.

Being fast or slow at naming depends on recency of experience

The speed with which we produce words (e.g., dog) changes depending on whether a word named in the past is from the same semantic category (e.g., cat) or not (e.g., vase). Strikingly, whereas earlier studies find that producing semantically related words speeds up subsequent naming, recent studies report that it slows down future naming. It is unclear why the same experience results in opposite effects and whether both effects originate within the language system. Using the same picture naming paradigm and materials, we manipulated the interval between two naming events, while reducing the influence of expectation. We observed facilitation when semantically related pictures were presented adjacently. By contrast, when semantically related pictures were separated by two unrelated pictures, interference was observed. The results suggest that both facilitation and interference effects emerge within the language system where changes are critically based on the interval between naming, rather than solely due to peripheral processes associated with task demands.

Neural correlate of auditory spatial attention allocation in the superior colliculus

This study is the physiological complement to previous behavioral work that demonstrated that rhesus monkeys are able to allocate attention about the surrounding space based on brief, broadband auditory cues. Single-unit recordings were taken from the intermediate layers of the superior colliculus (iSC) while the subjects oriented to visual and auditory targets in the context of a cuing task with their heads unrestrained. The results show a correlation between behavioral manifestations of attention allocation, attention capture and inhibition of return, and modulation of target-evoked responses in single iSC neurons. NEW & NOTEWORTHY These results show for the first time a neural correlate of attention capture and inhibition of return in response to auditory stimuli in the superior colliculus of the head-unrestrained monkey.

Change in sensitivity to visual error in superior colliculus during saccade adaptation

Saccadic eye movements provide a valuable model to study the brain mechanisms underlying motor learning. If a target is displaced surreptitiously while a saccade is underway, the saccade appears to be in error. If the error persists gradual neuronal adjustments cause the eye movement again to land near the target. This saccade adaptation typically follows an exponential time course, i.e., adaptation speed slows as adaptation progresses, indicating that the sensitivity to error decreases during adaptation. Previous studies suggested that the superior colliculus (SC) sends error signals to drive saccade adaptation. The objective of this study is to test whether the SC error signal is related to the decrease in the error sensitivity during adaptation. We show here that the visual activity of SC neurons, which is induced by a constant visual error that drives adaptation, decreases during saccade adaptation. This decrease of sensitivity to visual error was not correlated with the changes of primary saccade amplitude. Therefore, a possible interpretation of this result is that the reduction of visual sensitivity of SC neurons contributes an error sensitivity signal that could help control the saccade adaptation process.

Effects of a pretarget distractor on saccade reaction times across space and time in monkeys and humans

Previous studies have shown that the influence of a behaviorally irrelevant distractor on saccade reaction times (SRTs) varies depending on the temporal and spatial relationship between the distractor and the saccade target. We measured distractor influence on SRTs to a subsequently presented target, varying the spatial location and the timing between the distractor and the target. The distractor appeared at one of four equally eccentric locations, followed by a target (either 50 ms or 200 ms after) at one of 136 different locations encompassing an area of 20° square. We extensively tested two humans and two monkeys on this task to determine interspecies similarities and differences, since monkey neurophysiology is often used to interpret human behavioral findings. Results were similar across species; for the short interval (50 ms), SRTs were shortest to a target presented close to or at the distractor location and increased primarily as a function of the distance from the distractor. There was also an effect of distractor-target direction and visual field. For the long interval (200 ms) the results were inverted; SRTs were longest for short distances between the distractor and target and decreased as a function of distance from distractor. Both SRT patterns were well captured by a two-dimensional dynamic field model with short-distance excitation and long-distance inhibition, based upon known functional connectivity found in the superior colliculus that includes wide-spread excitation and inhibition. Based on these findings, we posit that the different time-dependent patterns of distractor-related SRTs can emerge from the same underlying neuronal mechanisms common to both species.

Orienting of visuo-spatial attention in complex 3D space: Search and detection

The ability to detect changes in the environment is necessary for appropriate interactions with the external world. Changes in the background go more unnoticed than foreground changes, possibly because attention prioritizes processing of foreground/near stimuli. Here, we investigated the detectability of foreground and background changes within natural scenes and the influence of stereoscopic depth cues on this. Using a flicker paradigm, we alternated a pair of images that were exactly same or differed for one single element (i.e., a color change of one object in the scene). The participants were asked to find the change that occurred either in a foreground or background object, while viewing the stimuli either with binocular and monocular cues (bmC) or monocular cues only (mC). The behavioral results showed faster and more accurate detections for foreground changes and overall better performance in bmC than mC conditions. The imaging results highlighted the involvement of fronto‐parietal attention controlling networks during active search and target detection. These attention networks did not show any differential effect as function of the presence/absence of the binocular cues, or the detection of foreground/background changes. By contrast, the lateral occipital cortex showed greater activation for detections in foreground compared to background, while area V3A showed a main effect of bmC vs. mC, specifically during search. These findings indicate that visual search with binocular cues does not impose any specific requirement on attention‐controlling fronto‐parietal networks, while the enhanced detection of front/near objects in the bmC condition reflects bottom‐up sensory processes in visual cortex. Hum Brain Mapp 36:2231–2247, 2015. © 2015 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Cholinergic modulation of stimulus-driven attentional capture

Distraction is one of the main problems encountered by people with degenerative diseases that are associated with reduced cortical cholinergic innervations. We examined the effects of donepezil, a cholinesterase inhibitor, on stimulus-driven attentional capture. Reflexive attention shifts to a distractor are usually elicited by abrupt peripheral changes. This bottom-up shift of attention to a salient item is thought to be the result of relatively inflexible hardwired mechanisms. Thirty young male participants were randomly allocated to one of two groups: placebo first/donepezil second session or the opposite. They were asked to locate a target appearing above and below fixation whilst a peripheral distractor moved abruptly (motion-jitter attentional capture condition) or not (baseline condition). A classical attentional capture effect was observed under placebo: moving distractors interfered with the task in slowing down response times as compared to the baseline condition with fixed distractors. Increased interference from moving distractors was found under donepezil. We suggest that attentional capture in our paradigm likely involved low level mechanisms such as automatic reflexive orienting. Peripheral motion-jitter elicited a rapid reflexive orienting response initiated by a cholinergic signal from the brainstem pedunculo-pontine nucleus that activates nicotinic receptors in the superior colliculus.

Identifying and quantifying multisensory integration: a tutorial review

We process information from the world through multiple senses, and the brain must decide what information belongs together and what information should be segregated. One challenge in studying such multisensory integration is how to quantify the multisensory interactions, a challenge that is amplified by the host of methods that are now used to measure neural, behavioral, and perceptual responses. Many of the measures that have been developed to quantify multisensory integration (and which have been derived from single unit analyses), have been applied to these different measures without much consideration for the nature of the process being studied. Here, we provide a review focused on the means with which experimenters quantify multisensory processes and integration across a range of commonly used experimental methodologies. We emphasize the most commonly employed measures, including single- and multiunit responses, local field potentials, functional magnetic resonance imaging, and electroencephalography, along with behavioral measures of detection, accuracy, and response times. In each section, we will discuss the different metrics commonly used to quantify multisensory interactions, including the rationale for their use, their advantages, and the drawbacks and caveats associated with them. Also discussed are possible alternatives to the most commonly used metrics.

Searching for inhibition of return in the rat using the covert orienting of attention task

Inhibition of return (IOR) is an important psychological construct describing inhibited responses to previously attended locations. In humans, it is investigated using Posner's cueing paradigm. This paradigm requires central visual fixation and detection of cued stimuli to the left or right of the fixation point. Stimuli can be validly or invalidly cued, appearing in the same or opposite location to the cue. Although a rat version of the spatial cueing paradigm (the covert orienting of attention task) does exist, IOR has so far not been demonstrated. We therefore investigated whether IOR could be robustly demonstrated in adult male rats using the covert orienting of attention task. This task is conducted in holed wall operant chambers with the central three holes mimicking the set-up for Posner cueing. Across four samples of rats (overall n = 84), we manipulated the following task parameters: stimulus onset asynchronies (Experiments 1-3), cue brightness (Experiment 1b) and the presence of a central reorienting event (Experiment 4). In Experiment 1, we also investigated strain differences by comparing Lister Hooded rats to Sprague-Dawley rats. Although Lister Hooded rats briefly showed evidence of IOR (Experiment 1a, and see Online Resource 1 data), we were unable to replicate this finding in our other experiments using different samples of this strain. Taken together, our findings suggest that IOR cannot be robustly demonstrated in the rat using the covert orienting of attention task conducted in holed wall operant chambers.

Transient pupil response is modulated by contrast-based saliency

The sudden appearance of a novel stimulus in the environment initiates a series of orienting responses that include coordinated shifts of gaze and attention, and also transient changes in pupil size. Although numerous studies have identified a significant effect of stimulus saliency on shifts of gaze and attention, saliency effects on pupil size are less understood. To examine salience-evoked pupil responses, we presented visual, auditory, or audiovisual stimuli while monkeys fixated a central visual spot. Transient pupil dilation was elicited after visual stimulus presentation regardless of target luminance relative to background, and auditory stimuli also evoked similar pupil responses. Importantly, the evoked pupil response was modulated by contrast-based saliency, with faster and larger pupil responses following the presentation of more salient stimuli. The initial transient component of pupil dilation was qualitatively similar to that evoked by weak microstimulation of the midbrain superior colliculus. The pupil responses elicited by audiovisual stimuli were well predicted by a linear summation of each modality response. Together, the results suggest that the transient pupil response, as one component of orienting, is modulated by contrast-based saliency, and the superior colliculus is likely involved in its coordination.

Gaze shifts to auditory and visual stimuli in cats

While much is known about the metrics and kinematics of gaze shifts to visual targets in cats, little is known about gaze shifts to auditory targets. Here, cats were trained to localize auditory and visual targets via gaze shifts. Five properties of gaze shifts to sounds were observed. First, gaze shifts were accomplished primarily by large head movements. Unlike primates, the head movement in cats often preceded eye movement though the relative timing of eye in head and head latencies depended upon the target modality and gaze shift magnitude. Second, gaze shift latencies to auditory targets tended to be shorter than equivalent shifts to visual targets for some conditions. Third, the main sequences relating gaze amplitude to maximum gaze velocity for auditory and visual targets were comparable. However, head movements to auditory and visual targets were less consistent than gaze shifts and tended to undershoot the targets by 30 % for both modalities. Fourth, at the end of gaze movement, the proportion of the gaze shift accomplished by the eye-in-head movement was greater to visual than auditory targets. On the other hand, at the end of head movement, the proportion of the gaze shift accomplished by the head was greater to auditory than visual targets. Finally, gaze shifts to long-duration auditory targets were accurate and precise and were similar to accuracy of gaze shifts to long-duration visual targets. Because the metrics of gaze shifts to visual and auditory targets are nearly equivalent, as well as their accuracy, we conclude that both sensorimotor tasks use primarily the same neural substrates for the execution of movement.

Superior colliculus and visual spatial attention

The superior colliculus (SC) has long been known to be part of the network of brain areas involved in spatial attention, but recent findings have dramatically refined our understanding of its functional role. The SC both implements the motor consequences of attention and plays a crucial role in the process of target selection that precedes movement. Moreover, even in the absence of overt orienting movements, SC activity is related to shifts of covert attention and is necessary for the normal control of spatial attention during perceptual judgments. The neuronal circuits that link the SC to spatial attention may include attention-related areas of the cerebral cortex, but recent results show that the SC's contribution involves mechanisms that operate independently of the established signatures of attention in visual cortex. These findings raise new issues and suggest novel possibilities for understanding the brain mechanisms that enable spatial attention.

Dissociable spatial and temporal effects of inhibition of return

Inhibition of return (IOR) refers to the relative suppression of processing at locations that have recently been attended. It is frequently explored using a spatial cueing paradigm and is characterized by slower responses to cued than to uncued locations. The current study investigates the impact of IOR on overt visual orienting involving saccadic eye movements. Using a spatial cueing paradigm, our experiments have demonstrated that at a cue-target onset asynchrony (CTOA) of 400 ms saccades to the vicinity of cued locations are not only delayed (temporal cost) but also biased away (spatial effect). Both of these effects are basically no longer present at a CTOA of 1200 ms. At a shorter 200 ms CTOA, the spatial effect becomes stronger while the temporal cost is replaced by a temporal benefit. These findings suggest that IOR has a spatial effect that is dissociable from its temporal effect. Simulations using a neural field model of the superior colliculus (SC) revealed that a theory relying on short-term depression (STD) of the input pathway can explain most, but not all, temporal and spatial effects of IOR.

Inhibition of return in a visual foraging task in non-human subjects

Inhibition of return is thought to help guide visual search by inhibiting the orienting of attention to previously attended locations. We have previously shown that, in a foraging visual search task, the neural responses to objects in parietal cortex are reduced after they have been examined. Here we ask whether the animals' reaction times (RTs) in the same task show a psychophysical correlate of inhibition of return: a slowing of reaction time in response to a probe placed at a previously fixated location. We trained three animals to perform an RT version of the visual foraging task. In the foraging task, subjects visually searched through an array of five identical distractors and five identical potential targets; one of which had a reward linked to it. In the RT variant of the task, subjects had to rapidly respond to a probe if it appeared. We found that RTs were slower for probes presented at locations that contained previously fixated objects, faster to potential targets and between the two for behaviorally irrelevant distractors that had not been fixated. These data show behavioral inhibitory tagging of previously fixated objects and suggest that the suppression of activity seen previously in the same task in parietal cortex could be a neural correlate of this mechanism.

Decision, sensation, and habituation: a multi-layer dynamic field model for Inhibition of Return

Inhibition of Return (IOR) is one of the most consistent and widely studied effects in experimental psychology. The effect refers to a delayed response to visual stimuli in a cued location after initial priming at that location. This article presents a dynamic field model for IOR. The model describes the evolution of three coupled activation fields. The decision field, inspired by the intermediate layer of the superior colliculus, receives endogenous input and input from a sensory field. The sensory field, inspired by earlier sensory processing, receives exogenous input. Habituation of the sensory field is implemented by a reciprocal coupling with a third field, the habituation field. The model generates IOR because, due to the habituation of the sensory field, the decision field receives a reduced target-induced input in cue-target-compatible situations. The model is consistent with single-unit recordings of neurons of monkeys that perform IOR tasks. Such recordings have revealed that IOR phenomena parallel the activity of neurons in the intermediate layer of the superior colliculus and that neurons in this layer receive reduced input in cue-target-compatible situations. The model is also consistent with behavioral data concerning temporal expectancy effects. In a discussion, the multi-layer dynamic field account of IOR is used to illustrate the broader view that behavior consists of a tuning of the organism to the environment that continuously and concurrently takes place at different spatiotemporal scales.

Subcortical mechanisms of feature-based attention

The degree to which spatial and feature-based attention are governed by similar control mechanisms is not clear. To explore this issue, I measured, during conditions of spatial or feature-based attention, activity in the human subcortical visual nuclei, which have precise retinotopic maps and are known to play important roles in the regulation of spatial attention but have limited selectivity of nonspatial features. Subjects attended to and detected changes in separate fields of moving or colored dots. When the fields were disjoint, spatially attending to one field enhanced hemodynamic responses in the superior colliculus (SC), lateral geniculate nucleus (LGN), and two retinotopic pulvinar nuclei. When the two dot fields were spatially overlapping, feature-based attention to the moving versus colored dots enhanced responses in the pulvinar nuclei and the majority of the LGN, including the magnocellular layers, and suppressed activity in some areas within the parvocellular layers; the SC was inconsistently modulated among subjects. The results demonstrate that feature-based attention operates throughout the visual system by prioritizing neurons encoding the attended information, including broadly tuned thalamic neurons. I conclude that spatial and feature-based attention operate via a common principle, but that spatial location is a special feature in that it is widely encoded in the brain, is used for overt orienting, and uses a specialized structure, the SC.

Visual adaptation and novelty responses in the superior colliculus

The brain's ability to ignore repeating, often redundant, information while enhancing novel information processing is paramount to survival. When stimuli are repeatedly presented, the response of visually sensitive neurons decreases in magnitude, that is, neurons adapt or habituate, although the mechanism is not yet known. We monitored the activity of visual neurons in the superior colliculus (SC) of rhesus monkeys who actively fixated while repeated visual events were presented. We dissociated adaptation from habituation as mechanisms of the response decrement by using a Bayesian model of adaptation, and by employing a paradigm including rare trials that included an oddball stimulus that was either brighter or dimmer. If the mechanism is adaptation, response recovery should be seen only for the brighter stimulus; if the mechanism is habituation, response recovery ('dishabituation') should be seen for both the brighter and dimmer stimuli. We observed a reduction in the magnitude of the initial transient response and an increase in response onset latency with stimulus repetition for all visually responsive neurons in the SC. Response decrement was successfully captured by the adaptation model, which also predicted the effects of presentation rate and rare luminance changes. However, in a subset of neurons with sustained activity in response to visual stimuli, a novelty signal akin to dishabituation was observed late in the visual response profile for both brighter and dimmer stimuli, and was not captured by the model. This suggests that SC neurons integrate both rapidly discounted information about repeating stimuli and novelty information about oddball events, to support efficient selection in a cluttered dynamic world.

Neural correlates of spatial orienting in the human superior colliculus

A natural visual scene contains more information than the visual system has the capacity to simultaneously process, requiring specific items to be selected for detailed analysis at the expense of others. Such selection and inhibition are fundamental in guiding search behavior, but the neural basis of these mechanisms remains unclear. Abruptly appearing visual items can automatically capture attention, but once attention has been directed away from the salient event, return to that same location is slowed. In non-human primates, signals associated with attentional capture (AC) and subsequent inhibition of return (IOR) have been recorded from the superior colliculus (SC)--a structure known to play a pivotal role in reflexive spatial orienting. Here, we sought to establish whether similar signals could be recorded from the human SC, as well as early retinotopic cortical visual areas, where signals associated with AC and IOR have yet to be investigated with respect to oculomotor responses. Using an optimized oculomotor paradigm together with high-field, high-spatial resolution functional magnetic resonance imaging and high-speed eye tracking, we demonstrate that BOLD signal changes recorded from the human SC correlate strongly with our saccadic measures of AC and IOR. A qualitatively similar pattern of responses was found for V1, but only the inhibitory response associated with IOR persisted through V2 and V3. Although the SC plays a role in mediating these automatic attentional biasing signals, the source of these signals is likely to lie in higher cortical areas.

Different functions in the cingulate cortex, a meta-analytic connectivity modeling study

The cingulate cortex is a structurally heterogeneous brain region involved in emotional, cognitive and motor tasks. With the aim of identifying which behavioral domains are associated with the activation of the cingulate cortex, we performed a structure based-meta-analysis using the activation likelihood estimation (ALE), which assesses statistical significant convergence of neuroimaging studies using the BrainMap database. To map the meta-analytic coactivation maps of the cingulate cortex (MACM), we subdivided the parenchyma along the rostro-caudal axis in 12 bilateral equispaced ROIs. ROIs were not chosen according to previously suggested subdivisions, as to obtain a completely data-driven result. Studies were included with one or more activation coordinates in at least one of the 12 pre-defined ROIs. The meta-analytic connectivity profile and behavioral domains profiles were identified for each ROI. Cluster analysis was then performed on the MACM and behavioral domains to group together ROIs with similar profiles. The results showed that the cingulate cortex can be divided in three clusters according to the MACM parcellation and in four according to the behavioral domain-based parcellation. In addition, a behavioral-domain based meta-analysis was conducted and the spatial consistency of functional connectivity patterns across different domain-related ALE results was evaluated by computing probabilistic maps. These maps identified some portions of the cingulate cortex as involved in several tasks. Our results showed the existence of a more specific functional characterization of some portions of the cingulate cortex but also a great multifunctionality of others. By analyzing a large number of studies, structure based meta-analysis can greatly contribute to new insights in the functional significance of brain activations and in the role of specific brain areas in behavior.

Population coding of visual space: modeling

We examine how the representation of space is affected by receptive field (RF) characteristics of the encoding population. Spatial responses were defined by overlapping Gaussian RFs. These responses were analyzed using multidimensional scaling to extract the representation of global space implicit in population activity. Spatial representations were based purely on firing rates, which were not labeled with RF characteristics (tuning curve peak location, for example), differentiating this approach from many other population coding models. Because responses were unlabeled, this model represents space using intrinsic coding, extracting relative positions amongst stimuli, rather than extrinsic coding where known RF characteristics provide a reference frame for extracting absolute positions. Two parameters were particularly important: RF diameter and RF dispersion, where dispersion indicates how broadly RF centers are spread out from the fovea. For large RFs, the model was able to form metrically accurate representations of physical space on low-dimensional manifolds embedded within the high-dimensional neural population response space, suggesting that in some cases the neural representation of space may be dimensionally isomorphic with 3D physical space. Smaller RF sizes degraded and distorted the spatial representation, with the smallest RF sizes (present in early visual areas) being unable to recover even a topologically consistent rendition of space on low-dimensional manifolds. Finally, although positional invariance of stimulus responses has long been associated with large RFs in object recognition models, we found RF dispersion rather than RF diameter to be the critical parameter. In fact, at a population level, the modeling suggests that higher ventral stream areas with highly restricted RF dispersion would be unable to achieve positionally-invariant representations beyond this narrow region around fixation.

Time course of allocation of spatial attention by acoustic cues in non-human primates

Spatial attention mediates the selection of information from different parts of space. When a brief cue is presented shortly before a target [cue to target onset asynchrony (CTOA)] in the same location, behavioral responses are facilitated, a process called attention capture. At longer CTOAs, responses to targets presented in the same location are inhibited; this is called inhibition of return (IOR). In the visual modality, these processes have been demonstrated in both humans and non-human primates, the latter allowing for the study of the underlying neural mechanisms. In audition, the effects of attention have only been shown in humans when the experimental task requires sound localization. Studies in monkeys with the use of similar cues but without a sound localization requirement have produced negative results. We have studied the effects of predictive acoustic cues on the latency of gaze shifts to visual and auditory targets in monkeys experienced in localizing sound sources in the laboratory with the head unrestrained. Both attention capture and IOR were demonstrated with acoustic cues, although with a faster time course than with visual cues. Additionally, the effect was observed across sensory modalities (acoustic cue to visual target), suggesting that the underlying neural mechanisms of these effects may be mediated within the superior colliculus, a center where inputs from both vision and audition converge.

Unconscious attentional orienting to exogenous cues: A review of the literature

The present paper reviews research that focuses on the dissociation between bottom-up attention and consciousness. In particular, we focus on studies investigating spatial exogenous orienting in the absence of awareness. We discuss studies that use peripheral masked onset cues and studies that use gaze cueing. The results from these studies show that the classic biphasic pattern of facilitation and inhibition, which is characteristic of conscious exogenous cueing can also be obtained with subliminal spatial cues. It is hypothesized that unconscious attentional orienting is mediated by the subcortical retinotectal pathway. Moreover, a possible neural network including superior colliculus, pulvinar and amygdala is suggested as the underlying mechanism.

Contribution of the superior colliculi to post-stroke unilateral spatial neglect and recovery

Unilateral spatial neglect (USN) is a highly prevalent and disabling consequence of stroke that often responds poorly to existing interventions. Its underlying neural mechanisms are still unclear. Recent work suggests that post-stroke USN may be partly related to a disruption of top-down and bottom-up control of visual attention mediated in part through the midbrain superior colliculi (SC). With mounting evidence from animal and human research, our objectives were: (1) to synthesize the literature implicating the SC in USN; (2) to review the rationale and potential for using eye patching and prism adaptation as USN treatment approaches that recruit SC involvement; and (3) to provide recommendations for research on the potential of therapeutic interventions that involve and/or target the retino-collicular pathway. Given the paucity of human studies, the contribution of the SC in USN, while plausible, remains to be confirmed. Further exploration of the mechanisms involved and their impact on USN in human subjects will help develop theoretically based intervention strategies tailored to USN type.

Attentional cueing at the saccade goal, not at the target location, facilitates saccades

Presenting a behaviorally irrelevant cue shortly before a target at the same location decreases the latencies of saccades to the target, a phenomenon known as exogenous attention facilitation. It remains unclear whether exogenous attention interacts with early, sensory stages or later, motor planning stages of saccade production. To distinguish between these alternatives, we used a saccadic adaptation paradigm to dissociate the location of the visual target from the saccade goal. Three male and four female human subjects performed both control trials, in which saccades were made to one of two target eccentricities, and adaptation trials, in which the target was shifted from one location to the other during the saccade. This manipulation adapted saccades so that they eventually were directed to the shifted location. In both conditions, a behaviorally irrelevant cue was flashed 66.7 ms before target appearance at a randomly selected one of seven positions that included the two target locations. In control trials, saccade latencies were shortest when the cue was presented at the target location and increased with cue-target distance. In contrast, adapted saccade latencies were shortest when the cue was presented at the adapted saccade goal, and not at the visual target location. The dynamics of adapted saccades were also altered, consistent with prior adaptation studies, except when the cue was flashed at the saccade goal. Overall, the results suggest that attentional cueing facilitates saccade planning rather than visual processing of the target.

The mechanism underlying inhibition of saccadic return

Human observers take longer to re-direct gaze to a previously fixated location. Although there has been some exploration of the characteristics of inhibition of saccadic return (ISR), the exact mechanisms by which ISR operates are currently unknown. In the framework of accumulation models of response times, in which evidence is integrated over time to a response threshold, ISR could reflect a reduction in the rate of accumulation for saccades to return locations or an increase in the effective criterion for response. In two experiments, participants generated sequences of three saccades, in response to a peripheral or a central cue. ISR occurred across these manipulations: saccade latency was consistently increased for movements to the immediately previously fixated location. Latency distributions from individual observers were fit with a Linear Ballistic Accumulator model. ISR was best accounted for as a change in the accumulation rate. We suggest this parameter represents the overall desirability of a particular course of action, the evidence for which may be derived from a variety of sensory and non-sensory sources.

Effects of sustained spatial attention in the human lateral geniculate nucleus and superior colliculus

The role of subcortical visual structures such as the lateral geniculate nucleus (LGN) and the superior colliculus (SC) in the control of visual spatial attention remains poorly understood. Here, we used high-resolution functional magnetic resonance imaging to measure responses in the human LGN and SC during sustained spatial attention. Subjects covertly and continuously tracked one of two segments that rotated through the visual field, composed of either moving dots or transient colored shapes. Activity in both nuclei was generally enhanced by attention, independent of the stimulus type, with the voxels responding more sensitively to stimulus contrast (those dominated by magnocellular input) exhibiting greater attentional enhancement. The LGN contained clusters of voxels exhibiting attentional enhancement or weak suppression, whereas the SC exhibited predominantly attentional enhancement, which was significantly stronger than in the LGN. The spatial distribution of the attentional effects was unrelated to the retinotopic organization in either structure. The results demonstrate that each of the major subcortical visual pathways participates in attentional selection, and their differential magnitudes of modulation suggest distinct roles.

Two spatially separated attention systems in the visual field: evidence from inhibition of return

It has been demonstrated that the human visual field shows some functional inhomogeneities, in particular when the central and perifoveal regions are compared to the more peripheral regions. The present study examined this inhomogeneity by examining the effect of stimulus eccentricity on inhibition of return (IOR), a phenomenon that biases our attention towards novel locations against returning it back to previously attended locations. Eighteen subjects were examined in a visual detection task, in which a target appeared randomly following a nonpredictive spatial cue in the visual field. The eccentricities of the cues and targets were systematically manipulated from 5 degrees to 30 degrees with 5 degrees increments. Results showed that response times to targets that appeared at cued locations were significantly slower than those at uncued locations for all stimulus eccentricities, demonstrating the IOR effects. However, response times at cued locations increased significantly when stimulus eccentricity shifted from 15 degrees to 20 degrees, leading to a much stronger IOR effect at more peripheral regions compared to central and perifoveal regions, indicating a functional dissociation between these two regions of the visual field. Possible neural mechanisms underlying this dissociation are discussed, and two attention systems modulating the two functional regions of the visual field are put forward to best account the present finding implicating in particular midbrain mechanism.

On the importance of the transient visual response in the superior colliculus

A salient event in the environment can initiate a complex orienting response that includes a shift in gaze. The midbrain superior colliculus (SC) contains the appropriate circuitry to generate and distribute a signal of the priority of this event, and co-ordinate the orienting response. The magnitude and timing of the short-latency transient visual response in the SC, when combined with cortical inputs signaling stimulus relevance and expectation, influences the type and latency of the orienting response. This signal in the SC is distributed to higher cortical areas to influence visual processing, to the reinforcement learning system to influence future actions, and to premotor circuits, including neck and shoulder muscles, to influence immediate action.

Cue repetition increases inhibition of return

Inhibition of return (IOR) refers to slowed responses to targets presented at the same location as a preceding stimulus. We explored whether the IOR effect would increase with the number of cues preceding the target (a 'cue'). Subjects performed a Posner cueing task with 1-5 cue presentations prior to the target, to which they made either a manual localization (Experiment 1) or target discrimination response (Experiment 2). The cues could be the same as (Experiment 1), or differ in shape from (Experiment 2), the target. The results showed that regardless of cue-target congruency the IOR effect increased dramatically with the number of preceding cues. This increase was driven mostly by a linear slowing of reaction times to targets presented on the same side as the cue(s), suggesting that a process such as sensory adaptation and/or habituation may be a contributing mechanism to the IOR effect.