Inhibition versus attentional momentum in cortical and collicular mechanisms of IOR

Seeing Beyond Salience and Guidance: The Role of Bias and Decision in Visual Search

Visual search is a popular tool for studying a range of questions about perception and attention, thanks to the ease with which the basic paradigm can be controlled and manipulated. While often thought of as a sub-field of vision science, search tasks are significantly more complex than most other perceptual tasks, with strategy and decision playing an essential, but neglected, role. In this review, we briefly describe some of the important theoretical advances about perception and attention that have been gained from studying visual search within the signal detection and guided search frameworks. Under most circumstances, search also involves executing a series of eye movements. We argue that understanding the contribution of biases, routines and strategies to visual search performance over multiple fixations will lead to new insights about these decision-related processes and how they interact with perception and attention. We also highlight the neglected potential for variability, both within and between searchers, to contribute to our understanding of visual search. The exciting challenge will be to account for variations in search performance caused by these numerous factors and their interactions. We conclude the review with some recommendations for ways future research can tackle these challenges to move the field forward.

Saccade latency indexes exogenous and endogenous object-based attention

Classic studies of object-based attention have utilized keypress responses as the main dependent measure. However, people typically make saccades to fixate important objects. Recent work has shown that attention may act differently when it is deployed covertly versus in advance of a saccade. We further investigated the link between saccades and attention by examining whether object-based effects can be observed for saccades. We adapted the classical double-rectangle cueing paradigm of Egly, Driver, and Rafal (1994), and measured both the first saccade latency and the keypress reaction time (RT) to a target that appeared at the end of one of the two rectangles. Our results showed that saccade latencies exhibited higher sensitivity than did RTs for detecting effects of attention. We also assessed the generality of the attention effects by testing three types of cues: hybrid (predictive and peripheral), exogenous (nonpredictive and peripheral), and endogenous (predictive and central). We found that both RTs and saccade latencies exhibited effects of both space-based and object-based attentional selection. However, saccade latencies showed a more robust attentional modulation than RTs. For the exogenous cues, we observed a spatial inhibition of return along with an object-based effect, implying that object-based attention is independent of space-based attention. Overall, our results revealed an oculomotor correlate of object-based attention, suggesting that, in addition to spatial priority, object-level priority also affects saccade planning.

Trajectory curvature in saccade sequences: spatiotopic influences vs. residual motor activity

When decisions drive saccadic eye movements, traces of the decision process can be inferred from the movement trajectories. For example, saccades can curve away from distractor stimuli, which was thought to reflect cortical inhibition biasing activity in the superior colliculus. Recent neurophysiological work does not support this theory, and two recent models have replaced top-down inhibition with lateral interactions in the superior colliculus or neural fatigue in the brainstem saccadic burst generator. All current models operate in retinotopic coordinates and are based on single saccade paradigms. To extend these models to sequences of saccades, we assessed whether and how saccade curvature depends on previously fixated locations and the direction of previous saccades. With a two-saccade paradigm, we first demonstrated that second saccades curved away from the initial fixation stimulus. Furthermore, by varying the time from fixation offset and the intersaccadic duration, we distinguished the extent of curvature originating from the spatiotopic representation of the previous fixation location or residual motor activity of the previous saccade. Results suggest that both factors drive curvature, and we discuss how these effects could be implemented in current models. In particular, we propose that the collicular retinotopic maps receive an excitatory spatiotopic update from the lateral interparial region.NEW & NOTEWORTHY Saccades curve away from locations of previous fixation. Varying stimulus timing demonstrates the effects of both 1) spatiotopic representation and 2) motor residual activity from previous saccades. The spatiotopic effect can be explained if current models are augmented with an excitatory top-down spatiotopic signal.

Stimulus-response incompatibility eliminates inhibitory cueing effects with saccadic but not manual responses

There are thought to be two forms of inhibition of return (IOR) depending on whether the oculomotor system is activated or suppressed. When saccades are allowed, output-based IOR is generated, whereas input-based IOR arises when saccades are prohibited. In a series of 4 experiments, we mixed or blocked compatible and incompatible trials with saccadic or manual responses to investigate whether cueing effects would follow the same pattern as those observed with more traditional peripheral onsets and central arrows. In all experiments, an uninformative cue was displayed, followed by a cue-back stimulus that was either red or green, indicating whether a compatible or incompatible response was required. The results showed that IOR was indeed observed for compatible responses in all tasks, whereas IOR was eliminated for incompatible trials-but only with saccadic responses. These findings indicate that the dissociation between input- and output-based forms of IOR depends on more than just oculomotor activation, providing further support for the existence of an inhibitory cueing effect that is distinct to the manual response modality.

Inhibitory cueing effects following manual and saccadic responses to arrow cues

With two cueing tasks, in the present study we examined output-based inhibitory cueing effects (ICEs) with manual responses to arrow targets following manual or saccadic responses to arrow cues. In all experiments, ICEs were observed when manual localization responses were required to both the cues and targets, but only when the cue-target onset asynchrony (CTOA) was 2,000 ms or longer. In contrast, when saccadic responses were made in response to the cues, ICEs were only observed with CTOAs of 2,000 ms or less-and only when an auditory cue-back signal was used. The present study also showed that the magnitude of ICEs following saccadic responses to arrow cues decreased with time, much like traditional inhibition-of-return effects. The magnitude of ICEs following manual responses to arrow cues, however, appeared later in time and had no sign of decreasing even 3 s after cue onset. These findings suggest that ICEs linked to skeletomotor activation do exist and that the ICEs evoked by oculomotor activation can carry over to the skeletomotor system.

The Timing and Neuroanatomy of Conscious Vision as Revealed by TMS-induced Blindsight

Following damage to the primary visual cortex, some patients exhibit “blindsight,” where they report a loss of awareness while retaining the ability to discriminate visual stimuli above chance. Transient disruption of occipital regions with TMS can produce a similar dissociation, known as TMS-induced blindsight. The neural basis of this residual vision is controversial, with some studies attributing it to the retinotectal pathway via the superior colliculus whereas others implicate spared projections that originate predominantly from the LGN. Here we contrasted these accounts by combining TMS with visual stimuli that either activate or bypass the retinotectal and magnocellular (R/M) pathways. We found that the residual capacity of TMS-induced blindsight occurs for stimuli that bypass the R/M pathways, indicating that such pathways, which include those to the superior colliculus, are not critical. We also found that the modulation of conscious vision was time and pathway dependent. TMS applied either early (0–40 msec) or late (280–320 msec) after stimulus onset modulated detection of stimuli that did not bypass R/M pathways, whereas during an intermediate period (90–130 msec) the effect was pathway independent. Our findings thus suggest a prominent role for the R/M pathways in supporting both the preparatory and later stages of conscious vision. This may help resolve apparent conflict in previous literature by demonstrating that the roles of the retinotectal and geniculate pathways are likely to be more nuanced than simply corresponding to the unconscious/conscious dichotomy.

S-cone Visual Stimuli Activate Superior Colliculus Neurons in Old World Monkeys: Implications for Understanding Blindsight

The superior colliculus (SC) is thought to be unresponsive to stimuli that activate only short wavelength-sensitive cones (S-cones) in the retina. The apparent lack of S-cone input to the SC was recognized by Sumner et al. [Sumner, P., Adamjee, T., & Mollon, J. D. Signals invisible to the collicular and magnocellular pathways can capture visual attention. Current Biology, 12, 1312–1316, 2002] as an opportunity to test SC function. The idea is that visual behavior dependent on the SC should be impaired when S-cone stimuli are used because they are invisible to the SC. The SC plays a critical role in blindsight. If the SC is insensitive to S-cone stimuli blindsight behavior should be impaired when S-cone stimuli are used. Many clinical and behavioral studies have been based on the assumption that S-cone-specific stimuli do not activate neurons in the SC. Our goal was to test whether single neurons in macaque SC respond to stimuli that activate only S-cones. Stimuli were calibrated psychophysically in each animal and at each individual spatial location used in experimental testing [Hall, N. J., & Colby, C. L. Psychophysical definition of S-cone stimuli in the macaque. Journal of Vision, 13, 2013]. We recorded from 178 visually responsive neurons in two awake, behaving rhesus monkeys. Contrary to the prevailing view, we found that nearly all visual SC neurons can be activated by S-cone-specific visual stimuli. Most of these neurons were sensitive to the degree of S-cone contrast. Of 178 visual SC neurons, 155 (87%) had stronger responses to a high than to a low S-cone contrast. Many of these neurons' responses (56/178 or 31%) significantly distinguished between the high and low S-cone contrast stimuli. The latency and amplitude of responses depended on S-cone contrast. These findings indicate that stimuli that activate only S-cones cannot be used to diagnose collicular mediation.

Color selectivity of the spatial congruency effect: evidence from the focused attention paradigm

The multisensory response enhancement (MRE), occurring when the response to a visual target integrated with a spatially congruent sound is stronger than the response to the visual target alone, is believed to be mediated by the superior colliculus (SC) (Stein & Meredith, 1993). Here, we used a focused attention paradigm to show that the spatial congruency effect occurs with red (SC-effective) but not blue (SC-ineffective) visual stimuli, when presented with spatially congruent sounds. To isolate the chromatic component of SC-ineffective targets and to demonstrate the selectivity of the spatial congruency effect we used the random luminance modulation technique (Experiment 1) and the tritanopic technique (Experiment 2). Our results indicate that the spatial congruency effect does not require the distribution of attention over different sensory modalities and provide correlational evidence that the SC mediates the effect.

From the heart to the mind: cardiac vagal tone modulates top-down and bottom-up visual perception and attention to emotional stimuli

The neurovisceral integration model (Thayer and Lane, 2000) posits that cardiac vagal tone, indexed by heart rate variability (HRV), can indicate the functional integrity of the neural networks implicated in emotion-cognition interactions. Our recent findings begin to disentangle how HRV is associated with both top-down and bottom-up cognitive processing of emotional stimuli. Higher resting HRV is associated with more adaptive and functional top-down and bottom-up cognitive modulation of emotional stimuli, which may facilitate effective emotion regulation. Conversely, lower resting HRV is associated with hyper-vigilant and maladaptive cognitive responses to emotional stimuli, which may impede emotion regulation. In the present paper, we recapitulate the neurovisceral integration model and review recent findings that shed light on the relationship between HRV and top-down and bottom-up visual perception and attention to emotional stimuli, which may play an important role in emotion regulation. Further implications of HRV on individual well-being and mental health are discussed.

Inhibition of return: Twenty years after

When responding to a suddenly appearing stimulus, we are slower and/or less accurate when the stimulus occurs at the same location of a previous event than when it appears in a new location. This phenomenon, often referred to as inhibition of return (IOR), has fostered a huge amount of research in the last 20 years. In this selective review, which introduces a Special Issue of Cognitive Neuropsychology dedicated to IOR, we discuss some of the methods used for eliciting IOR and its boundary conditions. We also address its debated relationships with orienting of attention, succinctly review findings of altered IOR in normal elderly and neuropsychiatric patients, and present results concerning its possible neural bases. We conclude with an outline of the papers collected in this issue, which offer a more in-depth treatment of behavioural, neural, and theoretical issues related to IOR.

Magnocellular and Parvocellular Pathway Influences on Location-Based Inhibition-Of-Return

The roles of the parvocellular (P) and magnocellular (M) retino-geniculo-cortical pathways during shifts of visual attention were investigated by creating M/dorsal-biased (eg low spatial frequency target, no objects present) and P/ventral-biased (ie high spatial frequency target, the perception of 3-D objects) stimulus conditions and measuring location-based inhibition-of-return (IOR). P/ventral-biased conditions produced the greatest IOR. M/dorsal-biased conditions produced the least IOR, in one instance eliminating it altogether. The results indicate a close relationship between IOR magnitude and relative P/ventral and M/dorsal activity with location-based IOR related more to P/ventral than to M/dorsal activity.

Human prosaccades and antisaccades under risk: effects of penalties and rewards on visual selection and the value of actions

Monkey studies report greater activity in the lateral intraparietal area and more efficient saccades when targets coincide with the location of prior reward cues, even when cue location does not indicate which responses will be rewarded. This suggests that reward can modulate spatial attention and visual selection independent of the "action value" of the motor response. Our goal was first to determine whether reward modulated visual selection similarly in humans, and next, to discover whether reward and penalty differed in effect, if cue effects were greater for cognitively demanding antisaccades, and if financial consequences that were contingent on stimulus location had spatially selective effects. We found that motivational cues reduced all latencies, more for reward than penalty. There was an "inhibition-of-return"-like effect at the location of the cue, but unlike the results in monkeys, cue valence did not modify this effect in prosaccades, and the inhibition-of-return effect was slightly increased rather than decreased in antisaccades. When financial consequences were contingent on target location, locations without reward or penalty consequences lost the benefits seen in noncontingent trials, whereas locations with consequences maintained their gains. We conclude that unlike monkeys, humans show reward effects not on visual selection but on the value of actions. The human saccadic system has both the capacity to enhance responses to multiple locations simultaneously, and the flexibility to focus motivational enhancement only on locations with financial consequences. Reward is more effective than penalty, and both interact with the additional attentional demands of the antisaccade task.

Social inhibition of return

Responses to a target stimulus can be slower when it appears in the same rather than a different location to a previous event, an effect known as inhibition of return (IOR). Recently, it has been shown that when two people alternate responses to a target, one person's responses are slower when they are directed to the same locations as their partner's previous response. The present study sought to investigate this highly novel effect, which we term social IOR (SIOR), in relation to what is known of IOR in individuals performing alone. We found that only a real conspecific can induce SIOR in another person, whereas an animated conspecific cannot. Additionally, SIOR emerges at locations to which a conspecific has been inferred to respond, even when direct observation of his/her responses is prevented. Finally, SIOR can be induced without the abrupt visual transients normally associated with the generation of IOR. These findings suggest that SIOR is the result of stronger activations of IOR mechanisms, or that it is subserved by entirely separate inhibitory processes.

Oculomotor distraction by signals invisible to the retinotectal and magnocellular pathways

Irrelevant stimulus onsets interfere with saccade planning to other stimuli, prolonging saccadic latency (the oculomotor distractor effect) or eliciting directional errors (saccadic capture). Such stimulus-driven interference has been associated with the retinotectal pathway, the direct pathway from retina to superior colliculus. Consistent with this theory, the distractor effect has not been found for stimuli visible only to the short-wave cones in the retina (S cones), which are thought not to contribute to the retinotectal pathway. However, S-cone signals are generally slower than luminance signals and such differences in temporal dynamics have not been taken into account when investigating the saccadic distractor effect. Here, by varying the delay between target and distractor, we found that S-cone stimuli do in fact produce a distractor effect, but the optimal delay is generally different from that for luminance distractors. The temporal dynamics of the distractor effect conform to a general framework of saccadic competition that takes sensory transmission time into account. Additionally, we observe that S-cone stimuli are able to produce saccadic capture in our paradigm. We conclude that stimulus-driven oculomotor interference does not rely on the retinotectal pathway, or indeed the magnocellular pathway, which is also blind to our S-cone stimuli.

Naso-temporal asymmetry for signals invisible to the retinotectal pathway

Monocular viewing conditions show an asymmetry between stimuli presented in the temporal and nasal visual fields in their efficiency for automatically triggering eye saccades and grasping attention. For instance, observers free to make a saccade to one of two stimuli presented together orient preferentially to the temporal stimulus. Such naso-temporal asymmetry (NTA) has been assumed to reflect the asymmetry in the retinotectal pathway to the superior colliculus. We tested this hypothesis using S cone stimuli, which are invisible to the magnocellular and retinotectal pathways. The observed NTA in choice saccades to bilateral stimuli was no less present for S cone stimuli than for luminance stimuli. Additionally, the amplitude of the NTA can be enhanced when S cone signals are added to luminance signals. These results suggest that behavioral NTA in humans is not diagnostic of retinotectal mediation. Furthermore, we found no asymmetries in latency, suggesting that the NTA in saccade choice does not originate simply from a bottom-up asymmetry in any low level visual pathways.

Interhemispheric transfer following callosotomy in humans: Role of the superior colliculus

It is now common knowledge that the total surgical section of the corpus callosum (CC) and of the other forebrain commissures prevents interhemispheric transfer (IT) of a host of mental functions. By contrast, IT of simple sensorimotor functions, although severely delayed, is not abolished, and an important question concerns the pathways subserving this residual IT. To answer this question we assessed visuomotor IT in split-brain patients using the Poffenberger paradigm (PP), that is, a behavioral paradigm in which simple reaction time (RT) to visual stimuli presented to the hemifield ipsilateral to the responding hand is compared to stimuli presented to the contralateral hemifield, a condition requiring an IT. We tested the possibility that the residual IT is mediated by the collicular commissure interconnecting the two sides of the superior colliculus (SC). To this purpose, we used short-wavelength visual stimuli, which in neurophysiological studies in non-human primates have been shown to be undetectable by collicular neurons. We found that, in both totally and partially callosotomised patients, IT was considerably longer with S-cone input than with L-cone input or with achromatic stimuli. This was not the case in healthy participants in whom IT was not affected by color. These data clearly show that the SC plays an important role in IT of sensorimotor information in the absence of the corpus callosum.