Covert visual search within and beyond the effective oculomotor range

ATLAS: Mapping ATtention's Location And Size to probe five modes of serial and parallel search

Conventional visual search tasks do not address attention directly and their core manipulation of 'set size' - the number of displayed items - introduces stimulus confounds that hinder interpretation. However, alternative approaches have not been widely adopted, perhaps reflecting their complexity, assumptions, or indirect attention-sampling. Here, a new procedure, the ATtention Location And Size ('ATLAS') task used probe displays to track attention's location, breadth, and guidance during search. Though most probe displays comprised six items, participants reported only the single item they judged themselves to have perceived most clearly - indexing the attention 'peak'. By sampling peaks across variable 'choice sets', the size and position of the attention window during search was profiled. These indices appeared to distinguish narrow- from broad attention, signalled attention to pairs of items where it arose and tracked evolving attention-guidance over time. ATLAS is designed to discriminate five key search modes: serial-unguided, sequential-guided, unguided attention to 'clumps' with local guidance, and broad parallel-attention with or without guidance. This initial investigation used only an example set of highly regular stimuli, but its broader potential should be investigated.

Oculomotor rehearsal in visuospatial working memory

The neural and cognitive mechanisms of spatial working memory are tightly coupled with the systems that control eye movements, but the precise nature of this coupling is not well understood. It has been argued that the oculomotor system is selectively involved in rehearsal of spatial but not visual material in visuospatial working memory. However, few studies have directly compared the effect of saccadic interference on visual and spatial memory, and there is little consensus on how the underlying working memory representation is affected by saccadic interference. In this study we aimed to examine how working memory for visual and spatial features is affected by overt and covert attentional interference across two experiments. Participants were shown a memory array, then asked to either maintain fixation or to overtly or covertly shift attention in a detection task during the delay period. Using the continuous report task we directly examined the precision of visual and spatial working memory representations and fit psychophysical functions to investigate the sources of recall error associated with different types of interference. These data were interpreted in terms of embodied theories of attention and memory and provide new insights into the nature of the interactions between cognitive and motor systems.

The presence of placeholders modulates the naso-temporal asymmetry in the remote distractor effect

The remote distractor effect (RDE) is a well-known and robust phenomenon whereby latencies of saccades are increased when a distractor is presented simultaneously along with the saccade target. Studies of the RDE in patients with a loss of vision in one visual field (hemianopia) following damage to primary visual cortex have provided conflicting results. Rafal, Smith, Krantz, Cohen, and Brennan (1990) reported a naso-temporal asymmetry in the RDE in patients with hemianopias, with a greater influence of distractors presented in their blind temporal visual field. This asymmetry was not observed in typically sighted controls. By contrast, Walker, Mannan, Maurer, Pambakian, and Kennard (2000) observed no effect of distractors presented to either the blind nasal or blind temporal hemifield of hemianopes, but the naso-temporal asymmetry was observed in typically sighted controls. The present study addressed one potential methodological differences between the two studies by investigating the inhibitory effect of a distractor on saccade latency in neurotypical participants. Here participants were tested monocularly and the effect of a nasal/temporal hemifield distractor on saccade latency observed in the presence or absence of peripheral placeholders. Our results showed a naso-temporal asymmetry in the magnitude of the RDE in the no placeholder condition, with a greater RDE when the distractor was presented in the temporal visual field. However, in the placeholder condition the opposite asymmetry was observed, that is an increased RDE when the distractor was presented in the nasal visual field. Our results suggest that the presence/absence of a placeholder might be the critical factor explaining the discrepancy between Rafal et al. (1990) and Walker et al. (2000) in participants without visual field loss. The current results can be interpreted in terms of additional inhibitory or attentional processes that bias selection towards stimuli in the nasal hemifield in the presence of placeholders, still, the mechanisms underlying these effects remain unclear.

Spatial attention and spatial short term memory in PSP and Parkinson's disease

Progressive Supranuclear Palsy (PSP) is a neurodegenerative disorder characterised by deterioration in motor, oculomotor and cognitive function. A key clinical feature of PSP is the progressive paralysis of eye movements, most notably for vertical saccades. These oculomotor signs can be subtle, however, and PSP is often misdiagnosed as Parkinson's disease (PD), in its early stages. Although some of the clinical features of PD and PSP overlap, they are distinct disorders with differing underlying pathological processes, responses to treatment and prognoses. One key difference lies in the effects the diseases have on cognition. The oculomotor system is tightly linked to cognitive processes such as spatial attention and spatial short-term memory (sSTM), and previous studies have suggested that PSP and PD experience different deficits in these domains. We therefore hypothesised that people with PSP (N = 15) would experience problems with attention (assessed with feature and conjunction visual search tasks) and sSTM (assessed with the Corsi blocks task) compared to people with PD (N = 16) and Age Matched Controls (N = 15). As predicted, feature and conjunction search were sgnificantly slower in the PSP group compared to the other groups, and this deficit was significantly worse for feature compared to conjunction search. The PD group did not differ from AMC on feature search but were significantly impaired on the conjunction search. The PSP group also had a pronounced vertical sSTM impairment that was not present in PD or AMC groups. It is argued that PSP is associated with specific impairment of visuospatial cognition which is caused by degeneration of the oculomotor structures that support exogenous spatial attention, consistent with oculomotor theories of spatial attention and memory.

On the link between attentional search and the oculomotor system: Is preattentive search restricted to the range of eye movements?

It has been proposed that covert visual search can be fast, efficient, and stimulus driven, particularly when the target is defined by a salient single feature, or slow, inefficient, and effortful when the target is defined by a nonsalient conjunction of features. This distinction between fast, stimulus-driven orienting and slow, effortful orienting can be related to the distinction between exogenous spatial attention and endogenous spatial attention. Several studies have shown that exogenous, covert orienting is limited to the range of saccadic eye movements, whereas covert endogenous orienting is independent of the range of saccadic eye movements. The current study examined whether covert visual search is affected in a similar way. Experiment 1 showed that covert visual search for feature singletons was impaired when stimuli were presented beyond the range of saccadic eye movements, whereas conjunction search was unaffected by array position. Experiment 2 replicated and extended this effect by measuring search times at 6 eccentricities. The impairment in covert feature search emerged only when stimuli crossed the effective oculomotor range and remained stable for locations further into the periphery, ruling out the possibility that the results of Experiment 1 were due to a failure to fully compensate for the effects of cortical magnification. The findings are interpreted in terms of biased competition and oculomotor theories of spatial attention. It is concluded that, as with covert exogenous orienting, biological constraints on overt orienting in the oculomotor system constrain covert, preattentive search.

Exogeneous Spatial Cueing beyond the Near Periphery: Cueing Effects in a Discrimination Paradigm at Large Eccentricities

Although visual attention is one of the most thoroughly investigated topics in experimental psychology and vision science, most of this research tends to be restricted to the near periphery. Eccentricities used in attention studies usually do not exceed 20° to 30°, but most studies even make use of considerably smaller maximum eccentricities. Thus, empirical knowledge about attention beyond this range is sparse, probably due to a previous lack of suitable experimental devices to investigate attention in the far periphery. This is currently changing due to the development of temporal high-resolution projectors and head-mounted displays (HMDs) that allow displaying experimental stimuli at far eccentricities. In the present study, visual attention was investigated beyond the near periphery (15°, 30°, 56° Exp. 1) and (15°, 35°, 56° Exp. 2) in a peripheral Posner cueing paradigm using a discrimination task with placeholders. Interestingly, cueing effects were revealed for the whole range of eccentricities although the inhomogeneity of the visual field and its functional subdivisions might lead one to suspect otherwise.

Updating spatial working memory in a dynamic visual environment

The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.

Associations and Dissociations between Oculomotor Readiness and Covert Attention

The idea that covert mental processes such as spatial attention are fundamentally dependent on systems that control overt movements of the eyes has had a profound influence on theoretical models of spatial attention. However, theories such as Klein’s Oculomotor Readiness Hypothesis (OMRH) and Rizzolatti’s Premotor Theory have not gone unchallenged. We previously argued that although OMRH/Premotor theory is inadequate to explain pre-saccadic attention and endogenous covert orienting, it may still be tenable as a theory of exogenous covert orienting. In this article we briefly reiterate the key lines of argument for and against OMRH/Premotor theory, then evaluate the Oculomotor Readiness account of Exogenous Orienting (OREO) with respect to more recent empirical data. These studies broadly confirm the importance of oculomotor preparation for covert, exogenous attention. We explain this relationship in terms of reciprocal links between parietal ‘priority maps’ and the midbrain oculomotor centres that translate priority-related activation into potential saccade endpoints. We conclude that the OMRH/Premotor theory hypothesis is false for covert, endogenous orienting but remains tenable as an explanation for covert, exogenous orienting.

The Relationship Between Spatial Attention and Eye Movements

The nature of the relationship between spatial attention and eye movements has been the subject of intense debate for more than 40 years. Two ideas have dominated this debate. First is the idea that spatial attention shares common neural mechanisms with eye movement programming, characterizing attention as an eye movement that has been prepared but not executed. Second, based on the observation that attention shifts to saccade targets, several theories have proposed that saccade programming necessarily recruits attentional resources. In this chapter, we review the evidence for each of these ideas and discuss some of the limitations and challenges in confirming their predictions. Although they are clearly dependent under some circumstances, dissociations between spatial attention and eye movements, and clear differences in their basic functions, point to the existence of two interconnected, but separate, systems.

Covert attention beyond the range of eye-movements: Evidence for a dissociation between exogenous and endogenous orienting

The relationship between covert shift of attention and the oculomotor system has been the subject of numerous studies. A widely held view, known as Premotor Theory, is that covert attention depends upon activation of the oculomotor system. However, recent work has argued that Premotor Theory is only true for covert, exogenous orienting of attention and that covert endogenous orienting is largely independent of the oculomotor system. To address this issue we examined how endogenous and exogenous covert orienting of attention was affected when stimuli were presented at a location outside the range of saccadic eye movements. Results from Experiment 1 showed that exogenous covert orienting was abolished when stimuli were presented beyond the range of saccadic eye movements, but preserved when stimuli were presented within this range. In contrast, in Experiment 2 endogenous covert orienting was preserved when stimuli appeared beyond the saccadic range. Finally, Experiment 3 confirmed the observations of Exp.1 and 2. Our results demonstrate that exogenous, covert orienting is limited to the range of overt saccadic eye movements, whereas covert endogenous orienting is not. These results are consistent with a weak, exogenous-only version of Premotor Theory.

The effect of offset cues on saccade programming and covert attention

Salient peripheral events trigger fast, “exogenous” covert orienting. The influential premotor theory of attention argues that covert orienting of attention depends upon planned but unexecuted eye-movements. One problem with this theory is that salient peripheral events, such as offsets, appear to summon attention when used to measure covert attention (e.g., the Posner cueing task) but appear not to elicit oculomotor preparation in tasks that require overt orienting (e.g., the remote distractor paradigm). Here, we examined the effects of peripheral offsets on covert attention and saccade preparation. Experiment 1 suggested that transient offsets summoned attention in a manual detection task without triggering motor preparation planning in a saccadic localisation task, although there were a high proportion of saccadic capture errors on “no-target” trials, where a cue was presented but no target appeared. In Experiment 2, “no-target” trials were removed. Here, transient offsets produced both attentional facilitation and faster saccadic responses on valid cue trials. A third experiment showed that the permanent disappearance of an object also elicited attentional facilitation and faster saccadic reaction times. These experiments demonstrate that offsets trigger both saccade programming and covert attentional orienting, consistent with the idea that exogenous, covert orienting is tightly coupled with oculomotor activation. The finding that no-go trials attenuates oculomotor priming effects offers a way to reconcile the current findings with previous claims of a dissociation between covert attention and oculomotor control in paradigms that utilise a high proportion of catch trials.

Mechanisms controlling human head stabilization during random rotational perturbations in the horizontal plane revisited

This study repeats the experimental protocol for investigation of head stabilization in healthy humans, described by Keshner and Peterson (1995) but with a modification of the analysis. Head movements were considered with respect to the room instead of relative to the trunk. The aim was to investigate the approximate contribution of reflex and voluntary control across perturbing frequencies and conditions with modulation of visual information and mental attention and discuss the resulting outcome while comparing methods. Seventeen healthy individuals were asked to keep the head steady in space while subjected to pseudorandom rotational perturbations in the horizontal plane, firmly seated on an actuated chair. Both methods confirmed the results for gain in previous studies showing fair ability to keep the head steady in space below 1 Hz with vision. Compensation deteriorated when vision was removed and worsened further with addition of a mental task. Between 1 and 2 Hz, unity gain occurred between head and trunk movements, whereas above 2 Hz the head moved more than the trunk. For phase angles, the original method demonstrated a phase split occurring from ~1 Hz, a purely mathematical artifact that caused subjects with virtually identical movements to appear as significantly different. This artifact was eliminated by analyzing the head‐room relative to trunk‐room rather than head–trunk relative to trunk‐room angles, thus preventing potentially erroneous interpretations of the results.

Rewards modulate saccade latency but not exogenous spatial attention

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

Linking perception and action by structure or process? Toward an integrative perspective

Over the past decades cognitive neuroscience's renewed interest in action has intensified the search of principles explaining how the cognitive system links perception to action and vice versa. To date, at least two seemingly alternative approaches can be distinguished. Perception and action might be linked either by common representational structures, as assumed by the ideomotor approach, or by common attentional processes, as assumed by the attention approach. This article first reviews the evidence from different paradigms supporting each approach. It becomes clear that most studies selectively focus either on actions directed at goals outside the actors' perceptual range (supporting the ideomotor approach) or on actions directed at targets within the actors' perceptual range (supporting the attention approach). In a second step, I will try to reconcile both approaches by reviewing recent eye movement studies that abolish the classical combination of approach and goals under study. Demonstrating that both approaches cover target- as well as goal-directed actions, it is proposed that operations addressed in both conceptual frameworks interact with each other.

The role of the oculomotor system in covert social attention

Observing a change in gaze direction triggers a reflexive shift of attention and appears to engage the eye-movement system. However, the functional relationship between social attention and this oculomotor activation is unclear. One extremely influential hypothesis is that the preparation of a saccadic eye movement is necessary and sufficient for a covert, reflexive shift of attention (the premotor theory of attention; Rizzolatti et al., 1994). Surprisingly, this theory has not been directly tested with respect to reflexive gaze cueing. In order to address this issue, gaze cueing, peripheral cueing, and arrow cueing were examined under conditions in which some stimuli appeared at locations that could not become the goal of a saccadic eye movement. It was observed that peripheral cues failed to elicit reflexive attentional orienting when targets appeared beyond the range of eye movements. Similarly, nonpredictive arrow cues were ineffective when targets could not become the goal of a saccade. In contrast, significant gaze-cueing effects were still observed when targets were beyond the range of eye movements. These data demonstrate that the mechanisms involved in gaze cueing are dissociated from those involved in exogenous orienting to peripheral or arrow cues. Furthermore, the findings suggest that, unlike peripheral cueing and reflexive arrow cueing, gaze cueing is independent of oculomotor control. We conclude that the premotor theory does not offer a compelling explanation for gaze cueing.

Effects of spatial congruency on saccade and visual discrimination performance in a dual-task paradigm

The present study investigated the coupling of selection-for-perception and selection-for-action during saccadic eye movement planning in three dual-task experiments. We focused on the effects of spatial congruency of saccade target (ST) location and discrimination target (DT) location and the time between ST-cue and Go-signal (SOA) on saccadic eye movement performance. In two experiments, participants performed a visual discrimination task at a cued location while programming a saccadic eye movement to a cued location. In the third experiment, the discrimination task was not cued and appeared at a random location. Spatial congruency of ST-location and DT-location resulted in enhanced perceptual performance irrespective of SOA. Perceptual performance in spatially incongruent trials was above chance, but only when the DT-location was cued. Saccade accuracy and precision were also affected by spatial congruency showing superior performance when the ST- and DT-location coincided. Saccade latency was only affected by spatial congruency when the DT-cue was predictive of the ST-location. Moreover, saccades consistently curved away from the incongruent DT-locations. Importantly, the effects of spatial congruency on saccade parameters only occurred when the DT-location was cued; therefore, results from experiments 1 and 2 are due to the endogenous allocation of attention to the DT-location and not caused by the salience of the probe. The SOA affected saccade latency showing decreasing latencies with increasing SOA. In conclusion, our results demonstrate that visuospatial attention can be voluntarily distributed upon spatially distinct perceptual and motor goals in dual-task situations, resulting in a decline of visual discrimination and saccade performance.