Shifting attention into and out of objects: Evaluating the processes underlying the object advantage

High visual salience of alert signals can lead to a counterintuitive increase of reaction times

It is often assumed that rendering an alert signal more salient yields faster responses to this alert. Yet, there might be a trade-off between attracting attention and distracting from task execution. Here we tested this in four behavioral experiments with eye-tracking using an abstract alert-signal paradigm. Participants performed a visual discrimination task (primary task) while occasional alert signals occurred in the visual periphery accompanied by a congruently lateralized tone. Participants had to respond to the alert before proceeding with the primary task. When visual salience (contrast) or auditory salience (tone intensity) of the alert were increased, participants directed their gaze to the alert more quickly. This confirms that more salient alerts attract attention more efficiently. Increasing auditory salience yielded quicker responses for the alert and primary tasks, apparently confirming faster responses altogether. However, increasing visual salience did not yield similar benefits: instead, it increased the time between fixating the alert and responding, as high-salience alerts interfered with alert-task execution. Such task interference by high-salience alert-signals counteracts their more efficient attentional guidance. The design of alert signals must be adapted to a "sweet spot" that optimizes this stimulus-dependent trade-off between maximally rapid attentional orienting and minimal task interference.

Variability in the temporal dynamics of object-based attentional selection

Our attention can be directed to specific locations in our visual field (space-based attention), or to specific objects (object-based attention). However, object-based attention tends to be less pronounced than space-based attention and can vary greatly between individuals. Here we investigated whether the low prevalence of object-based effects is related to variability in the temporal dynamics of attentional selection. We manipulated cue-to-target intervals from 50 to 600 ms in a two-rectangle discrimination task. Space- and object-based effects were measured at the group level and for individual participants. We used bootstrapping to highlight cue-to-target intervals with maximal space- and object-based effects, and fast Fourier transform (FFT) to investigate rhythmic sampling of locations within and between objects. Whereas overall, space-based effects were robust and stable across all cue-to-target intervals for most participants, object-based effects were small and were only found for a small subset of participants in the different cue-to-target intervals. In the frequency domain, only a small number of participants exhibited significant periodicities, prompting the need for further investigation and consideration. Overall, our study suggests variability in the temporal dynamics of object-based effects underlying their low prevalence, a finding that needs to be further investigated in future studies.

Staying and Returning dynamics of young children's attention

In this paper, we decompose selective sustained attending behavior into components of continuous attention maintenance and attentional transitions and study how each of these components develops in young children. Our results in two experiments suggest that changes in children's ability to return attention to a target locus after distraction ("Returning") play a crucial role in the development of selective sustained attention between the ages of 3.5-6 years, perhaps to a greater extent than changes in the ability to continuously maintain attention on the target ("Staying"). We further distinguish Returning from the behavior of transitioning attention away from task (i.e., becoming distracted) and investigate the relative contributions of bottom-up and top-down factors on these different types of attentional transitions. Overall, these results (a) suggest the importance of understanding the cognitive process of transitioning attention for understanding selective sustained attention and its development, (b) provide an empirical paradigm within which to study this process, and (c) begin to characterize basic features of this process, namely its development and its relative dependence on top-down and bottom-up influences on attention. RESEARCH HIGHLIGHTS: Young children exhibited an endogenously ability, Returning, to preferentially transition attention to task-relevant information over task-irrelevant information. Selective sustained attention and its development were decomposed into Returning and Staying, or task-selective attention maintenance, using novel eye-tracking-based measures. Returning improved between the ages of 3.5-6 years, to a greater extent than Staying. Improvements in Returning supported improvements in selective sustained attention between these ages.

The Architecture of Object-Based Attention

The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are involved? Here, we review recent progress in the field to determine the mechanisms underlying object-based attention. First, findings from unconscious priming and cueing suggest that the preattentive targets of object-based attention can be fully developed object representations that have reached the level of identity. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. How feedback from object areas can accurately target the object's specific locations and features is unknown but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could all rely on object-based attention. Specifically, studies show that attention can be allocated to the separated members of a group-without affecting the space between them-matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. We outline the architecture of object-based attention, the novel predictions it brings, and discuss how it works in parallel with other attention pathways.

Faces do not guide attention in an object-based facilitation manner

Numerous studies on face processing have revealed their special ability to affect attention, but relatively little research has been done on how faces guide spatial attention allocation. To enrich this field, this study resorted to the object-based attention (OBA) effect in a modified double-rectangle paradigm where the rectangles were replaced with human faces and mosaic patterns (non-face objects). Experiment 1 replicated the typical OBA effect in the non-face objects, but this effect was absent in Asian and Caucasian faces. Experiment 2 removed the eye region from Asian faces, but still found no object-based facilitation in the faces without eyes. In Experiment 3, the OBA effect was also observed for faces when the faces disappear a short period before the responses. Overall, these results revealed that when two faces are presented together, they do not exert object-based facilitation regardless of their facial features such as race and the presence of eyes. We argue that the lack of a typical OBA effect is due to the filtering cost induced by the entire face content. This cost slows down the response when attention shifts within a face and results in the absence of object-based facilitation.

Awareness-independent gradual spread of object-based attention

Although attention can be directed at certain objects, how object-based attention spreads within an object and whether this spread interacts with awareness remain unclear. Using a modified spatial cuing paradigm with backward masking, we addressed these issues with either visible or invisible displays presenting the real (Experiment 1) and illusory (Experiment 2) U-shaped objects (UOs), whose ends and middles, the possible locations of the cue and target, have iso-eccentric distances from the fixation. These equidistant ends and middles of UOs offered us a unique opportunity to examine whether attention gradually spreads within a given object, i.e., within an UO, attention spreads from its cued-end to uncued-end via the uncued-middle. Despite the visibility (visible or invisible) of UOs, both experiments supported this gradual spread manner by showing a faster response of human participants (male and female) to the target in the uncued-middle than that in the uncued-end. Our results thus indicate a gradual spread of object-based attention and further reveal that this gradual spread is independent of both the “visual objectness” (whether the object is defined as the real or illusory boundaries) and conscious access to objects.

Attention can operate on object representations in visual sensory memory

Numerous studies have shown that attention can be allocated to various types of objects, such as low-level objects developed by perceptual organization and high-level objects developed by semantic associations. However, little is known about whether attention can also be affected solely by object representations in the brain, after the disappearance of physical objects. Here, we used a modified double-rectangle paradigm to investigate how attention is affected by object representation in visual sensory memory when the physical objects disappear for a short period of time before the target onset. By manipulating the interstimulus interval (ISI) between the offset of the objects and the onset of the target, an object-based attention effect, with shorter reaction times (RTs) for within-object relative to between-object conditions, was observed in the short-ISI (within 500 ms in Experiments 1a, 1b, 2, and 3) conditions while disappearing in the long-ISI (800 ms in Experiment 4) conditions. This result demonstrated that the mere presence of object representation in visual sensory memory, or the sensory memory-maintained object, can serve as an object unit that attention can operate on. This provides evidence for the relationship between object-based attention and visual sensory memory: object representation in visual sensory memory could affect attentional allocation, or attention can operate on a sensory memory-maintained object.

A region complexity effect masquerading as object-based attention

A large portion of the evidence for object-based attention comes from experiments using the two-rectangle paradigm introduced by Egly, Driver, and Rafal (1994), in which response times are longer when the two stimulus locations relevant to the task are on separate objects. In the new experiments presented here, response times are longer when the two locations are part of the same object but are separated by a concavity in the object, so that the region directly between the two locations is crossed by the object's boundaries. Response times when the two locations are separated by the concavity are not statistically different from when they are on two separate objects. The results are similar for a two-letter comparison task and for a spatial cuing task. Thus, in these experiments, the response time increase does not reflect the cost of shifting attention from object to object, because it appears when the two locations are on the same object, and it is not increased when they are on different objects. Instead, it seems to reflect the complexity of the region between the two stimulus locations. This finding raises questions about whether data from previous two-rectangle experiments should be attributed to object-based attention.

Attention in Psychology, Neuroscience, and Machine Learning

Attention is the important ability to flexibly control limited computational resources. It has been studied in conjunction with many other topics in neuroscience and psychology including awareness, vigilance, saliency, executive control, and learning. It has also recently been applied in several domains in machine learning. The relationship between the study of biological attention and its use as a tool to enhance artificial neural networks is not always clear. This review starts by providing an overview of how attention is conceptualized in the neuroscience and psychology literature. It then covers several use cases of attention in machine learning, indicating their biological counterparts where they exist. Finally, the ways in which artificial attention can be further inspired by biology for the production of complex and integrative systems is explored.

Location-Specific Orientation Set Is Independent of the Horizontal Benefit with or Without Object Boundaries

Chen and Cave (2019) showed that facilitation in visual comparison tasks that had previously been attributed to object-based attention could more directly be explained as facilitation in comparing two shapes that are configured horizontally rather than vertically. They also cued the orientation of the upcoming stimulus configuration without cuing its location and found an asymmetry: the orientation cue only enhanced performance for vertical configurations. The current study replicates the horizontal benefit in visual comparison and again demonstrates that it is independent of surrounding object boundaries. In these experiments, the cue is informative about the location of the target configuration as well as its orientation, and it enhances performance for both horizontal and vertical configurations; there is no asymmetry. Either a long or a short cue can enhance performance when it is valid. Thus, Chen and Cave’s cuing asymmetry seems to reflect unusual aspects of an attentional set for orientation that must be established without knowing the upcoming stimulus location. Taken together, these studies show that a location-specific cue enhances comparison independently of the horizontal advantage, while a location-nonspecific cue produces a different type of attentional set that does not enhance comparison in horizontal configurations.

Towards solving the hard problem of consciousness: The varieties of brain resonances and the conscious experiences that they support

The hard problem of consciousness is the problem of explaining how we experience qualia or phenomenal experiences, such as seeing, hearing, and feeling, and knowing what they are. To solve this problem, a theory of consciousness needs to link brain to mind by modeling how emergent properties of several brain mechanisms interacting together embody detailed properties of individual conscious psychological experiences. This article summarizes evidence that Adaptive Resonance Theory, or ART, accomplishes this goal. ART is a cognitive and neural theory of how advanced brains autonomously learn to attend, recognize, and predict objects and events in a changing world. ART has predicted that "all conscious states are resonant states" as part of its specification of mechanistic links between processes of consciousness, learning, expectation, attention, resonance, and synchrony. It hereby provides functional and mechanistic explanations of data ranging from individual spikes and their synchronization to the dynamics of conscious perceptual, cognitive, and cognitive-emotional experiences. ART has reached sufficient maturity to begin classifying the brain resonances that support conscious experiences of seeing, hearing, feeling, and knowing. Psychological and neurobiological data in both normal individuals and clinical patients are clarified by this classification. This analysis also explains why not all resonances become conscious, and why not all brain dynamics are resonant. The global organization of the brain into computationally complementary cortical processing streams (complementary computing), and the organization of the cerebral cortex into characteristic layers of cells (laminar computing), figure prominently in these explanations of conscious and unconscious processes. Alternative models of consciousness are also discussed.

Interaction between object-based attention and pertinence values shapes the attentional priority map of a multielement display

Previous studies have shown that the perceptual organization of the visual scene constrains the deployment of attention. Here we investigated how the organization of multiple elements into larger configurations alters their attentional weight, depending on the “pertinence” or behavioral importance of the elements’ features. We assessed object-based effects on distinct aspects of the attentional priority map: top-down control, reflecting the tendency to encode targets rather than distracters, and the spatial distribution of attention weights across the visual scene, reflecting the tendency to report elements belonging to the same rather than different objects. In 2 experiments participants had to report the letters in briefly presented displays containing 8 letters and digits, in which pairs of characters could be connected with a line. Quantitative estimates of top-down control were obtained using Bundesen’s Theory of Visual Attention (1990). The spatial distribution of attention weights was assessed using the “paired response index” (PRI), indicating responses for within-object pairs of letters. In Experiment 1, grouping along the task-relevant dimension (targets with targets and distracters with distracters) increased top-down control and enhanced the PRI; in contrast, task-irrelevant grouping (targets with distracters) did not affect performance. In Experiment 2, we disentangled the effect of target-target and distracter-distracter grouping: Pairwise grouping of distracters enhanced top-down control whereas pairwise grouping of targets changed the PRI. We conclude that object-based perceptual representations interact with pertinence values (of the elements’ features and location) in the computation of attention weights, thereby creating a widespread pattern of attentional facilitation across the visual scene.

Hierarchical Navigation of Visual Attention: Orienting and Focusing Within and Between Hierarchically Structured Objects

This study explored the dynamics of attentional navigation between two hierarchically structured objects. Three experiments examined a Hierarchical Attentional Navigation (HAN) hypothesis, by which attentional navigation between two visual stimuli is constrained to follow the path linking the two stimuli in a hierarchical object-based representation. Presented with two adjacent compound-letter objects on each trial, participants successively identified the letter(s) at the specified hierarchical level (global or local) of the origin and destination object, respectively: local-local (Experiment 1), global-local (Experiment 2a), or local-global (Experiment 2b). The organizational complexity of the objects (2-level structure vs. 3-level structure) and their global size (large vs. small) were orthogonally manipulated. Results were generally consistent with the HAN hypothesis: overall response latency was positively related to the number of intervening levels of hierarchical object structure linking the two target levels. Hierarchical navigation was also suggested by the pattern of global size effects. The usefulness of the HAN framework for interpreting these and related findings in attention research is discussed.

Exploring the relationship between object realism and object-based attention effects

Visual attention prioritizes processing of locations in space, and evidence also suggests that the benefits of attention can be shaped by the presence of objects (object-based attention). However, the prevalence of object-based attention effects has been called into question recently by evidence from a large-sampled study employing classic attention paradigms (Pilz et al., 2012). We conducted two experiments to explore factors that might determine when and if object-based attention effects are observed, focusing on the degree to which the concreteness and realism of objects might contribute to these effects. We adapted the classic attention paradigm first reported by Egly, Driver, and Rafal (1994) by replacing abstract bar stimuli in some conditions with objects that were more concrete and familiar to participants: items of silverware. Furthermore, we varied the realism of these items of silverware, presenting either cartoon versions or photo-realistic versions. Contrary to predictions, increased realism did not increase the size of object-based effects. In fact, no clear object-based effects were observed in either experiment, consistent with previous failures to replicate these effects in similar paradigms. While object-based attention may exist, and may have important influences on how we parse the visual world, these and other findings suggest that the two-object paradigm typically relied upon to study object-based effects may not be the best paradigm to investigate these issues.

Facilitation by exogenous attention for static and dynamic gestalt groups

Attentional mechanisms allow the brain to selectively allocate its resources to stimuli of interest within the huge amount of information reaching its sensory systems. The voluntary component of attention, endogenous attention, can be allocated in a flexible manner depending on the goals and strategies of the observer. On the other hand, the reflexive component, exogenous attention, is driven by the stimulus. Here, we investigated how exogenous attention is deployed to moving stimuli that form distinct perceptual groups. We showed that exogenous attention is deployed according to a reference frame that moves along with the stimulus. Moreover, in addition to the cued stimulus, exogenous attention is deployed to all elements forming a perceptual group. These properties provide a basis for the efficient deployment of exogenous attention under ecological viewing conditions.

Crossmodal semantic congruence can affect visuo-spatial processing and activity of the fronto-parietal attention networks

Previous studies have shown that multisensory stimuli can contribute to attention control. Here we investigate whether irrelevant audio–visual stimuli can affect the processing of subsequent visual targets, in the absence of any direct bottom–up signals generated by low-level sensory changes and any goal-related associations between the multisensory stimuli and the visual targets. Each trial included two pictures (cat/dog), one in each visual hemifield, and a central sound that was semantically congruent with one of the two pictures (i.e., either “meow” or “woof” sound). These irrelevant audio–visual stimuli were followed by a visual target that appeared either where the congruent or the incongruent picture had been presented (valid/invalid trials). The visual target was a Gabor patch requiring an orientation discrimination judgment, allowing us to uncouple the visual task from the audio–visual stimuli. Behaviourally we found lower performance for invalid than valid trials, but only when the task demands were high (Gabor target presented together with a Gabor distractor vs. Gabor target alone). The fMRI analyses revealed greater activity for invalid than for valid trials in the dorsal and the ventral fronto-parietal attention networks. The dorsal network was recruited irrespective of task demands, while the ventral network was recruited only when task demands were high and target discrimination required additional top–down control. We propose that crossmodal semantic congruence generates a processing bias associated with the location of congruent picture, and that the presentation of the visual target on the opposite side required updating these processing priorities. We relate the activation of the attention networks to these updating operations. We conclude that the fronto-parietal networks mediate the influence of crossmodal semantic congruence on visuo-spatial processing, even in the absence of any low-level sensory cue and any goal-driven task associations.

Binocular fusion and invariant category learning due to predictive remapping during scanning of a depthful scene with eye movements

How does the brain maintain stable fusion of 3D scenes when the eyes move? Every eye movement causes each retinal position to process a different set of scenic features, and thus the brain needs to binocularly fuse new combinations of features at each position after an eye movement. Despite these breaks in retinotopic fusion due to each movement, previously fused representations of a scene in depth often appear stable. The 3D ARTSCAN neural model proposes how the brain does this by unifying concepts about how multiple cortical areas in the What and Where cortical streams interact to coordinate processes of 3D boundary and surface perception, spatial attention, invariant object category learning, predictive remapping, eye movement control, and learned coordinate transformations. The model explains data from single neuron and psychophysical studies of covert visual attention shifts prior to eye movements. The model further clarifies how perceptual, attentional, and cognitive interactions among multiple brain regions (LGN, V1, V2, V3A, V4, MT, MST, PPC, LIP, ITp, ITa, SC) may accomplish predictive remapping as part of the process whereby view-invariant object categories are learned. These results build upon earlier neural models of 3D vision and figure-ground separation and the learning of invariant object categories as the eyes freely scan a scene. A key process concerns how an object's surface representation generates a form-fitting distribution of spatial attention, or attentional shroud, in parietal cortex that helps maintain the stability of multiple perceptual and cognitive processes. Predictive eye movement signals maintain the stability of the shroud, as well as of binocularly fused perceptual boundaries and surface representations.

Where's Waldo? How perceptual, cognitive, and emotional brain processes cooperate during learning to categorize and find desired objects in a cluttered scene

The Where's Waldo problem concerns how individuals can rapidly learn to search a scene to detect, attend, recognize, and look at a valued target object in it. This article develops the ARTSCAN Search neural model to clarify how brain mechanisms across the What and Where cortical streams are coordinated to solve the Where's Waldo problem. The What stream learns positionally-invariant object representations, whereas the Where stream controls positionally-selective spatial and action representations. The model overcomes deficiencies of these computationally complementary properties through What and Where stream interactions. Where stream processes of spatial attention and predictive eye movement control modulate What stream processes whereby multiple view- and positionally-specific object categories are learned and associatively linked to view- and positionally-invariant object categories through bottom-up and attentive top-down interactions. Gain fields control the coordinate transformations that enable spatial attention and predictive eye movements to carry out this role. What stream cognitive-emotional learning processes enable the focusing of motivated attention upon the invariant object categories of desired objects. What stream cognitive names or motivational drives can prime a view- and positionally-invariant object category of a desired target object. A volitional signal can convert these primes into top-down activations that can, in turn, prime What stream view- and positionally-specific categories. When it also receives bottom-up activation from a target, such a positionally-specific category can cause an attentional shift in the Where stream to the positional representation of the target, and an eye movement can then be elicited to foveate it. These processes describe interactions among brain regions that include visual cortex, parietal cortex, inferotemporal cortex, prefrontal cortex (PFC), amygdala, basal ganglia (BG), and superior colliculus (SC).

The object advantage can be eliminated under equiluminant conditions

A key phenomenon supporting the existence of object-based attention is the object advantage, in which responses are faster for within-object, relative to equidistant between-object, shifts of attention. The origins of this effect have been variously ascribed to low-level "bottom-up" sensory processing and to a cognitive "top-down" strategy of within-object attention prioritization. The degree to which the object advantage depends on lower-level sensory processing was examined by differentially stimulating the magnocellular (M) and parvocellular (P) retino-geniculo-cortical visual pathways by using equiluminant and nonequiluminant conditions. We found that the object advantage can be eliminated when M activity is reduced using psychophysically equiluminant stimuli. This novel result in normal observers suggests that the origin of the object advantage is found in lower-level sensory processing rather than a general cognitive process, which should not be so sensitive to differential activation of the bottom-up P and M pathways. Eliminating the object advantage while maintaining a spatial-cueing advantage with reduced M activity suggests that the notion of independent M-driven spatial attention and P-driven object attention requires revision.

Object-based attention guided by an invisible object

Evidence for object-based attention typically comes from studies using displays with visible objects, and little is known about whether object-based attention can occur with invisible objects. We investigated this issue with a modified double-rectangle cuing paradigm, which was originally developed by Egly et al. (J Exp Psychol Gen 123:161-177, 1994). In this study, low-contrast rectangles were presented very briefly, which rendered them invisible to subjects. With the invisible rectangles, we found a classical object-based attentional effect as indexed by the same-object effect. We also found the instantaneous object effect-object-based attention was dependent on the orientation of the rectangles presented with the target, providing evidence for the dynamic updating hypothesis (Ho and Yeh in Acta Psychol 132:31-39, 2009). These results suggest that object-based attention can be guided by an invisible object in an automatic way, with a minimal influence from high-level top-down control.

Neural dynamics of object-based multifocal visual spatial attention and priming: object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how "attentional shrouds" are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

How prevalent is object-based attention?

Previous research suggests that visual attention can be allocated to locations in space (space-based attention) and to objects (object-based attention). The cueing effects associated with space-based attention tend to be large and are found consistently across experiments. Object-based attention effects, however, are small and found less consistently across experiments. In three experiments we address the possibility that variability in object-based attention effects across studies reflects low incidence of such effects at the level of individual subjects. Experiment 1 measured space-based and object-based cueing effects for horizontal and vertical rectangles in 60 subjects comparing commonly used target detection and discrimination tasks. In Experiment 2 we ran another 120 subjects in a target discrimination task in which rectangle orientation varied between subjects. Using parametric statistical methods, we found object-based effects only for horizontal rectangles. Bootstrapping methods were used to measure effects in individual subjects. Significant space-based cueing effects were found in nearly all subjects in both experiments, across tasks and rectangle orientations. However, only a small number of subjects exhibited significant object-based cueing effects. Experiment 3 measured only object-based attention effects using another common paradigm and again, using bootstrapping, we found only a small number of subjects that exhibited significant object-based cueing effects. Our results show that object-based effects are more prevalent for horizontal rectangles, which is in accordance with the theory that attention may be allocated more easily along the horizontal meridian. The fact that so few individuals exhibit a significant object-based cueing effect presumably is why previous studies of this effect might have yielded inconsistent results. The results from the current study highlight the importance of considering individual subject data in addition to commonly used statistical methods.

Central-Cue Discriminability Modulates Object-Based Attention by Influencing Spatial Attention

The role of central-cue discriminability in modulating object-based effects was examined using Egly, Driver, and Rafal’s (1994) “double-rectangle” spatial cueing paradigm. Based on the attentional focusing hypothesis (Goldsmith & Yeari, 2003), we hypothesized that highly discriminable central-arrow cues would be processed with attention spread across the two rectangles (potential target locations), thereby strengthening the perceptual representation of these objects so that they influence the subsequent endogenous deployment of attention, yielding object-based effects. By contrast, less discriminable central-arrow cues should induce a more narrow attentional focus to the center of the display, thereby weakening the rectangle object representations so that they no longer influence the subsequent attentional deployment. Central-arrow-cue discriminability was manipulated by size and luminance contrast. The results supported the predictions, reinforcing the attentional focusing hypothesis and highlighting the need to consider central-cue discriminability when designing experiments and in comparing experimental results.

Visual streams and shifting attention

Understanding the relationship between bottom-up and top-down processing in visual perception and attention is challenging. An important part of that challenge is studying the roles the parvocellular (P) and magnocellular (M) retino-geniculo-cortical pathways play in visual processing and attention. The P pathway provides the dominant initial input to the ventral stream which plays an important role in object processing and is assumed to be relatively more involved in object-based attention. The faster responding M pathway provides the dominant initial input to the dorsal stream which plays an important role in processing movement and spatial location information and is assumed to be relatively more involved in space-based attention. To gain insight into the relationship between M/dorsal and P/ventral activity and deploying visual attention, we used a covert cuing paradigm to manipulate attention while bottom-up and top-down perceptual stimulus variables created M/dorsal and P/ventral-biased conditions. One study examined the object advantage, where responses are faster for within-relative to equidistant between-object shifts of attention. Visual stream contributions to object- and spaced-based attention were revealed using psychophysically equiluminant conditions expected to reduce M/dorsal activity. Other studies investigating visual stream contributions to location-based inhibition of return (IOR) used IOR magnitude as an indicator of the ease or difficulty of deploying spatial attention. Greater IOR was found under P/ventral-biased conditions. Less IOR was found under M/dorsal-biased conditions. The results support the use of M/dorsal and P/ventral-biased conditions as a valuable strategy for studying the relationship between visual stream activity and shifting attention.

Spatial working memory maintenance: does attention play a role? A visual search study

Recent studies have proposed that a common mechanism may underlie spatial attention and spatial working memory. One proposal is that spatial working memory is maintained by attention-based rehearsal [Awh, E., Jonides, J., & Reuter-Lorenz, P. A. (1998). Rehearsal in spatial working memory. Journal of Experimental Psychology: Human Perception and Performance, 24(3), 780-790], and so a spatial attention shift during the retention interval of a spatial location should impair its memory performance. In the present study, participants engaged in single-item, parallel or serial search tasks while remembering a spatial location. Although memory tended to bias all searches, the need for an attentional shift during the retention interval impaired memory performance only in single-item search, but not in other searches. These findings suggest that previous evidence for the attention-based rehearsal account does not generalize to visual search. Results are discussed with regard to the relationship between spatial attention and spatial working memory.

Effects of instantaneous object input and past experience on object-based attention

Evidence for object-based attention typically comes from studies using displays with unchanged objects, and no consensus has yet been reached as to whether the object effect would be altered by changing object displays or having seen this change across-trials. We examined this by using modifications of the double-rectangle cuing paradigm of Egly et al. [Egly, R., Driver, J., & Rafal, R. D. (1994). Shifting visual attention between objects and locations: Evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General, 123, 161-177], and our results, when the objects remained unchanging, replicated the original object effect. However, no object effect was found when the rectangles disappeared from view in the last (target) frame. This was true regardless of the likelihood of the rectangles disappearing, indicating the importance of instantaneous object inputs for object-based attention. The across-trial experience of seeing a different object (boomerang), however, was found to influence the object effect when the cued rectangles persisted throughout the trial. Unlike previous studies, which emphasize one or the other, we demonstrate clearly that instantaneous object inputs and past experience interact to determine the way attention selects objects.