Attentional attraction of receptive fields can explain spatial and temporal effects of attention

An attentional approach to geometrical illusions

It is known for a long time that some drawings composed of points, lines, and areas are systematically misperceived. The origin of these geometrical illusions is still unknown. Here we outline how a recent progress in attentional research contributes to a better understanding of such perceptual distortions. The basic idea behind this approach is that crucial elements of a drawing are differently attended. These changes in the allocation of spatial attention go along with systematic changes in low-level spatial coding. As a result, changes in the perception of spatial extent, angles, positions, and shapes can arise. How this approach can be applied to individual illusions is discussed.

Are neuronal mechanisms of attention universal across human sensory and motor brain maps?

One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.

On the origin of the Helmholtz's square illusion: An attentional account

A square filled with parallel horizontal or vertical lines appears perceptually extended in the direction orthogonal to the lines. Here, we suggest that this Helmholtz illusion arises due to changes in spatial attention that entail changes at very early stages of perceptual processing. Three experiments are reported which tested this assumption. In Experiment1 and Experiment2, transient attentional cues were flashed in such a way that they either promoted (congruent condition) or hindered (incongruent condition) the attentional state presumably induced by the target objects. We predicted a decline of the illusion in the incongruent condition compared with the congruent condition. This prediction was confirmed in both experiments. However, the influence of (in)congruent attention cuing on the Helmholtz illusion depended on more sustained distributions of attention as well. An influence of sustained attention on the illusion was confirmed in Experiment 3, in which changes of attentional focus were induced by a secondary task. Overall, the results were consistent with our claim that the origin of the Helmholtz illusion is closely linked to the distribution of spatial attention.

Effects of involuntary and voluntary attention on critical spacing of visual crowding

Visual spatial attention can be allocated in two distinct ways: one that is voluntarily directed to behaviorally relevant locations in the world, and one that is involuntarily captured by salient external stimuli. Precueing spatial attention has been shown to improve perceptual performance on a number of visual tasks. However, the effects of spatial attention on visual crowding, defined as the reduction in the ability to identify target objects in clutter, are far less clear. In this study, we used an anticueing paradigm to separately measure the effects of involuntary and voluntary spatial attention on a crowding task. Each trial began with a brief peripheral cue that predicted that the crowded target would appear on the opposite side of the screen 80% of the time and on the same side of the screen 20% of the time. Subjects performed an orientation discrimination task on a target Gabor patch that was flanked by other similar Gabor patches with independent random orientations. For trials with a short stimulus onset asynchrony between cue and target, involuntary capture of attention led to faster response times and smaller critical spacing when the target appeared on the cue side. For trials with a long stimulus onset asynchrony, voluntary allocation of attention led to faster reaction times but no significant effect on critical spacing when the target appeared on the opposite side to the cue. We additionally found that the magnitudes of these cueing effects of involuntary and voluntary attention were not strongly correlated across subjects for either reaction time or critical spacing.

Different gain modulations of selective attention at short and long cue-target delays

Previous studies have tested attentional gain patterns, for example, within the normalization model of attention (NMoA), by altering the relative sizes of the attention field and stimuli. Existing studies have not investigated whether the gain patterns of altering the relative exogenous cue size as compared with the target stimuli matches the prediction of NMoA and whether these gain patterns exist in the late stage of attentional processing. To resolve these questions, the present study maintained the target grating size and changed the exogenous cue size in both short and long cue-target onset asynchronies (CTOAs) conditions. The results revealed response gain for small cue/large target size conditions and contrast gain for large cue/small target size conditions, which was consistent with the NMoA. However, we observed the decrease in the contrast gain factor only with long CTOAs, regardless of whether the cue size was relatively small or large. This indicated that NMoA-related effects based on the relative attentional field dominated in the early stage and that the contrast gain dominated in the late stage.

Different attentional focus sizes modulate the size-eccentricity effect

The size-eccentricity effect is a perceptual distortion phenomenon in which a peripherally located object is perceived to be smaller than a centrally located object. Although the increase in apparent object size caused by attention has been documented, little is known about the effect of different sizes of attentional focus on object appearance. The present study investigated how different sizes of attentional focus affect the size-eccentricity effect using a spatial pre-cueing paradigm. Additionally, we examined the influence of different task types on size perception. A peripheral object following a small attentional focus appeared larger, without observation of the size-eccentricity effect. In contrast, a peripheral object appeared smaller following a large attentional focus in both larger and smaller judgement tasks. These results suggest that the relative size of the attentional focus has opposite effects on the perception of object size, independent of task type. Furthermore, in addition to the structural properties of the retina and the locus of attention, the size of attentional focus determines the extent to which an object appears smaller in the periphery. The present study complements the attentional attraction field model of the size and density of population receptive fields in V1 and further explains how the effect of attention is restricted by retinal structure.

Motion processing impaired by transient spatial attention: Potential implications for the magnocellular pathway

Spatial cues presented prior to the presentation of a static stimulus usually improve its perception. However, previous research has also shown that transient exogenous cues to direct spatial attention to the location of a forthcoming stimulus can lead to reduced performance. In the present study, we investigated the effects of transient exogenous cues on the perception of briefly presented drifting Gabor patches. The spatial and temporal frequencies of the drifting Gabors were chosen to mainly engage the magnocellular pathway. We found better performance in the motion direction discrimination task when neutral cues were presented before the drifting target compared to a valid spatial cue. The behavioral results support the hypothesis that transient attention prolongs the internal response to the attended stimulus, thus reducing the temporal segregation of visual events. These results were complemented by applying a recently developed model for perceptual decisions to rule out a speed-accuracy trade-off and to further assess cueing effects on visual performance. In a model-based assessment, we found that valid cues initially enhanced processing but overall resulted in less efficient processing compared to neutral cues, possibly caused by reduced temporal segregation of visual events.

Effects of spatial attention on spatial and temporal acuity: A computational account

In our daily lives, the visual system receives a plethora of visual information that competes for the brain's limited processing capacity. Nevertheless, not all visual information is useful for our cognitive, emotional, social, and ultimately survival purposes. Therefore, the brain employs mechanisms to select critical information and thereby optimizes its limited resources. Attention is the selective process that serves such a function. In particular, covert spatial attention - attending to a particular location in the visual field without eye movements - improves spatial resolution and paradoxically deteriorates temporal resolution. The neural correlates underlying these attentional effects still remainelusive. In this work, we tested a neural model's predictions that explain these phenomena based on interactions between channels with different spatiotemporal sensitivities - namely, the magnocellular (transient) and parvocellular (sustained) channels. More specifically, our model postulates that spatial attention enhances activities in the parvocellular pathway, thereby producing improved performance in spatial resolution tasks. However, the enhancement of parvocellular activities leads to decreased magnocellular activities due to parvo-magno inhibitory interactions. As a result, spatial attention hampers temporal resolution. We compared the predictions of the model to psychophysical data, and show that our model can account qualitatively and quantitatively for the effects of spatial attention on spatial and temporal acuity.

Spatial Attention Enhances Crowded Stimulus Encoding Across Modeled Receptive Fields by Increasing Redundancy of Feature Representations

Any visual system, biological or artificial, must make a trade-off between the number of units used to represent the visual environment and the spatial resolution of the sampling array. Humans and some other animals are able to allocate attention to spatial locations to reconfigure the sampling array of receptive fields (RFs), thereby enhancing the spatial resolution of representations without changing the overall number of sampling units. Here, we examine how representations of visual features in a fully convolutional neural network interact and interfere with each other in an eccentricity-dependent RF pooling array and how these interactions are influenced by dynamic changes in spatial resolution across the array. We study these feature interactions within the framework of visual crowding, a well-characterized perceptual phenomenon in which target objects in the visual periphery that are easily identified in isolation are much more difficult to identify when flanked by similar nearby objects. By separately simulating effects of spatial attention on RF size and on the density of the pooling array, we demonstrate that the increase in RF density due to attention is more beneficial than changes in RF size for enhancing target classification for crowded stimuli. Furthermore, by varying target/flanker spacing, as well as the spatial extent of attention, we find that feature redundancy across RFs has more influence on target classification than the fidelity of the feature representations themselves. Based on these findings, we propose a candidate mechanism by which spatial attention relieves visual crowding through enhanced feature redundancy that is mostly due to increased RF density.

Contrasting effects of exogenous and endogenous attention on size perception

Although neuroimaging studies have shown that exogenous and endogenous attention are dissociable, only a few behavioural studies have explored their differential effects on visual sensitivity, and none have directly focused on visual appearance. Here, we show that exogenous and endogenous attention produces contrasting effects on apparent size. Participants performed a spatial pre-cueing comparative judgement task that had been frequently used to test the attentional effects on visual perception. The results showed that a smaller stimulus within the focus of exogenous attention was perceived to be equal in size as a larger unattended stimulus, whereas a larger stimulus within the focus of endogenous attention was perceived to be equal in size as a smaller unattended stimulus. In other words, exogenous attention increased the perceived size while endogenous attention decreased the perceived size. The contrasting effects may be attributed to the mechanism that exogenous attention favours parvocellular processing for which more neurons with smaller receptive fields (RFs) are activated for a given size, whereas endogenous attention favours magnocellular processing for which fewer neurons with larger RFs are activated. This finding shows that exogenous and endogenous attention acts differentially on size perception, and provides supportive evidence for the distinct mechanisms underlying the two types of attentional processing.

An image-computable model of how endogenous and exogenous attention differentially alter visual perception

Attention alters perception across the visual field. Typically, endogenous (voluntary) and exogenous (involuntary) attention similarly improve performance in many visual tasks, but they have differential effects in some tasks. Extant models of visual attention assume that the effects of these two types of attention are identical and consequently do not explain differences between them. Here, we develop a model of spatial resolution and attention that distinguishes between endogenous and exogenous attention. We focus on texture-based segmentation as a model system because it has revealed a clear dissociation between both attention types. For a texture for which performance peaks at parafoveal locations, endogenous attention improves performance across eccentricity, whereas exogenous attention improves performance where the resolution is low (peripheral locations) but impairs it where the resolution is high (foveal locations) for the scale of the texture. Our model emulates sensory encoding to segment figures from their background and predict behavioral performance. To explain attentional effects, endogenous and exogenous attention require separate operating regimes across visual detail (spatial frequency). Our model reproduces behavioral performance across several experiments and simultaneously resolves three unexplained phenomena: 1) the parafoveal advantage in segmentation, 2) the uniform improvements across eccentricity by endogenous attention, and 3) the peripheral improvements and foveal impairments by exogenous attention. Overall, we unveil a computational dissociation between each attention type and provide a generalizable framework for predicting their effects on perception across the visual field.

On the origin of the Ebbinghaus illusion: The role of figural extent and spatial frequency of stimuli

An object is perceived as larger when it is surrounded by smaller context objects than when it is surrounded by larger context objects. The origin of this well-known phenomenon, called as Ebbinghaus or Titchener circles illusion, is still puzzling. Here we introduce a basic explanation of how this illusion could emerge and provide some preliminary empirical support for this idea. In essence, we suggest that changes in the figural extent and in the spatial frequency of the stimulus pattern entail adjustments of the size and resolution of the attentional field, which are accompanied by changes in spatial coding. This approach is consistent with previous observations and can enable a deeper understanding of geometric illusions.

Action affects perception through modulation of attention

The present study explored the origin of perceptual changes repeatedly observed in the context of actions. In Experiment 1, participants tried to hit a circular target with a stylus movement under restricted feedback conditions. We measured the perception of target size during action planning and observed larger estimates for larger movement distances. In Experiment 2, we then tested the hypothesis that this action specific influence on perception is due to changes in the allocation of spatial attention. For this purpose, we replaced the hitting task by conditions of focused and distributed attention and measured the perception of the former target stimulus. The results revealed changes in the perceived stimulus size very similar to those observed in Experiment 1. These results indicate that action’s effects on perception root in changes of spatial attention.

The size of attentional focus modulates the perception of object location

The present study examined how the size of attended area affects the repulsion of perceived object location from the focus of attention reported previously (attentional repulsion effect). We induced sustained changes in the size of attentional focus and tested the impact of this experimental variation on the perception of object location. The results of three experiments revealed reliable repulsion effects for each size of attentional focus. However, the magnitude of the effect decreased substantially with an increase in focus size. This outcome extends the knowledge about how spatial attention affects visual perception.

Mexican Hat Modulation of Visual Acuity Following an Exogenous Cue

Classical models of exogenous attention suggest that attentional enhancement at the focus of attention degrades gradually with distance from the attended location. On the other hand, the Attentional Attraction Field (AAF) model (Baruch and Yeshurun, 2014) suggests that the shift of receptive fields toward the attended location, reported by several physiological studies, leads to a decreased density of RFs at the attentional surrounds and hence the model predicts that the modulation of performance by spatial attention may have the shape of a Mexican Hat. Motivated by these theories, this study presents behavioral evidence in support of a Mexican Hat shaped modulation in exogenous spatial tasks that appears only at short latencies. In two experiments participants had to decide the location of a small gap in a target circle that was preceded by a non-informative attention capturing cue. The distance between cue and target and the latency between their onsets were varied. At short SOAs the performance curves were cubic and only at longer SOAs- this trend turned linear. Our results suggest that a rapid Mexican Hat modulation is an inherent property of the mechanism underlying exogenous attention and that a monotonically degrading trend, such as advocated by classical models, develops only at later stages of processing. The involvements of bottom-up processes such as the attraction of RFs to the focus of attention are further discussed.

On Why Objects Appear Smaller in the Visual Periphery

An object appears smaller in the periphery than in the center of the visual field. In two experiments ( N = 24), we demonstrated that visuospatial attention contributes substantially to this perceptual distortion. Participants judged the size of central and peripheral target objects after a transient, exogenous cue directed their attention to either the central or the peripheral location. Peripheral target objects were judged to be smaller following a central cue, whereas this effect disappeared completely when the peripheral target was cued. This outcome suggests that objects appear smaller in the visual periphery not only because of the structural properties of the visual system but also because of a lack of spatial attention.

Flexibility in resizing attentional breadth: Asymmetrical versus symmetrical attentional contraction and expansion costs depends on context

One of the core ways that attentional resources can be regulated is the breadth of attention: the tendency to concentrate one’s attentional resources over a small region of space (i.e., “narrow scope”), or to spread them over a larger region of space (i.e., “broad scope”). It has long been understood that humans have a preference towards the broad or global level of processing. More recently, beyond any static preference, researchers have increasingly appreciated the importance of rapid rescaling of attentional breadth to meet task demands, especially for real-world tasks such as driving. Here, we examined whether there was any asymmetry in the human capacity to resize attention from a narrow to broad scale (expansion) versus a broad to narrow scale (contraction). In Experiment 1, we found remarkable symmetry in expansion and contraction efficiency, even under conditions where the global stimuli were demonstrably more salient. This indicates that humans can flexibly adapt to the attentional demands of the context. However, in Experiment 2, an asymmetry was revealed, whereby attentional expansion was more efficient than contraction. The key difference between Experiments 1 and 2 was whether or not the initial baseline block demanded frequent attentional resizing, suggesting that recent experience can impact attentional flexibility. We also found reliable individual differences in participants’ ability to resize their attentional breadth, identifying a group of high-flexibility individuals who excelled at both attentional expansion and contraction.

Causal inference for spatial constancy across whole body motion

The brain uses self-motion information to internally update egocentric representations of locations of remembered world-fixed visual objects. If a discrepancy is observed between this internal update and reafferent visual feedback, this could be either due to an inaccurate update or because the object has moved during the motion. To optimally infer the object's location it is therefore critical for the brain to estimate the probabilities of these two causal structures and accordingly integrate and/or segregate the internal and sensory estimates. To test this hypothesis, we designed a spatial updating task involving passive whole body translation. Participants, seated on a vestibular sled, had to remember the world-fixed position of a visual target. Immediately after the translation, the reafferent visual feedback was provided by flashing a second target around the estimated "updated" target location, and participants had to report the initial target location. We found that the participants' responses were systematically biased toward the position of the second target position for relatively small but not for large differences between the "updated" and the second target location. This pattern was better captured by a Bayesian causal inference model than by alternative models that would always either integrate or segregate the internally updated target location and the visual feedback. Our results suggest that the brain implicitly represents the posterior probability that the internally updated estimate and the visual feedback come from a common cause and uses this probability to weigh the two sources of information in mediating spatial constancy across whole body motion. NEW & NOTEWORTHY When we move, egocentric representations of object locations require internal updating to keep them in register with their true world-fixed locations. How does this mechanism interact with reafferent visual input, given that objects typically do not disappear from view? Here we show that the brain implicitly represents the probability that both types of information derive from the same object and uses this probability to weigh their contribution for achieving spatial constancy across whole body motion.

The size of the attentional window when measured by the pupillary response to light

This study measured the size of the attentional window when attention is narrowly focused, using attentional modulation of the pupillary light response - pupillary constriction when covertly attending a brighter than darker area. This allowed us to avoid confounds and biases involved in relying on observers' response (e.g., RT), which contaminated previous measurements of this window. We presented letters to the right and left of fixation, each surrounded by task-irrelevant disks with varying distances. The disks were bright on one side and dark on the other. A central cue indicated which letter to attend. Luminance levels were identical across trials. We found that pupil size was modulated by the disks' luminance when they were 1° away from the attended letter, but not when this distance was larger. This suggests that the diameter of the attentional window is at least 2°, which is twice as large as that established with behavioral measurements.

Attention and multisensory modulation argue against total encapsulation

Firestone & Scholl (F&S) postulate that vision proceeds without any direct interference from cognition. We argue that this view is extreme and not in line with the available evidence. Specifically, we discuss two well-established counterexamples: Attention directly affects core aspects of visual processing, and multisensory modulations of vision originate on multiple levels, some of which are unlikely to fall "within perception."