Attentional weights in vision as products of spatial and nonspatial components

Attentional Modulation in Early Visual Cortex: A Focused Reanalysis of Steady-state Visual Evoked Potential Studies

Steady-state visual evoked potentials (SSVEPs) are a powerful tool for investigating selective attention. Here, we conducted a combined reanalysis of multiple studies employing this technique in a variety of attentional experiments to, first, establish benchmark effect sizes of attention on amplitude and phase of SSVEPs and, second, harness the power of a large data set to test more specific hypotheses. Data of eight published SSVEP studies were combined, in which human participants (n = 135 in total) attended to flickering random dot stimuli based on their defining features (e.g., location, color, luminance, or orientation) or feature conjunctions. The reanalysis established that, in all the studies, attention reliably enhanced amplitudes, with color-based attention providing the strongest effect. In addition, the latency of SSVEPs elicited by attended stimuli was reduced by ∼4 msec. Next, we investigated the modulation of SSVEP amplitudes in a subset of studies where two different features were attended concurrently. Although most models assume that attentional effects of multiple features are combined additively, our results suggest that neuronal enhancement provided by concurrent attention is better described by multiplicative integration. Finally, we used the combined data set to demonstrate that the increase in trial-averaged SSVEP amplitudes with attention cannot be explained by increased synchronization of single-trial phases. Contrary to the prediction of the phase-locking account, the variance across trials of complex Fourier coefficients increases with attention, which is more consistent with boosting of a largely phase-locked signal embedded in non-phase-locked noise.

Advances in the application of a computational Theory of Visual Attention (TVA): Moving towards more naturalistic stimuli and game-like tasks

The theory of visual attention, “TVA”, is an influential and formal theory of attentional selection. It is widely applied in clinical assessment of attention and fundamental attention research. However, most TVA-based research is based on accuracy data from letter report experiments performed in controlled laboratory environments. While such basic approaches to questions regarding attentional selection are undoubtedly useful, recent technological advances have enabled the use of increasingly sophisticated experimental paradigms involving more realistic scenarios. Notably, these studies have in many cases resulted in different estimates of capacity limits than those found in studies using traditional TVA-based assessment. Here we review recent developments in TVA-based assessment of attention that goes beyond the use of letter report experiments and experiments performed in controlled laboratory environments. We show that TVA can be used with other tasks and new stimuli, that TVA-based parameter estimation can be embedded into complex scenarios, such as games that can be used to investigate particular problems regarding visual attention, and how TVA-based simulations of “visual foraging” can elucidate attentional control in more naturalistic tasks. We also discuss how these developments may inform future advances of TVA.

TVA in the wild: Applying the theory of visual attention to game-like and less controlled experiments

As a formal theory, Bundesen’s theory of visual attention (TVA) enables the estimation of several theoretically meaningful parameters involved in attentional selection and visual encoding. As of yet, TVA has almost exclusively been used in restricted empirical scenarios such as whole and partial report and with strictly controlled stimulus material. We present a series of experiments in which we test whether the advantages of TVA can be exploited in more realistic scenarios with varying degree of stimulus control. This includes brief experimental sessions conducted on different mobile devices, computer games, and a driving simulator. Overall, six experiments demonstrate that the TVA parameters for processing capacity and attentional weight can be measured with sufficient precision in less controlled scenarios and that the results do not deviate strongly from typical laboratory results, although some systematic differences were found.

The time course of salience: not entirely caused by salience

Visual salience is a key component of attentional selection, the process that guards the scarce resources needed for conscious recognition and perception. In previous works, we proposed a measure of visual salience based on a formal theory of visual selection. However, the strength of visual salience depends on the time course as well as local physical contrasts. Evidence from multiple experimental designs in the literature suggests that the strength of salience rises initially and declines after approximately 150 ms. The present article amends the theory-based salience measure beyond local physical contrasts to the time course of salience. It does so through a first experiment which reveals that—contrary to expectations—salience is not reduced during the first 150 ms after onset. Instead, the overall visual processing capacity is severely reduced, which corresponds to a reduced processing speed of all stimuli in the visual field. A second experiment confirms this conclusion by replicating the result. We argue that the slower stimulus processing may have been overlooked previously because the attentional selection mechanism had not yet been modeled in studies on the time course of salience.

Top-Down Attention Is Limited Within but Not Between Feature Dimensions

In natural vision, processing of spatial and nonspatial features occurs simultaneously; however, the two types of attention in charge of facilitating this processing have distinct mechanisms. Here, we tested the independence of spatial and feature-based attention at different stages of visual processing by examining color-based attentional selection while spatial attention was focused or divided. Human observers attended to one or two of four fields of randomly moving dots presented in both left and right visual hemifields. In the focused attention condition, the target stimulus was defined both by color and location, whereas in the divided attention condition stimuli of the target color had to be attended in both hemifields. Sustained attentional selection was measured by means of steady-state visual evoked potentials elicited by each of the frequency-tagged flickering dot fields. Additionally, target and distractor selection was assessed with ERPs to these stimuli. We found that spatial and color-based attention independently modulated the amplitude of steady-state visual evoked potentials, confirming independent top-down influences on early visual areas. In contrast, P3 amplitudes elicited only by targets and distractors of the attended color were subject to space-based enhancement, suggesting increasing integration of spatial and feature-based selection over the course of perceptual processing.

Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention

Spatial attention changes the sampling of visual space. Behavioral studies suggest that feature-based attention modulates this resampling to optimize the attended feature's sampling. We investigate this hypothesis by estimating spatial sampling in visual cortex while independently varying both feature-based and spatial attention. Our results show that spatial and feature-based attention interacted: resampling of visual space depended on both the attended location and feature (color vs. temporal frequency). This interaction occurred similarly throughout visual cortex, regardless of an area's overall feature preference. However, the interaction did depend on spatial sampling properties of voxels that prefer the attended feature. These findings are parsimoniously explained by variations in the precision of an attentional gain field. Our results demonstrate that the deployment of spatial attention is tailored to the spatial sampling properties of units that are sensitive to the attended feature.

Poking Left To Be Right? A Model-Based Analysis of Temporal Order Judged by Mice

The theory of visual attention (TVTVA) provides a formal framework for the assessment of visual attention and related processes. Its center is a mathematical model of visual encoding processes and discretely defined components of attention. Building on this model, TVTVA offers quantitative and process-related explanations for a variety of phenomena in the domain of visual attention. Because the theory relies on very general assumptions which might hold true for other domains of sensory processing, we tested its possible explanatory value for tactile processing in mice. Reanalyzing published data of temporal-order judgments by mice, we show how a TVTVA-based analysis identifies the processes which drive observable behavior and that it comes to conclusions quite different from those of conventional analyses of temporal-order judgments. According to this analysis, despite the same overall capacity dedicated to the task, some mice assume attentional biases toward one side, possibly to optimize their overall performance. We suggest that TVTVA's concepts provide a powerful point of vantage to find explanations for observable behavior where conventional analysis easily leads to dead ends.