Equality judgments cannot distinguish between attention effects on appearance and criterion: a reply to Schneider (2011)

Endogenous attention enhances contrast appearance regardless of stimulus contrast

There has been enduring debate on how attention alters contrast appearance. Recent research indicates that exogenous attention enhances contrast appearance for low-contrast stimuli but attenuates it for high-contrast stimuli. Similarly, one study has demonstrated that endogenous attention heightens perceived contrast for low-contrast stimuli, yet none have explored its impact on high-contrast stimuli. In this study, we investigated how endogenous attention alters contrast appearance, with a specific focus on high-contrast stimuli. In Experiment 1, we utilized the rapid serial visual presentation (RSVP) paradigm to direct endogenous attention, revealing that contrast appearance was enhanced for both low- and high-contrast stimuli. To eliminate potential influences from the confined attention field in the RSVP paradigm, Experiment 2 adopted the letter identification paradigm, deploying attention across a broader visual field. Results consistently indicated that endogenous attention increased perceived contrast for high-contrast stimuli. Experiment 3 employed equiluminant chromatic letters as stimuli in the letter identification task to eliminate potential interference from contrast adaption, which might have occurred in Experiment 2. Remarkably, the boosting effect of endogenous attention persisted. Combining the results from these experiments, we propose that endogenous attention consistently enhances contrast appearance, irrespective of stimulus contrast levels. This stands in contrast to the effects of exogenous attention, suggesting that mechanisms through which endogenous attention alters contrast appearance may differ from those of exogenous attention.

Dissociable Neural Mechanisms Underlie the Effects of Attention on Visual Appearance and Response Bias

A prominent theoretical framework spanning philosophy, psychology, and neuroscience holds that selective attention penetrates early stages of perceptual processing to alter the subjective visual experience of behaviorally relevant stimuli. For example, searching for a red apple at the grocery store might make the relevant color appear brighter and more saturated compared with seeing the exact same red apple while searching for a yellow banana. In contrast, recent proposals argue that data supporting attention-related changes in appearance reflect decision- and motor-level response biases without concurrent changes in perceptual experience. Here, we tested these accounts by evaluating attentional modulations of EEG responses recorded from male and female human subjects while they compared the perceived contrast of attended and unattended visual stimuli rendered at different levels of physical contrast. We found that attention enhanced the amplitude of the P1 component, an early evoked potential measured over visual cortex. A linking model based on signal detection theory suggests that response gain modulations of the P1 component track attention-induced changes in perceived contrast as measured with behavior. In contrast, attentional cues induced changes in the baseline amplitude of posterior alpha band oscillations (∼9-12 Hz), an effect that best accounts for cue-induced response biases, particularly when no stimuli are presented or when competing stimuli are similar and decisional uncertainty is high. The observation of dissociable neural markers that are linked to changes in subjective appearance and response bias supports a more unified theoretical account and demonstrates an approach to isolate subjective aspects of selective information processing.SIGNIFICANCE STATEMENT Does attention alter visual appearance, or does it simply induce response bias? In the present study, we examined these competing accounts using EEG and linking models based on signal detection theory. We found that response gain modulations of the visually evoked P1 component best accounted for attention-induced changes in visual appearance. In contrast, cue-induced baseline shifts in alpha band activity better explained response biases. Together, these results suggest that attention concurrently impacts visual appearance and response bias, and that these processes can be experimentally isolated.

The Beep-Speed Illusion Cannot Be Explained With a Simple Selection Bias

An object appears to move at higher speed than another equally fast object when brief nonspatial tones coincide with its changes in motion direction. We refer to this phenomenon as the beep-speed illusion (Meyerhoff et al., 2022, Cognition, 219, 104978). The origin of this illusion is unclear; however, attentional explanations and potential biases in the response behavior appear to be plausible candidates. In this report, we test a simple bias explanation that emerges from the way the dependent variable is assessed. As the participants have to indicate the faster of the two objects, participants possibly always indicate the audio-visually synchronized object in situations of perceptual uncertainty. Such a response behavior potentially could explain the observed shift in perceived speed. We therefore probed the magnitude of the beep-speed illusion when the participants indicated either the object that appeared to move faster or the object that appeared to move slower. If a simple selection bias would explain the beep-speed illusion, the response pattern should be inverted with the instruction to indicate the slower object. However, contrary to this bias hypothesis, illusion emerged indistinguishably under both instructions. Therefore, simple selection biases cannot explain the beep-speed illusion.

Spontaneous Alpha-Band Oscillations Bias Subjective Contrast Perception

Perceptual decisions depend both on the features of the incoming stimulus and on the ongoing brain activity at the moment the stimulus is received. Specifically, trial-to-trial fluctuations in cortical excitability have been linked to fluctuations in the amplitude of prestimulus α oscillations (∼8-13 Hz), which are in turn are associated with fluctuations in subjects' tendency to report the detection of a stimulus. It is currently unknown whether α oscillations bias postperceptual decision-making, or even bias subjective perception itself. To answer this question, we used a contrast discrimination task in which both male and female human subjects reported which of two gratings (one in each hemifield) was perceived as having a stronger contrast. Our EEG analysis showed that subjective contrast was reduced for the stimulus in the hemifield represented in the hemisphere with relatively stronger prestimulus α amplitude, reflecting reduced cortical excitability. Furthermore, the strength of this spontaneous hemispheric lateralization was strongly correlated with the magnitude of individual subjects' biases, suggesting that the spontaneous patterns of α lateralization play a role in explaining the intersubject variability in contrast perception. These results indicate that spontaneous fluctuations in cortical excitability, indicated by patterns of prestimulus α amplitude, affect perceptual decisions by altering the phenomenological perception of the visual world.SIGNIFICANCE STATEMENT Our moment-to-moment perception of the world is shaped by the features of the environment surrounding us, as much as by the constantly evolving states that characterize our brain activity. Previous research showed how the ongoing electrical activity of the brain can influence whether a stimulus has accessed conscious perception. However, evidence is currently missing on whether these electrical brain states can be associated to the subjective experience of a sensory input. Here we show that local changes in patterns of electrical brain activity preceding visual stimulation can bias our phenomenological perception. Importantly, we show that the strength of these variations can help explain the great interindividual variability in how we perceive the visual environment surrounding us.

The beep-speed illusion: Non-spatial tones increase perceived speed of visual objects in a forced-choice paradigm

We introduce a new audio-visual illusion revealing the interplay between audio-visual integration and selective visual attention. This illusion involves two simultaneously moving objects that change their motion trajectory occasionally, but only the direction changes of one object are accompanied by spatially uninformative tones. We observed a selective increase in perceived object speed of the audio-visually synchronized object by measuring the point of subjective equality in a forced-choice paradigm. The illusory increase in perceived speed of the audio-visually synchronized object persisted when preventing eye movements. Using temporally matched color changes of the synchronized object also increased the perceived speed. Yet, using color changes of a surrounding frame instead of tones had no effect on perceived speed ruling out simple alertness explanations. Thus, in contrast to coinciding tones, visual coincidences only elicit illusory increases in perceived speed when the coincidence provided spatial information. Taken together, our pattern of results suggests that audio-visual synchrony attracts visual attention toward the coinciding visual object, leading to an increase in speed-perception and thus shedding new light on the interplay between attention and multisensory feature integration. We discuss potential limitations such as the choice of paradigm and outline prospective research question to further investigate the effect of audio-visual integration on perceived object speed.

A three-response task reveals how attention alters decision criteria but not appearance

Whether attention alters appearance or just changes decision criteria continues to be controversial. When subjects are forced to choose which of two equal targets, one of which has been pre-cued, has a higher contrast, they tend to choose the cued target. This has been interpreted as attention increasing the apparent contrast of the cued target. However, when subjects must decide whether the two targets have equal or unequal contrast, they respond veridically with no apparent effect of attention. The discrepancy between these comparative and equality judgments is explained by attention altering the decision criteria but not appearance. We supposed that when subjects are forced to choose which of two apparently equal targets has the higher contrast, they tend to proportion their uncertainty in favor of the cued target. To test this hypothesis, we used a three-response task, in which subjects chose which target had the higher contrast but also had the option to report that the targets appeared equal. This task disentangled potential attention effects on appearance from those on the decision criteria. We found that subjects with narrower criteria about what constituted equal contrast were more likely to choose the cued target, supporting the uncertainty stealing hypothesis. Across the population, the effects of the attentional cue are explained as changes in the decision criteria and not changes in appearance.

Stimulus visibility and uncertainty mediate the influence of attention on response bias and visual contrast appearance

Although attention is known to improve the efficacy of sensory processing, the impact of attention on subjective visual appearance is still a matter of debate. Although recent studies suggest that attention can alter the appearance of stimulus contrast, others argue that these changes reflect response bias induced by attention cues. Here, we provide evidence that attention has effects on both appearance and response bias. In a comparative judgment task in which subjects reported whether the attended or unattended visual stimulus had a higher perceived contrast, attention induced substantial baseline-offset response bias as well as small but significant changes in subjective contrast appearance when subjects viewed near-threshold stimuli. However, when subjects viewed suprathreshold stimuli, baseline-offset response bias decreased and attention primarily changed contrast appearance. To address the possibility that these changes in appearance might be influenced by uncertainty due to the attended and unattended stimuli having similar physical contrasts, subjects performed an equality judgment task in which they reported if the contrast of the two stimuli was the same or different. We found that, although there were still attention-induced changes in contrast appearance at lower contrasts, the robust changes in contrast appearance at higher contrasts observed in the comparative judgment task were diminished in the equality judgment task. Together, these results suggest that attention can impact both response bias and appearance, and these two types of attention effects are differentially mediated by stimulus visibility and uncertainty. Collectively, these findings help constrain arguments about the cognitive penetrability of perception.

Exogenous spatial attention shortens perceived depth

Although spatial attention has been found to alter the subjective appearance of visual stimuli in several perceptual dimensions, no research has explored whether exogenous spatial attention can affect depth perception, which is a fundamental dimension in perception that allows us to effectively interact with the environment. Here, we used an experimental paradigm adapted from Gobell and Carrasco (Psychological Science, 16[8], 644-651, 2005) to investigate this question. A peripheral cue preceding two line stimuli was used to direct exogenous attention to either location of the two lines. The two lines were separated by a certain relative disparity, and participants were asked to judge the perceived depth of two lines while attention was manipulated. We found that a farther stereoscopic depth at the attended location was perceived to be equally distant as a nearer depth at the unattended location. No such effect was found in a control experiment that employed a postcue paradigm, suggesting that our findings could not be attributed to response bias. Therefore, our study shows that exogenous spatial attention shortens perceived depth. The apparent change in stereoscopic depth may be regulated by a mechanism involving direct neural enhancement on those tuned to disparity, or be modulated by an attentional effect on apparent contrast. This finding shows that attention can change not only visual appearance but also the perceived spatial relation between an object and an observer.

Prior Experience Alters the Appearance of Blurry Object Borders

Object memories activated by borders serve as priors for figure assignment: figures are more likely to be perceived on the side of a border where a well-known object is sketched. Do object memories also affect the appearance of object borders? Memories represent past experience with objects; memories of well-known objects include many with sharp borders because they are often fixated. We investigated whether object memories affect appearance by testing whether blurry borders appear sharper when they are contours of well-known objects versus matched novel objects. Participants viewed blurry versions of one familiar and one novel stimulus simultaneously for 180 ms; then made comparative (Exp. 1) or equality judgments regarding perceived blur (Exps. 2–4). For equivalent levels of blur, the borders of well-known objects appeared sharper than those of novel objects. These results extend evidence for the influence of past experience to object appearance, consistent with dynamic interactive models of perception.

Spatial attention alters visual appearance

It is well established that attention improves performance on many visual tasks. However, for more than 100 years, psychologists, philosophers, and neurophysiologists have debated its phenomenology-whether attention actually changes one's subjective experience. Here, we show that it is possible to objectively and quantitatively investigate the effects of attention on subjective experience. First, we review evidence showing that attention alters the appearance of many static and dynamic basic visual dimensions, which mediate changes in appearance of higher-level perceptual aspects. Then, we summarize current views on how attention alters appearance. These findings have implications for our understanding of perception and attention, illustrating that attention affects not only how we perform in visual tasks, but actually alters our experience of the visual world.

How visual spatial attention alters perception

Visual attention is essential for visual perception. Spatial attention allows us to grant priority in processing and selectively process information at a given location. In this paper, I explain how two kinds of spatial attention: covert (allocated to the target location, without accompanying eye movements) and presaccadic (allocated to the location of the upcoming saccade's target) affect performance and alter appearance. First, I highlight some behavioral and neuroimaging research on covert attention, which alters performance and appearance in many basic visual tasks. Second, I review studies showing that presaccadic attention improves performance and alters appearance at the saccade target location. Further, these modulations change the processing of feature information automatically, even when it is detrimental to the task at hand. We propose that saccade preparation may support transsaccadic integration. Systematically investigating the common and differential characteristics of covert attention and presaccadic attention will continue to further our understanding of the pervasive selective processing of information, which enables us to make sense of our complex visual world.

On spatial attention and its field size on the repulsion effect

We investigated the attentional repulsion effect-stimuli appear displaced further away from attended locations-in three experiments: one with exogenous (involuntary) attention, and two with endogenous (voluntary) attention with different attention-field sizes. It has been proposed that differences in attention-field size can account for qualitative differences in neural responses elicited by attended stimuli. We used psychophysical comparative judgments and manipulated either exogenous attention via peripheral cues or endogenous attention via central cues and a demanding rapid serial visual presentation task. We manipulated the attention field size of endogenous attention by presenting streams of letters at two specific locations or at two of many possible locations during each block. We found a robust attentional repulsion effect in all three experiments: with endogenous and exogenous attention and with both attention-field sizes. These findings advance our understanding of the influence of spatial attention on the perception of visual space and help relate this repulsion effect to possible neurophysiological correlates.

Interactions between voluntary and involuntary attention modulate the quality and temporal dynamics of visual processing

Successfully navigating a dynamic environment requires the efficient distribution of finite neural resources. Voluntary (endogenous) covert spatial attention selectively allocates those processing resources to goal-relevant locations in the visual scene in the absence of eye movements. However, the allocation of spatial attention is not always voluntary; abrupt onsets in the visual periphery automatically enhance processing of nearby stimuli (exogenous attention). In dynamic environments, exogenous events and internal goals likely compete to determine the distribution of attention, but how such competition is resolved is not well understood. To investigate how exogenous events interact with the concurrent allocation of voluntary attention, we used a speed-accuracy trade-off (SAT) procedure. SAT conjointly measures the rate of information accrual and asymptotic discriminability, allowing us to measure how attentional interactions unfold over time during stimulus processing. We found that both types of attention sped information accrual and improved discriminability. However, focusing endogenous attention at the target location reduced the effects of exogenous cues on the rate of information accrual and rendered negligible their effects on asymptotic discriminability. We verified the robustness of these findings in four additional experiments that targeted specific, critical response delays. In conclusion, the speed and quality of visual processing depend conjointly on internally and externally driven attentional states, but it is possible to voluntarily diminish distraction by irrelevant events in the periphery.

Attentional Effects on Phenomenological Appearance: How They Change with Task Instructions and Measurement Methods

It has been reported that exogenous cues accentuate contrast appearance. The empirical finding is controversial because non-veridical perception challenges the idea that attention prioritizes processing resources to make perception better, and because philosophers have used the finding to challenge representational accounts of mental experience. The present experiments confirm that when evaluated with comparison paradigms exogenous cues increase the apparent contrast. In addition, contrast appearance was also changed by simply changing the purpose of a secondary task. When comparison and discrimination reports were combined in a single experiment there was a behavioral disassociation: contrast enhanced for comparison responses, but did not change for discrimination judgments, even when participants made both types of judgment for a single stimulus. That a single object can have multiple simultaneous appearances leads inescapably to the conclusion that our unitary mental experience is illusory.

Attention and multisensory modulation argue against total encapsulation

Firestone & Scholl (F&S) postulate that vision proceeds without any direct interference from cognition. We argue that this view is extreme and not in line with the available evidence. Specifically, we discuss two well-established counterexamples: Attention directly affects core aspects of visual processing, and multisensory modulations of vision originate on multiple levels, some of which are unlikely to fall "within perception."

Attention enhances contrast appearance via increased input baseline of neural responses

Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, using a two-alternative, forced-choice comparison task to probe the effect of attention on appearance across the contrast range. We modeled performance in the task as a function of underlying neural contrast-response functions. Fitting this model to the observed data revealed that an increased input baseline in the neural responses accounted for the enhancement of apparent contrast with spatial attention.

Color vision in ADHD: part 2--does attention influence color perception?

Background

To investigate the impact of exogenous covert attention on chromatic (blue and red) and achromatic visual perception in adults with and without Attention Deficit Hyperactivity Disorder (ADHD). Exogenous covert attention, which is a transient, automatic, stimulus-driven form of attention, is a key mechanism for selecting relevant information in visual arrays.

Methods

30 adults diagnosed with ADHD and 30 healthy adults, matched on age and gender, performed a psychophysical task designed to measure the effects of exogenous covert attention on perceived color saturation (blue, red) and contrast sensitivity.

Results

The effects of exogenous covert attention on perceived blue and red saturation levels and contrast sensitivity were similar in both groups, with no differences between males and females. Specifically, exogenous covert attention enhanced the perception of blue saturation and contrast sensitivity, but it had no effect on the perception of red saturation.

Conclusion

The findings suggest that exogenous covert attention is intact in adults with ADHD and does not account for the observed impairments in the perception of chromatic (blue and red) saturation.

Electronic supplementary material

The online version of this article (doi:10.1186/1744-9081-10-39) contains supplementary material, which is available to authorized users.

Effects of Stimulus Order on Discrimination Processes in Comparative and Equality Judgements: Data and Models

In typical discrimination experiments, participants are presented with a constant standard and a variable comparison stimulus and their task is to judge which of these two stimuli is larger (comparative judgement). In these experiments, discrimination sensitivity depends on the temporal order of these stimuli (Type B effect) and is usually higher when the standard precedes rather than follows the comparison. Here, we outline how two models of stimulus discrimination can account for the Type B effect, namely the weighted difference model (or basic Sensation Weighting model) and the Internal Reference Model. For both models, the predicted psychometric functions for comparative judgements as well as for equality judgements, in which participants indicate whether they perceived the two stimuli to be equal or not equal, are derived and it is shown that the models also predict a Type B effect for equality judgements. In the empirical part, the models’ predictions are evaluated. To this end, participants performed a duration discrimination task with comparative judgements and with equality judgements. In line with the models’ predictions, a Type B effect was observed for both judgement types. In addition, a time-order error, as indicated by shifts of the psychometric functions, and differences in response times were observed only for the equality judgement. Since both models entail distinct additional predictions, it seems worthwhile for future research to unite the two models into one conceptual framework.

Reach preparation enhances visual performance and appearance

We investigated the impact of the preparation of reach movements on visual perception by simultaneously quantifying both an objective measure of visual sensitivity and the subjective experience of apparent contrast. Using a two-by-two alternative forced choice task, observers compared the orientation (clockwise or counterclockwise) and the contrast (higher or lower) of a Standard Gabor and a Test Gabor, the latter of which was presented during reach preparation, at the reach target location or the opposite location. Discrimination performance was better overall at the reach target than at the opposite location. Perceived contrast increased continuously at the target relative to the opposite location during reach preparation, that is, after the onset of the cue indicating the reach target. The finding that performance and appearance do not evolve in parallel during reach preparation points to a distinction with saccade preparation, for which we have shown previously there is a parallel temporal evolution of performance and appearance. Yet akin to saccade preparation, this study reveals that overall reach preparation enhances both visual performance and appearance.