"Pop-out" of targets modulated in luminance or colour: the effect of intrinsic and extrinsic uncertainty

A diffusion model analysis of target detection in near-threshold visual search

When searching for a target briefly presented among distractors how do people combine information across display locations to make a decision and how does the quality of the evidence entering the decision process vary with the type of items in the display? Research on accuracy in near-threshold visual search has had difficulty in distinguishing between models that make similar predictions about accuracy but make different assumptions about the underlying psychological processes. We used the diffusion model to analyse response times and accuracy data from four near-threshold search tasks which showed striking asymmetries between response-time distributions on target-present and target-absent trials. We found that performance was better explained by a model in which evidence was accumulated in parallel about each stimulus separately than one in which the evidence was pooled into a single decision process. We found that as contrast increased, the quality of the evidence entering the decision process about targets was markedly stronger than the evidence about nontargets. The overall pattern of evidence strength for stimuli on target-present and target-absent trials was consistent with a fixed-capacity memory system in which early visual processes assigned resources preferentially to targets over nontargets. The asymmetry was somewhat reduced in a letter-digit discrimination task that used heterogeneous targets and distractors, likely because heterogeneity reduces the efficiency of the preattentive filtering processes.

Orientation enhancement in early visual processing can explain time course of brightness contrast and White's illusion

Dynamics of orientation tuning in V1 indicates that computational model of V1 should not only comprise of bank of static spatially oriented filters but also include the contribution for dynamical response facilitation or suppression along orientation. Time evolution of orientation response in V1 can emerge due to time- dependent excitation and lateral inhibition in the orientation domain. Lateral inhibition in the orientation domain suggests that Ernst Mach's proposition can be applied for the enhancement of initial orientation distribution that is generated due to interaction of visual stimulus with spatially oriented filters and subcortical temporal filter. Oriented spatial filtering that appears much early (<70 ms) in the sequence of visual information processing can account for many of the brightness illusions observed at steady state. It is therefore expected that time evolution of orientation response might be reflecting in the brightness percept over time. Our numerical study suggests that only spatio-temporal filtering at early phase can explain experimentally observed temporal dynamics of brightness contrast illusion. But, enhancement of orientation response at early phase of visual processing is the key mechanism that can guide visual system to predict the brightness by "Max-rule" or "Winner Takes All" (WTA) estimation and thus producing White's illusions at any exposure.

Attention in a bayesian framework

The behavioral phenomena of sensory attention are thought to reflect the allocation of a limited processing resource, but there is little consensus on the nature of the resource or why it should be limited. Here we argue that a fundamental bottleneck emerges naturally within Bayesian models of perception, and use this observation to frame a new computational account of the need for, and action of, attention - unifying diverse attentional phenomena in a way that goes beyond previous inferential, probabilistic and Bayesian models. Attentional effects are most evident in cluttered environments, and include both selective phenomena, where attention is invoked by cues that point to particular stimuli, and integrative phenomena, where attention is invoked dynamically by endogenous processing. However, most previous Bayesian accounts of attention have focused on describing relatively simple experimental settings, where cues shape expectations about a small number of upcoming stimuli and thus convey "prior" information about clearly defined objects. While operationally consistent with the experiments it seeks to describe, this view of attention as prior seems to miss many essential elements of both its selective and integrative roles, and thus cannot be easily extended to complex environments. We suggest that the resource bottleneck stems from the computational intractability of exact perceptual inference in complex settings, and that attention reflects an evolved mechanism for approximate inference which can be shaped to refine the local accuracy of perception. We show that this approach extends the simple picture of attention as prior, so as to provide a unified and computationally driven account of both selective and integrative attentional phenomena.

Relating spatial and temporal orientation pooling to population decoding solutions in human vision

Spatial pooling is often considered synonymous with averaging (or other statistical combinations) of local information contained within a complex visual image. We have recently shown, however, that spatial pooling of motion signals is better characterized in terms of optimal decoding of neuronal populations rather than image statistics (Webb et al., 2007). Here we ask which computations guide the spatial and temporal pooling of local orientation signals in human vision. The observers’ task was to discriminate which of two texture patterns had a more clockwise global orientation. Standard textures had a common orientation; comparison textures were chosen independently from a skewed (asymmetrical) probability distribution with distinct spatial or temporal statistics. We simulated observers’ performance using different estimators (vector average, winner-takes-all and maximum likelihood) to decode the orientation-tuned activity of a population of model neurons. Our results revealed that the perceived global orientation of texture patterns coincided with the mean (or vector average read-out) of orientation signals accumulated over both space and time. To reconcile these results with our previous work on direction pooling, we varied stimulus duration. Perceived global orientation was accurately predicted by a vector average read-out of orientation signals at relatively short stimulus durations and maximum likelihood read-out at longer durations. Moreover, decreasing the luminance contrast of texture patterns increased the duration of the transition from a vector average to maximum likelihood read-out. Our results suggest that direction and orientation pooling use similar probabilistic read-out strategies when sufficient time is available.

Search superiority in autism within, but not outside the crowding regime

Visual cognition of observers with autism spectrum disorder (ASD) seems to show an unbalance between the complementary functions of integration and segregation. This study uses visual search and crowding paradigms to probe the relative ability of children with autism, compared to normal developments children, to extract individual targets from cluttered backgrounds both within and outside the crowding regime. The data show that standard search follows the same pattern in the ASD and control groups with a strong effect of the set size that is substantially weakened by cueing the target location with a synchronous spatial cue. On the other hand, the crowding effect of eight flankers surrounding a small peripheral target is virtually absent in the clinical sample, indicating a superior ability to segregate cluttered visual items. This data, along with evidence of an impairment to the neural system for binding contours in ASD, bring additional support to the general idea of a shift of the trade-off between integration and segregation toward the latter. More specifically, they show that when discriminability is balanced across conditions, an advantage in odd-man out tasks is evident in ASD observers only within the crowding regime, when binding mechanism might get compulsorily triggered in normal observers.

Chromaticity in the UV/blue range facilitates the search for achromatically background-matching prey in birds

A large variety of predatory species rely on their visual abilities to locate their prey. However, the search for prey may be hampered by prey camouflage. The most prominent example of concealing coloration is background-matching prey coloration characterized by a strong visual resemblance of prey to the background. Even though this principle of camouflage was recognized to efficiently work in predator avoidance a long time ago, the underlying mechanisms are not very well known. In this study, we assessed whether blue tits (Cyanistes caeruleus) use chromatic cues in the search for prey. We used two prey types that were achromatically identical but differed in chromatic properties in the UV/blue range and presented them on two achromatically identical backgrounds. The backgrounds had either the same chromatic properties as the prey items (matching combination) or differed in their chromatic properties (mismatching combination). Our results show that birds use chromatic cues in the search for mismatching prey, whereupon chromatic contrast leads to a 'pop-out' of the prey item from the background. When prey was presented on a matching background, search times were significantly higher. Interestingly, search for more chromatic prey on the matching background was easier than search for less chromatic prey on the matching background. Our results indicate that birds use both achromatic and chromatic cues when searching for prey, and that the combination of both cues might be helpful in the search task.

On-line processing of uncertain information in visuomotor control

Our sensory observations represent a delayed, noisy estimate of the environment. Delay causes instability and noise causes uncertainty. To deal with these problems, theory suggests that the processing of sensory information by the brain should be probabilistic: to start a movement or to alter it midflight, our brain should make predictions about the near future of sensory states and then continuously integrate the delayed sensory measures with predictions to form an estimate of the current state. To test the predictions of this theory, we asked participants to reach to the center of a blurry target. With increased uncertainty about the target, reach reaction times increased. Occasionally, we changed the position of the target or its blurriness during the reach. We found that the motor response to a given second target was influenced by the uncertainty about the first target. The specific trajectories of motor responses were consistent with predictions of a "minimum variance" state estimator. That is, the motor output that the brain programmed to start a reaching movement or correct it midflight was a continuous combination of two streams of information: a stream that predicted the near future of the state of the environment and a stream that provided a delayed measurement of that state.

Non-linear integration of crowded orientation signals

Crowding of oriented signals has been explained as linear, compulsory averaging of the signals from target and flankers [Parkes, L., Lund, J., Angelucci, A., Solomon, J. A., & Morgan, M. (2001). Compulsory averaging of crowded orientation signals in human vision. Nature Neuroscience, 4(7), 739-744]. On the other hand, a comparable search task with sparse stimuli is well modeled by a 'Signed-Max' rule that integrates non-linearly local tilt estimates [Baldassi, S., & Verghese, P. (2002). Comparing integration rules in visual search. Journal of Vision, 2(8), 559-570], as reflected by the bimodality of the distributions of reported tilts in a magnitude matching task [Baldassi, S., Megna, N., & Burr, D. C. (2006). Visual clutter causes high-magnitude errors. PLoS Biology, 4(3), e56]. This study compares the two models in the context of crowding by using a magnitude matching task, to measure distributions of perceived target angles and a localization task, to probe the degree of access to local information. Response distributions were bimodal, implying uncertainty, only in the presence of abutting flankers. Localization of the target is relatively preserved but it quantitatively falls in between the predictions of the two models, possibly suggesting local averaging followed by a max operation. This challenges the notion of global averaging and suggests some conscious access to local orientation estimates.

Attention and the detection of masked radial frequency patterns: Data and model

A radial frequency (RF) stimulus is strongly masked by a second, surrounding RF stimulus that follows the first after a critical stimulus onset asynchrony (SOA) of around 100ms. We sought to determine whether a mask-dependent attentional cuing effect, like that found when detecting pattern-masked sinusoidal gratings, would be obtained with RF stimuli. Observers detected RF modulations in cued or miscued stimuli that were masked with a simultaneous (SIM) RF mask or a delayed (SUC) RF mask that followed it after 100ms. There were large cuing effects in the SUC condition and small cuing effects in the SIM condition, replicating previous findings. The data are well described by a model in which masks affect the informational persistence of stimuli and cues affect the rate at which stimulus information is transferred into visual short-term memory.

How does the purpose of inspection influence the potency of visual salience in scene perception?

Salience-map models have been taken to suggest that the locations of eye fixations are determined by the extent of the low-level discontinuities in an image. While such models have found some support, an increasing emphasis on the task viewers are performing implies that these models must combine with cognitive demands to describe how the eyes are guided efficiently. An experiment is reported in which eye movements to objects in photographs were examined while viewers performed a memory-encoding task or one of two search tasks. The objects depicted in the scenes had known salience ranks according to a popular model. Participants fixated higher-salience objects sooner and more often than lower-salience objects, but only when memorising scenes. This difference shows that salience-map models provide useful predictions even in complex scenes and late in viewing. However, salience had no effects when searching for a target defined by category or exemplar. The results suggest that salience maps are not used to guide the eyes in these tasks, that cognitive override by task demands can be total, and that modelling top-down search is important but may not be easily accomplished within a salience-map framework.

Real-world visual search is dominated by top-down guidance

How do bottom-up and top-down guidance signals combine to guide search behavior? Observers searched for a target either with or without a preview (top-down manipulation) or a color singleton (bottom-up manipulation) among the display objects. With a preview, reaction times were faster and more initial eye movements were guided to the target; the singleton failed to attract initial saccades under these conditions. Only in the absence of a preview did subjects preferentially fixate the color singleton. We conclude that the search for realistic objects is guided primarily by top-down control. Implications for saliency map models of visual search are discussed.

Two kinds of visual perspective taking

Visual perspective taking can be used to determine where objects are located relative toanother agent, or whether the agent can see a particular object. Four experiments indicated that different processes provide these different kinds of information. When participants were asked to report whether an object was to the left or to the right of another agent, response times (RTs) increased with increasing angular distance between the participant and the agent, suggesting that participants mentally transformed their perspective to align it with that of the agent. For visibility judgments, RTs were independent of the angle between the participant and the agent but increased with the distance between the agent and the object, suggesting that participants traced the agent's line of sight. Together, these data suggest that perspective taking encompasses at least two qualitatively different computational processes: one that updates the viewer's imagined perspective, and one that traces a line of sight.

Visual clutter causes high-magnitude errors

Perceptual decisions are often made in cluttered environments, where a target may be confounded with competing “distractor” stimuli. Although many studies and theoretical treatments have highlighted the effect of distractors on performance, it remains unclear how they affect thequality of perceptual decisions. Here we show that perceptual clutter leads not only to an increase in judgment errors, but also to an increase in perceived signal strength and decision confidence on erroneous trials. Observers reported simultaneously the direction and magnitude of the tilt of a target grating presented either alone, or together with vertical distractor stimuli. When presented in isolation, observers perceived isolated targets as only slightly tilted on error trials, and had little confidence in their decision. When the target was embedded in distractors, however, they perceived it to be strongly tilted on error trials, and had high confidence of their (erroneous) decisions. The results are well explained by assuming that the observers' internal representation of stimulus orientation arises from a nonlinear combination of the outputs of independent noise-perturbed front-end detectors. The implication that erroneous perceptual decisions in cluttered environments are made with high confidence has many potential practical consequences, and may be extendable to decision-making in general.

Visual targets imbedded in distractors lead not only to judgment errors, but also to higher confidence about erroneous decisions. The signed max model provides a plausible framework for explaining the disparity between perception and reality.

Eye movements: viewing the window of opportunity

When searching with our eyes, parallel programming of successive eye movements ensures that visual information arriving too late to alter the direction of one eye movement can still influence the direction of the next. Paradoxically, we can use random noise to probe the time period over which visual information influences where next to direct our gaze.