Background changes delay the perceptual availability of form information

Contrast and luminance adaptation alter neuronal coding and perception of stimulus orientation

Sensory systems face a barrage of stimulation that continually changes along multiple dimensions. These simultaneous changes create a formidable problem for the nervous system, as neurons must dynamically encode each stimulus dimension, despite changes in other dimensions. Here, we measured how neurons in visual cortex encode orientation following changes in luminance and contrast, which are critical for visual processing, but nuisance variables in the context of orientation coding. Using information theoretic analysis and population decoding approaches, we find that orientation discriminability is luminance and contrast dependent, changing over time due to firing rate adaptation. We also show that orientation discrimination in human observers changes during adaptation, in a manner consistent with the neuronal data. Our results suggest that adaptation does not maintain information rates per se, but instead acts to keep sensory systems operating within the limited dynamic range afforded by spiking activity, despite a wide range of possible inputs.

Sensory systems produce stable stimulus representations despite constant changes across multiple stimulus dimensions. Here, the authors reveal dynamic neural coding mechanisms by testing how coding of one dimension (orientation) changes with adaptations to other dimensions (luminance and contrast).

Macaque V1 representations in natural and reduced visual contexts: spatial and temporal properties and influence of saccadic eye movements

Vision in natural situations is different from the paradigms generally used to study vision in the laboratory. In natural vision, stimuli usually appear in a receptive field as the result of saccadic eye movements rather than suddenly flashing into view. The stimuli themselves are rich with meaningful and recognizable objects rather than simple abstract patterns. In this study we examined the sensitivity of neurons in macaque area V1 to saccades and to complex background contexts. Using a variety of visual conditions, we find that natural visual response patterns are unique. Compared with standard laboratory situations, in more natural vision V1 responses have longer latency, slower time course, delayed orientation selectivity, higher peak selectivity, and lower amplitude. Furthermore, the influences of saccades and background type (complex picture vs. uniform gray) interact to give a distinctive, and presumably more natural, response pattern. While in most of the experiments natural images were used as background, we find that similar synthetic unnatural background stimuli produce nearly identical responses (i.e., complexity matters more than "naturalness"). These findings have important implications for our understanding of vision in more natural situations. They suggest that with the saccades used to explore complex images, visual context ("surround effects") would have a far greater effect on perception than in standard experiments with stimuli flashed on a uniform background. Perceptual thresholds for contrast and orientation should also be significantly different in more natural situations.

A comparison of visuomotor cue integration strategies for object placement and prehension

Visual cue integration strategies are known to depend on cue reliability and how rapidly the visual system processes incoming information. We investigated whether these strategies also depend on differences in the information demands for different natural tasks. Using two common goal-oriented tasks, prehension and object placement, we determined whether monocular and binocular information influence estimates of three-dimensional (3D) orientation differently depending on task demands. Both tasks rely on accurate 3D orientation estimates, but 3D position is potentially more important for grasping. Subjects placed an object on or picked up a disc in a virtual environment. On some trials, the monocular cues (aspect ratio and texture compression) and binocular cues (e.g., binocular disparity) suggested slightly different 3D orientations for the disc; these conflicts either were present upon initial stimulus presentation or were introduced after movement initiation, which allowed us to quantify how information from the cues accumulated over time. We analyzed the time-varying orientations of subjects' fingers in the grasping task and those of the object in the object placement task to quantify how different visual cues influenced motor control. In the first experiment, different subjects performed each task, and those performing the grasping task relied on binocular information more when orienting their hands than those performing the object placement task. When subjects in the second experiment performed both tasks in interleaved sessions, binocular cues were still more influential during grasping than object placement, and the different cue integration strategies observed for each task in isolation were maintained. In both experiments, the temporal analyses showed that subjects processed binocular information faster than monocular information, but task demands did not affect the time course of cue processing. How one uses visual cues for motor control depends on the task being performed, although how quickly the information is processed appears to be task invariant.

Luminance-evoked inhibition in primary visual cortex: a transient veto of simultaneous and ongoing response

Large-scale changes in luminance are known to exert a significant suppressive or masking effect on visual perception, but the neural substrate for this effect remains unclear. In this report, we describe the results of experiments using in vivo intracellular recording to explore the impact of luminance transients on the responses of orientation-selective neurons in layer 2/3 of tree shrew primary visual cortex. By measuring changes in excitatory and inhibitory conductances, we find that instantaneous changes in luminance evoke strong cortical inhibition. When combined with visual stimuli that would otherwise yield strong excitatory responses, luminance transients produce significant reductions in excitation as well as increases in inhibition. As a result, luminance transients significantly delay the emergence of orientation tuned cortical responses, and virtually eliminate ongoing responses to effective stimuli. We conclude that cortical inhibition is a critical factor in luminance-evoked cortical suppression and the likely substrate for luminance-induced visual masking phenomenon.

Lightness, filling-in, and the fundamental role of context in visual perception

Visual perception is defined by the unique spatial interactions that distinguish it from the point-to-point precision of a photometer. Over several decades, Lothar Spillmann has made key observations about the nature of these interactions and the role of context in perception. Our lab has explored the perceptual properties of spatial interactions and more generally the importance of visual context for neuronal responses and perception. Our investigations into the spatiotemporal dynamics of lightness provide insight into underlying mechanisms. For example, backward masking and luminance modulation experiments suggest that the representation of a uniformly luminous object develops first at the borders and, in some manner, the center fills in. The temporal dynamics of lightness induction are also consistent with a filling-in process. There is a slow cutoff temporal frequency above which surround luminance modulation will not elicit perceptual induction of a central area. The larger the central area, the lower the cutoff frequency for induction, perhaps indicating that an edge-based process requires more time to "complete" the larger area. In recordings from primary visual cortex we find that neurons respond in a manner surprisingly consistent with lightness perception and the spatial and temporal properties of induction. For example, the activity of V1 neurons can be modulated by light outside the receptive field and as the modulation rate is increased response modulation falls off more rapidly for large uniform areas than smaller areas. The conclusion we draw from these experiments is that lightness appears to be computed slowly on the basis of edge and context information. A possible role for the spatial interactions is lightness constancy, which is thought to depend on extensive spatial integration. We find not only that V1 responses are strongly context dependent, but that this dependence makes V1 lightness constant on average. The dependence of constancy on surround interactions underscores the fundamental role that context plays in perception. In more recent studies, further support has been found for the importance of context in experiments using natural scene stimuli.

Vision: a brake on the speed of sight

We move our eyes more often than our heart beats. Our brain seems to cope effortlessly with the consequences of these rapid visual alterations, but a new study shows that similar scene changes in the absence of eye movements delay the speed of information processing. So are there costs in constantly shifting our focus of gaze?

Background changes delay the perceptual availability of form information

In natural visual situations, unlike most psychophysical experiments, when a new stimulus appears in a portion of the visual field, the surrounding background changes simultaneously. In recordings from macaque V1, we found that a visual stimulus presented simultaneously with a background change evokes a response that is qualitatively different from the response to the same stimulus flashed on a static background. With the changing background, information about stimulus orientation and contrast is significantly delayed compared with the static-background situation. Our physiological results make several predictions that we test in the present paper with human psychophysical experiments. In a backward masking paradigm, a bar stimulus was either flashed onto a static background or presented simultaneously with a change in background luminance or pattern. Subjects discriminated bar orientation or detected that the scene changed before the mask. To achieve an equivalent contrast threshold for orientation discrimination, a longer stimulus-mask onset asynchrony (SOA) was needed in the changing than in the static-background condition; to match the orientation discrimination performance in the static and changing-background conditions at a fixed SOA, a higher bar contrast was needed when the background changed. Moreover, in the changing-background condition, a longer SOA was needed to discriminate bar orientation than to detect the scene change. These results suggest that orientation information is available more slowly when the background changes; orientation information is available earlier as stimulus contrast increases. The psychophysical findings are consistent with our physiological predictions. Compared with the common technique of flashing stimuli onto a static background, the changing-background paradigm may be more similar to natural vision in which saccades bring new stimuli and backgrounds into the visual field.