Perceived visual speed constrained by image segmentation

Perceived group size is determined by the centroids of the component elements

To accomplish the deceptively simple task of perceiving the size of objects in the visual scene, the visual system combines information about the retinal size of the object with several other cues, including perceived distance, relative size, and prior knowledge. When local component elements are perceptually grouped to form objects, the task is further complicated because a grouped object does not have a continuous contour from which retinal size can be estimated. Here, we investigate how the visual system solves this problem and makes it possible for observers to judge the size of perceptually grouped objects. We systematically vary the shape and orientation of the component elements in a two-alternative forced-choice task and find that the perceived size of the array of component objects can be almost perfectly predicted from the distance between the centroids of the component elements and the center of the array. This is true whether the global contour forms a circle or a square. When elements were positioned such that the centroids along the global contour were at different distances from the center, perceived size was based on the average distance. These results indicate that perceived size does not depend on the size of individual elements, and that smooth contours formed by the outer edges of the component elements are not used to estimate size. The current study adds to a growing literature highlighting the importance of centroids in visual perception and may have implications for how size is estimated for ensembles of different objects.

Contrast versus identity encoding in the face image follow distinct orientation selectivity profiles

Orientation selectivity is a fundamental property of primary visual encoding. High-level processing stages also show some form of orientation dependence, with face identification preferentially relying on horizontally-oriented information. How high-level orientation tuning emerges from primary orientation biases is unclear. In the same group of participants, we derived the orientation selectivity profile at primary and high-level visual processing stages using a contrast detection and an identity matching task. To capture the orientation selectivity profile, we calculated the difference in performance between all tested orientations (0, 45, 90, and 135°) for each task and for upright and inverted faces, separately. Primary orientation selectivity was characterized by higher sensitivity to oblique as compared to cardinal orientations. The orientation profile of face identification showed superior horizontal sensitivity to face identity. In each task, performance with upright and inverted faces projected onto qualitatively similar a priori models of orientation selectivity. Yet the fact that the orientation selectivity profiles of contrast detection in upright and inverted faces correlated significantly while such correlation was absent for identification indicates a progressive dissociation of orientation selectivity profiles from primary to high-level stages of orientation encoding. Bayesian analyses further indicate a lack of correlation between the orientation selectivity profiles in the contrast detection and face identification tasks, for upright and inverted faces. From these findings, we conclude that orientation selectivity shows distinct profiles at primary and high-level stages of face processing and that a transformation must occur from general cardinal attenuation when processing basic properties of the face image to horizontal tuning when encoding more complex properties such as identity.

Motion perception in central field loss

Motion information is essential in daily life because it provides cues to depth, timing, object identification, and self-motion, as well as input to the oculomotor system. As the peripheral visual field is exquisitely sensitive to motion, we investigated the periphery of individuals with central visual field loss (CFL) to determine whether speed and direction discrimination are intact in this population. We compared CFL participants' (N = 8), older (N = 6), and young controls' (N = 6) ability to discriminate motion speed and direction in a two-spatial-alternative forced-choice design. Participants viewed moving dots on the left and right of a fixation marker and judged which side had the faster speed or more clockwise direction. For the young control group, we repeated the experiment with the stimulus limited to thin strips of fixed width at eccentricities of 5°, 10°, and 15°. There was no significant difference in mean speed or direction discrimination thresholds of CFL participants and older controls for either velocity. Young controls had significantly lower thresholds than the CFL group for both tasks. We did not find an effect of visual acuity, viewing eccentricity, or scotoma location on individuals' ability to discriminate speed or direction. Our results indicate that for high-visibility stimuli moving at 5°-10°/s, speed and direction discrimination are intact in the periphery of individuals with CFL.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.

Suppressive mechanisms in visual motion processing: From perception to intelligence

Perception operates on an immense amount of incoming information that greatly exceeds the brain's processing capacity. Because of this fundamental limitation, the ability to suppress irrelevant information is a key determinant of perceptual efficiency. Here, I will review a series of studies investigating suppressive mechanisms in visual motion processing, namely perceptual suppression of large, background-like motions. These spatial suppression mechanisms are adaptive, operating only when sensory inputs are sufficiently robust to guarantee visibility. Converging correlational and causal evidence links these behavioral results with inhibitory center-surround mechanisms, namely those in cortical area MT. Spatial suppression is abnormally weak in several special populations, including the elderly and individuals with schizophrenia-a deficit that is evidenced by better-than-normal direction discriminations of large moving stimuli. Theoretical work shows that this abnormal weakening of spatial suppression should result in motion segregation deficits, but direct behavioral support of this hypothesis is lacking. Finally, I will argue that the ability to suppress information is a fundamental neural process that applies not only to perception but also to cognition in general. Supporting this argument, I will discuss recent research that shows individual differences in spatial suppression of motion signals strongly predict individual variations in IQ scores.

Unconscious local motion alters global image speed

Accurate motion perception of self and object speed is crucial for successful interaction in the world. The context in which we make such speed judgments has a profound effect on their accuracy. Misperceptions of motion speed caused by the context can have drastic consequences in real world situations, but they also reveal much about the underlying mechanisms of motion perception. Here we show that motion signals suppressed from awareness can warp simultaneous conscious speed perception. In Experiment 1, we measured global speed discrimination thresholds using an annulus of 8 local Gabor elements. We show that physically removing local elements from the array attenuated global speed discrimination. However, removing awareness of the local elements only had a small effect on speed discrimination. That is, unconscious local motion elements contributed to global conscious speed perception. In Experiment 2 we measured the global speed of the moving Gabor patterns, when half the elements moved at different speeds. We show that global speed averaging occurred regardless of whether local elements were removed from awareness, such that the speed of invisible elements continued to be averaged together with the visible elements to determine the global speed. These data suggest that contextual motion signals outside of awareness can both boost and affect our experience of motion speed, and suggest that such pooling of motion signals occurs before the conscious extraction of the surround motion speed.

The global slowdown effect: why does perceptual grouping reduce perceived speed?

The percept of four rotating dot pairs is bistable. The "local percept" is of four pairs of dots rotating independently. The "global percept" is of two large squares translating over one another (Anstis & Kim 2011). We have previously demonstrated (Kohler, Caplovitz, & Tse 2009) that the global percept appears to move more slowly than the local percept. Here, we investigate and rule out several hypotheses for why this may be the case. First, we demonstrate that the global slowdown effect does not occur because the global percept is of larger objects than the local percept. Second, we show that the global slowdown effect is not related to rotation-specific detectors that may be more active in the local than in the global percept. Third, we find that the effect is also not due to a reduction of image elements during grouping and can occur with a stimulus very different from the one used previously. This suggests that the effect may reflect a general property of perceptual grouping. Having ruled out these possibilities, we suggest that the global slowdown effect may arise from emergent motion signals that are generated by the moving dots, which are interpreted as the ends of "barbell bars" in the local percept or the corners of the illusory squares in the global percept. Alternatively, the effect could be the result of noisy sources of motion information that arise from perceptual grouping that, in turn, increase the influence of Bayesian priors toward slow motion (Weiss, Simoncelli, & Adelson 2002).

Attentional-Tracking Acuity Is Modulated by Illusory Changes in Perceived Speed

Many activities, such as driving or playing sports, require simultaneous monitoring of multiple, often moving, objects. Such situations tap people’s ability to attend selected objects without tracking them with their eyes—this is known as attentional tracking. It has been established that attentional tracking can be affected by the physical speed of a moving target. In the experiments reported here, we showed that this effect is primarily due to apparent speeds, as opposed to physical speeds. We used sensory adaptation—in this case, prolonged exposure to adapting stimuli moving faster or slower than standard test stimuli—to modulate perceived speed. We found performance decrements and increments for apparently sped and slowed test stimuli when participants attempted attentional tracking. Our data suggest that both perceived speed and the acuity of attention for moving objects reflect a ratio of responses in low-pass and band-pass temporal-frequency channels in human vision.

Opposite modulation of high- and low-level visual aftereffects by perceptual grouping

A fundamental task of visual perception is to group visual features - sometimes spatially separated and partially occluded - into coherent, unified representations of objects. Perceptual grouping can vastly simplify the description of a visual scene and is critical for our visual system to understand the three-dimensional visual world. Numerous neurophysiological and brain imaging studies have demonstrated that neural mechanisms of perceptual grouping are characterized by the enhancement of neural responses throughout the visual processing hierarchy, from lower visual areas processing grouped features to higher visual areas representing objects and shapes from grouping. In a series of psychophysical adaptation experiments, we made the counterintuitive observation that perceptual grouping amplified the shape aftereffect but meanwhile, reduced the tilt aftereffect and the threshold elevation aftereffect (TEAE). Furthermore, the modulation of perceptual grouping on the TEAE showed a partial interocular transfer. This finding suggests a 2-fold effect of perceptual grouping - enhancing the high-level shape representation and attenuating the low-level feature representation even at a monocular level. We propose that this effect is a functional manifestation of a predictive coding scheme and reflects an efficient code of visual information across lower and higher visual cortical areas.

Extrastriate cortical activity reflects segmentation of motion into independent sources

Identical local image motion signals can arise from countless object motions in the world. In order to resolve this ambiguity, the visual system must somehow integrate motion signals arising from different locations along an object's contour. Difficulties arise, however, because image contours can derive from multiple objects and from occlusion. Thus, correctly integrating respective objects' motion signals presupposes the specification of what counts as an object. Depending on how this form analysis problem is solved, dramatically different object motion percepts can be constructed from the same set of local image motions. Here we apply fMRI to investigate the mechanisms underlying the segmentation and integration of motion signals that are critical to motion perception in general. We hold the number of image objects constant, but vary whether these objects are perceived to move independently or not. We find that BOLD signal in V3v, V4v, V3A, V3B and MT varies with the number of distinct sources of motion information in the visual scene. These data support the hypothesis that these areas integrate form and motion information in order to segment motion into independent sources (i.e. objects) thereby overcoming ambiguities that arise at the earliest stages of motion processing.

Decoding of coherent but not incoherent motion signals in early dorsal visual cortex

When several scattered grating elements are arranged in such a way that their directions of motion are consistent with a common path, observers perceive them as belonging to a globally coherent moving object. Here we investigated how this coherence changes the representation of motion signals in human visual cortex using functional magnetic resonance imaging (fMRI) and multivariate voxel pattern decoding, which have the potential to reveal how well a stimulus is encoded in different contexts. Only during globally coherent motion was it possible to reliably distinguish fMRI signals evoked by different directions of motion in early visual cortex. This effect was specific to the retinotopic representation of the visual field quadrant in V1 traversed by the coherent element path and could not simply be attributed to a general increase in signal strength. Decoding was more reliable for cortical areas corresponding to the lower visual field. Because some previous studies observed poorer speed discrimination when motion was grouped, we also conducted behavioural experiments to investigate this with our stimuli, but did not reveal a consistent relationship between coherence and perceived speed. Taken together, these data show that neuronal populations in early visual cortex represent information that could be used for interpreting motion signals as unified objects.

Feature integration across space, time, and orientation

The perception of a visual target can be strongly influenced by flanking stimuli. In static displays, performance on the target improves when the distance to the flanking elements increases-presumably because feature pooling and integration vanishes with distance. Here, we studied feature integration with dynamic stimuli. We show that features of single elements presented within a continuous motion stream are integrated largely independent of spatial distance (and orientation). Hence, space-based models of feature integration cannot be extended to dynamic stimuli. We suggest that feature integration is guided by perceptual grouping operations that maintain the identity of perceptual objects over space and time.

Peeling plaids apart: context counteracts cross-orientation contrast masking

Background

Contrast discrimination for an image is usually harder if another image is superimposed on top. We asked whether such contrast masking may be enhanced or relieved depending on cues promoting integration of both images as a single pattern, versus segmentation into two independent components.

Methodology & Principal Findings

Contrast discrimination thresholds for a foveal test grating were sharply elevated in the presence of a perfectly overlapping orthogonally-oriented mask grating. However thresholds returned to the unmasked baseline when a surround grating was added, having the same orientation and phase of either the test or mask grating. Both such masking and ‘unmasking’ effects were much stronger for moving than static stimuli.

Conclusions & Significance

Our results suggest that common-fate motion reinforces the perception of a single coherent plaid pattern, while the surround helps to identify each component independently, thus peeling the plaid apart again. These results challenge current models of early vision, suggesting that higher-level surface organization influences contrast encoding, determining whether the contrast of a grating may be recovered independently from that of its mask.

The effect of spatial layout on motion segmentation

We present a series of experiments exploring the effect of the stimulus spatial configuration on speed discrimination and two different types of segmentation, for random dot patterns. In the first experiment, we find that parsing the image produces a decrease of speed discrimination thresholds such as was first shown by Verghese and Stone [Verghese, P., & Stone, L. (1997). Spatial layout affects speed discrimination threshold. Vision Research, 37(4), 397-406; Verghese, P., & Stone, L. S. (1996). Perceived visual speed constrained by image segmentation. Nature, 381, 161-163] for sinusoidal gratings. In the second experiment, we study how the spatial configuration affects the ability of a subject in localizing an illusory contour defined by two surfaces with different speeds. Results show that the speed difference necessary to localize the contour decreases as the stimulus patches are separated. The third experiment involves transparency. Our results show a little or null effect for this condition. We explain the first and second experiment in the framework of the model of Bravo and Watamaniuk [Bravo, M., & Watamaniuk, S. (1995). Evidence for two speed signals: a coarse local signal for segregation and a precise global signal for discrimination. Vision Research, 35(12), 1691-1697] who proposed that motion computation consists in, at least, two stages: a first computation of coarse local speeds followed by an integration stage. We propose that the more precise estimate of speed obtained from the integration stage is used to produce a new refined segmentation of the image perhaps, through a feedback loop. Our data suggest that this third stage would not apply to the processing of transparency.

Resolution of complex motion detectors in the central and peripheral visual field

We examine how local direction signals are combined to compute the focus of radial motion (FRM) in random dot patterns and examine how this process changes across the visual field. Equivalent noise analysis showed that a loss in FRM accuracy was largely attributable to an increase in local motion detector noise with little or no change in efficiency across the visual field. The minimum separation for discriminating the foci of two overlapping optic flow patterns increased in the periphery faster than predicted from the resolution for a single FRM. This behavior requires that observers average numerous local velocities to estimate the FRM, which enables resistance to internal and external noise and endows the system with the property of position invariance. However, such pooling limits the precision with which multiple looming objects can be discriminated, especially in the peripheral visual field.

Behavioral Receptive Field for Ocular Following in Humans: Dynamics of Spatial Summation and Center-Surround Interactions

Visual neurons integrate information over a finite part of the visual field with high selectivity. This classical receptive field is modulated by peripheral inputs that play a role in both neuronal response normalization and contextual modulations. However, the consequences of these properties for visuomotor transformations are yet incompletely understood. To explore those, we recorded short-latency ocular following responses in humans to large center-only and center-surround stimuli. We found that eye movements are triggered by a mechanism that integrates motion over a restricted portion of the visual field, the size of which depends on stimulus contrast and increases as a function of time after response onset. We also found evidence for a strong nonisodirectional center-surround organization, responsible for normalizing the central, driving input so that motor responses are set to their most linear contrast dynamics. Such response normalization is delayed about 20 ms relative to tracking onset, gradually builds up over time, and is partly tuned for surround orientation/direction. These results outline the spatiotemporal organization of a behavioral receptive field, which might reflect a linear integration among subpopulations of cortical visual motion detectors.

Motion grouping impairs speed discrimination

Discriminating between two speed signals is harder when they are seen as part of a single trajectory, compared to the case when they appear as distinct entities. Observers were asked to judge which half of a display had dots that were moving faster. This was done under two main conditions: when dot motion appeared to continue across the boundary between the two halves, and when it moved parallel to the boundary. Speed discrimination thresholds were elevated when motion in the two halves appeared to cross the boundary compared to the case when motion was parallel to the boundary. Extensive practice improved performance until speed discrimination in the two cases was virtually indistinguishable. The addition of noise caused the original effect to reappear, i.e., thresholds were elevated when motion continued across the border. Our results suggest that the local differences in velocity on either side of border are ignored when motion appears to cross the border. Instead the visual system seems to enforce an a priori assumption that when motion continues across a boundary it belongs to a common motion path.

Spatial interference among moving targets

Peripheral vision for static form is limited both by reduced spatial acuity and by interference among adjacent features ('crowding'). However, the visibility of acuity-corrected image motion is relatively constant across the visual field. We measured whether spatial interference among nearby moving elements is similarly invariant of retinal eccentricity and assessed if motion integration could account for any observed sensitivity loss. We report that sensitivity to the direction of motion of a central target-highly visible in isolation-was strongly impaired by four drifting flanking elements. The extent of spatial interference increased with eccentricity. Random-direction flanks and flanks whose directions formed global patterns of rotation or expansion were more disruptive than flanks forming global patterns of translation, regardless of the relative direction of the target element. Spatial interference was low-pass tuned for spatial frequency and broadly tuned for temporal frequency. We show that these results challenge the generality of models of spatial interference that are based on retinal image quality, masking, confusions between target and flanks, attentional resolution limits or (simple) "averaging" of element parameters. Instead, the results suggest that spatial interference is a consequence of the integration of meaningful image structure within large receptive fields. The underlying connectivity of this integration favours low spatial frequency structure but is broadly tuned for speed.

Synchrony and covariation of firing rates in the primary visual cortex during contour grouping

The visual system imposes structure onto incoming information, by grouping image elements of a single object together, and by segregating them from elements that belong to other objects and the background. One influential theory holds that the code for grouping and segmentation is carried by the synchrony of neuronal discharges on a millisecond time scale. We tested this theory by recording neuronal activity in the primary visual cortex (area V1) of monkeys engaged in a contour-grouping task. We found that synchrony was unrelated to contour grouping. The firing rates of V1 neurons are also correlated across trials. We demonstrate that this rate covariation is mainly determined by fluctuations in visual attention. Moreover, we show that rate covariation depends on perceptual grouping, as it is strongest between neurons that respond to features of the same object.

"Pop-out" of targets modulated in luminance or colour: the effect of intrinsic and extrinsic uncertainty

Targets defined by attributes such as colour or brightness are said to "pop-out" from a cluttered scene, with little or no dependency on the size of the set to be searched, while search for other attributes can depend strongly on set-size. We measured contrast thresholds for increments and decrements in luminance or colour and show that they increase strongly with set-size (as previously observed for orientation). However, in some conditions, where the potential distractors were not salient visual targets, there was no dependency of set-size at all ("pop-out"). All the data can be modelled by assuming two main sources of uncertainty: the intrinsic uncertainty due to the number of detectors monitored during a specific task and the extrinsic uncertainty introduced by increasing the number of items displayed. The strength of the effect is well explained by a simple signal detection theory "signed-max" model suited for two-tailed tasks [Journal of Vision 2 (8), 559]. The results suggest that "pop-out" is not peculiar to luminance or colour, but may occur in conditions when the intrinsic uncertainty is so high as to saturate the effects of further uncertainty sources.

Psychophysical receptive fields of edge detection mechanisms

Theories of edge detection generally assume a front-end linear stage involving some population of neural filters. Here we study these early mechanisms using psychophysical techniques, and evaluate a number of models for edge detection. We measured psychophysical efficiency for detection of noisy luminance edge stimuli over a range of stimulus sizes and shapes. The data suggest a diversity in receptive field shape and orientation bandwidth, consistent with physiological evidence, but inconsistent with standard multi-channel models of visual processing.

Can spatial and temporal motion integration compensate for deficits in local motion mechanisms?

We studied the motion perception of a patient, AMG, who had a lesion in the left occipital lobe centered on visual areas V3 and V3A, with involvement of underlying white matter. As shown by a variety of psychophysical tests involving her perception of motion, the patient was impaired at motion discriminations that involved the detection of small displacements of random-dot displays, including local speed discrimination. However, she was unimpaired on tests that required spatial and temporal integration of moving displays, such as motion coherence. The results indicate that she had a specific impairment of the computation of local but not global motion and that she could not integrate motion information across different spatial scales. Such a specific impairment has not been reported before.

Perceptual consequences of centre-surround antagonism in visual motion processing

Centre-surround receptive field organization is a ubiquitous property in mammalian visual systems, presumably tailored for extracting image features that are differentially distributed over space. In visual motion, this is evident as antagonistic interactions between centre and surround regions of the receptive fields of many direction-selective neurons in visual cortex. In a series of psychophysical experiments we make the counterintuitive observation that increasing the size of a high-contrast moving pattern renders its direction of motion more difficult to perceive and reduces its effectiveness as an adaptation stimulus. We propose that this is a perceptual correlate of centre-surround antagonism, possibly within a population of neurons in the middle temporal visual area. The spatial antagonism of motion signals observed at high contrast gives way to spatial summation as contrast decreases. Evidently, integration of motion signals over space depends crucially on the visibility of those signals, thereby allowing the visual system to register motion information efficiently and adaptively.

Three-dimensional symmetric shapes are discriminated more efficiently than asymmetric ones

Objects with bilateral symmetry, such as faces, animal shapes, and many man-made objects, play an important role in everyday vision. Because they occur frequently, it is reasonable to conjecture that the brain may be specialized for symmetric objects. We investigated whether the human visual system processes three-dimensional (3D) symmetric objects more efficiently than asymmetric ones. Human subjects, having learned a symmetric wire object, discriminated which of two distorted copies of the learned object was more similar to the learned one. The distortion was achieved by adding 3D Gaussian positional perturbations at the vertices of the wire object. In the asymmetric condition, the perturbation was independent from one vertex to the next. In the symmetric condition, independent perturbations were added to only half of the object; perturbations on the other half retained the symmetry of the object. We found that subjects' thresholds were higher in the symmetric condition. However, since the perturbation in the symmetric condition was correlated, a stimulus image provided less information in the symmetric condition. Taking this in to consideration, an ideal-observer analysis revealed that subjects were actually more efficient at discriminating symmetric objects. This reversal in interpretation underscores the importance of ideal-observer analysis. A completely opposite, and wrong, conclusion would have been drawn from analyzing only human discrimination thresholds. Given the same amount of information, the visual system is actually better able to discriminate symmetric objects than asymmetric ones.

What constitutes an efficient reference frame for vision?

Vision requires a reference frame. To what extent does this reference frame depend on the structure of the visual input, rather than just on retinal landmarks? This question is particularly relevant to the perception of dynamic scenes, when keeping track of external motion relative to the retina is difficult. We tested human subjects' ability to discriminate the motion and temporal coherence of changing elements that were embedded in global patterns and whose perceptual organization was manipulated in a way that caused only minor changes to the retinal image. Coherence discriminations were always better when local elements were perceived to be organized as a global moving form than when they were perceived to be unorganized, individually moving entities. Our results indicate that perceived form influences the neural representation of its component features, and from this, we propose a new method for studying perceptual organization.

Comparison of the spatial-frequency selectivity of local and global motion detectors

Convergent physiological and behavioral evidence indicates that the initial receptive fields responsible for motion detection are spatially localized. Consequently, the perception of global patterns of movement (such as expansion) requires that the output of these local mechanisms be integrated across visual space. We have differentiated local and global motion processes, with mixtures of coherent and incoherent moving patterns composed of bandpass filtered dots, and have measured their spatial-frequency selectivity. We report that local motion detectors show narrow-band spatial-frequency tuning (i.e., they respond only to a narrow range of spatial frequencies) but that global motion detectors show broadband spatial-frequency tuning (i.e., they integrate across a broad range of spatial frequencies), with a preference for low spatial frequencies.

Spatial coherence does not affect contrast discrimination for multiple Gabor stimuli

Gestalt grouping rules imply a process or mechanism for grouping together local features of an object into a perceptual whole. Several psychophysical experiments have been interpreted as evidence for constrained interactions between nearby spatial filter elements and this has led to the hypothesis that element linking might be mediated by these interactions. A common tacit assumption is that these interactions result in response modulation which disturbs a local contrast code. We addressed this possibility by performing contrast discrimination experiments using two-dimensional arrays of multiple Gabor patches arranged either (i) vertically, (ii) in circles (coherent conditions), or (iii) randomly (incoherent condition), as well as for a single Gabor patch. In each condition, contrast increments were applied to either the entire test stimulus (experiment 1) or a single patch whose position was cued (experiment 2). In experiment 3, the texture stimuli were reduced to a single contour by displaying only the central vertical strip. Performance was better for the multiple-patch conditions than for the single-patch condition, but whether the multiple-patch stimulus was coherent or not had no systematic effect on the results in any of the experiments. We conclude that constrained local interactions do not interfere with a local contrast code for our suprathreshold stimuli, suggesting that, in general, this is not the way in which element linking is achieved. The possibility that interactions are involved in enhancing the detectability of contour elements at threshold remains unchallenged by our experiments.

Snakes and ladders: the role of temporal modulation in visual contour integration

We investigated temporal aspects of the cortical mechanisms supporting visual contour integration by measuring observers' efficiency at detecting fragmented contours, composed of Gabor micropatterns, embedded in a field of distractor elements. Gabors consisted of a static Gaussian enveloping a sinusoidal carrier which was temporally modulated by motion or counter-phase flicker. The elements forming the path could be oriented either parallel ('snakes') or perpendicular to the contour orientation ('ladders'). Sensitivity to contour structure (estimated by measuring the maximum tolerable element orientation jitter supporting contour detection) was increased when the elements were drifting or flickering. Snakes were more detectable than ladders under all conditions. The increase in sensitivity conferred by drifting carriers was present even when the elements in the same stimulus were drifting at a range of speeds spanning almost three octaves. These results lend further support to the notion that the contour integration system receives separate transient and sustained input.

Information limit on the spatial integration of local orientation signals

Channel-based models of human spatial vision require that the output of spatial filters be pooled across space. This pooling yields global estimates of local feature attributes such as orientation that are useful in situations in which that attribute may be locally variable, as is the case for visual texture. The spatial characteristics of orientation summation are considered in the study. By assessing the effect of orientation variability on observers' ability to estimate the mean orientation of spatially unstructured textures, one can determine both the internal noise on each orientation sample and the number of samples being pooled. By a combination of fixing and covarying the size of textured regions and the number of elements constituting them, one can then assess the effects of the texture's size, density, and numerosity (the number of elements present) on the internal noise and the sampling density. Results indicate that internal noise shows a primary dependence on texture density but that, counterintuitively, subjects rely on a sample size approximately equal to a fixed power of the number of samples present, regardless of their spatial arrangement. Orientation pooling is entirely flexible with respect to the position of input features.

Dissociable factors affect speed perception and discrimination

Factors affecting our judgement of the speed of visual motion were investigated. Two types of judgement were made: perceived speed relative to a standard comparison stimulus, and discrimination between the speeds of similar stimuli. The factors affect ng these two judgements were found to be doubly dissociable, suggesting that they may be constrained by processing at different levels of the visual hierarchy. The results are discussed in terms of the 3-D interpretation of visual image motion, and related to possible neural substrates.

Contrast integration across space

Contrast integration across space was studied in respect to stimulus extent and the spatial layout, using high-contrast stimuli. Contrast discrimination thresholds were measured (2AFC) by either increasing the size of a peripheral (2.4 degrees) Gabor signal (GS: lambda = 0.08 degree) or by increasing the number of GS elements in a circular arrangement. The supra-threshold mask (pedestal) was either increased with the target or fixed at maximal size and had 30% contrast. For stimuli with an increasing size of both the pedestal and the increment target, we find approximately constant discrimination thresholds. Contrast discrimination improved linearly on a log-log scale with slopes average of -1/4 (fourth-root summation) when the size of the Gabor target was increased but the mask was kept at maximal size, indicating contrast integration across space. Taken together, these results indicate balanced spatial integration of both contrast increment and pedestal, resulting object-size invariant contrast discrimination. Contrast discrimination was found to improve as well when the number of aligned Gabor elements was increased (both pedestal and increment), pointing to independent contrast normalization for disconnected (sparsely positioned) stimuli. The results indicate a complex pattern of spatial integration involved in contrast discrimination, possibly depending on image segmentation.

Enhanced motion aftereffect for complex motions

We measured the magnitude of the motion after effect (MAE) elicited by gratings viewed through four spatial apertures symmetrically positioned around fixation. The gratings were identical except for their orientations, which were varied to form patterns of global motion corresponding to radiation, rotation or translation. MAE magnitude was estimated by three methods: the duration of the MAE; the contrast required to null the MAE and the threshold elevation for detecting an abrupt jump. All three techniques showed that MAEs for radiation and rotation were greater than those for translation. The greater adaptability of radiation and rotation over translation also was observed in areas of the display where no adapting stimulus had been presented. We also found that adaptation to motion in one direction had equal effects on sensitivity to motion in the same and opposite directions.

The perception and discrimination of speed in complex motion

Random dot kinematograms were used to simulate radial, rotational and spiral optic flow. The stimuli were designed so that, while dot speed increased linearly with distance from the centre of the display, the density of dots remained uniform throughout their presentation. In two experiments, subjects were required to perform a temporal 2AFC speed discrimination task. Experiment 1 measured the perceived speed of a range of optic flow patterns against a rotational comparison stimulus. Radial motions were found to appear faster than rotations by approximately 10%, with a smaller but significant effect for spirals. Experiment 2 measured discrimination thresholds for pairs of similar optic flow stimuli identical in all respects except mean speed. No consistent differences were observed between the speed discrimination thresholds of radial, rotational and spiral motions and a control stimulus with the same speed profile in which motion followed fixed random trajectories. The perceived speed results are interpreted in terms of a model satisfying constraints on motion-in-depth and object rigidity, while speed discrimination appears to be based upon the pooled responses of elementary motion detectors.

A computational model of selective deficits in first and second-order motion processing

Recent neurological studies of selective impairments in first and second-order motion processing are of considerable relevance in elucidating the mechanisms of motion perception in normal human observers. We examine the stimuli which have been used to assess first and second-order motion processing capabilities in clinical subjects, and discuss the nature of the computations necessary to extract their motion. We find that a simple computational model of first and second-order motion processing is able to account for the data. The model consists of a first-order channel computing motion at coarse and fine scales, and a coarse scale second-order channel. The second-order channel is sensitive to motion information defined by variations in luminance, contrast, spatial frequency and flicker. When elements of the model are disabled, its performance on either first or second-order motion can be selectively impaired in line with the neurological data.

Effects of spatial configuration on contrast detection

We studied spatial integration at low contrasts by testing the detection thresholds of multi-Gabor element displays, examining configuration parameters such as orientation uniformity, contour smoothness, continuity, spacing and relative phase. We find that detectability depends on stimulus geometry and is constrained by collinearity and proximity spatial relationships. For textures, thresholds decrease with local orientation uniformity. For a 'coherent' contour (e.g. smooth and continuous), thresholds decrease linearly with increased number of elements, on a log-log scale, with a slope of -1/4 (sensitivity S proportional to N1/4). However, for a 'non-coherent' contour (e.g. jagged or with spacing > 5 lambda) thresholds are only slightly affected by the number of patches. Similar behavior is observed for supra-threshold stimuli embedded in band-pass noise. These results suggest that contrast integration is primarily based on local mechanisms and constrained by contour properties. These local mechanisms are possibly mediated by lateral interactions in the primary visual cortex.

Complex motion perception and its deficits

Within the hierarchy of motion perception, the dorsolateral middle superior temporal area (MSTd) is optimally suited for the analysis of the complex motion patterns that are directly useful for visually guided behaviour (e.g. computation of heading). Recent electrophysiological and psychophysical evidence suggests the existence of 'detectors' in MSTd that are specialised for complex motion patterns and advocates the necessity of combining retinal and extraretinal signals received by MSTd neurones for the accurate perception of heading. In some neurological patients, of which only a small number have been reported to date, lesions involving the human homologue of MST have devastating effects on their ability to navigate in their surroundings. It has been reported that these patients have impaired performance of psychophysical tasks of complex motion discrimination.

Psychophysical evidence for a functional hierarchy of motion processing mechanisms

Current models of motion perception typically describe mechanisms that operate locally to extract direction and speed information. To deal with the movement of self or objects with respect to the environment, higher-level receptive fields are presumably assembled from the outputs of such local analyzers. We find that the apparent speed of gratings viewed through four spatial apertures depends on the interaction of motion directions among the apertures, even when the motion within each aperture is identical except for direction. Specifically, local motion consistent with a global pattern of radial motion appears 32% faster than that consistent with translational or rotational motion. The enhancement of speed is not reflected in detection thresholds and persists in spite of instructions to fixate a single local aperture and ignore the global configuration. We also find that a two-dimensional pattern of motion is necessary to elicit the effect and that motion contrast alone does not produce the enhancement. These results implicate at least two serial stages of motion-information processing: a mechanism to code the local direction and speed of motion, followed by a global mechanism that integrates such signals to represent meaningful patterns of movement, depending on the configuration of the local motions.

Interaction of stereo vision and optic flow processing revealed by an illusory stimulus

The influence of stereoscopic vision on the perception of optic flow fields was investigated in experiments based on a recently described illusion. In this illusion, subjects perceive a shift of the center of an expanding optic flow field when it is transparently superimposed by a unidirectional motion pattern. This illusory shift can be explained by the visual system taking the presented flow pattern as a certain self-motion flow field. Here we examined the dependence of the illusory transformation on differences in depth between the two superimposed motion patterns. Presenting them with different relative binocular disparities, we found a strong variation in the magnitude of the illusory shift. Especially when translation was in front of expansion, a highly significant decrease of the illusory shift occurred, down to 25% of its magnitude at zero disparity. These findings confirm the assumption that the motion pattern is interpreted as a self-motion flow field. In a further experiment we presented monocular depth cues by changing dot size and dot density. This caused a reduction of the illusory shift which is distinctly smaller than under stereoscopic presentation. We conclude that the illusory optic flow transformation is modified by depth information, especially by binocular disparity. The findings are linked to the phenomenon of induced motion and are related to neurophysiology.

Switching attention without shifting the spotlight object-based attentional modulation of brain potentials

Although psychophysical evidence for object-based attention has been reported, corresponding studies with event-related potentials (ERPs) are scarce. Here subjects were presented with perceptual fields containing two superimposed objects (transparent surfaces generated by two sets of dots in rigid rotation around fixation, each set of a different color and direction of motion) or only one object (the same dots but either at rest or all rotating in the same direction). Brief (150-msec) rectilinear displacements affected either of the sets at random ISIs of 350 to 550 msec. Attention was directed to one set of dots, guided by color, in order to discriminate the direction of their displacement. Motion-onset ERPs elicited by these displacements were compared for attended and unattended dots. When the perceptual field consisted of two objects, strong suppression of P1 and N1 was obtained in the ERPs associated with the unattended object. No suppression was found with the field containing a single object, although an enhanced selection negativity was found in ERPs associated with attended dots (selected by color). Since the two objects occupied the same region of visual space, the suppression of P1/N1 cannot be explained by the space-based mechanisms but is consistent with object-based attentional selection at early stages of vision. The results highlight the role of perceptual organizations in enabling alternative attentional mechanisms.

Radial motion looks faster

Current models of motion perception depend on unidirectional motion-sensitive mechanisms that provide local inputs for complex pattern motion, such as optic flow. To test the generality of such models, we asked observers to compare the speed of radial gratings with the translational speed of vertical gratings. The speed of the radial gratings was consistently overestimated by 20-60% relative to that of translating gratings that were identical in all other respects. The speed bias was not associated with a general spatial or temporal processing bias, nor with the high relative speed of points about the center of expansion/contraction. The bias increased non-linearly with the size of sectors of the radiating pattern exposed. As the motion of the two patterns was locally identical but judged differently, the apparent speed of both kinds of motion cannot be served by any mechanism, nor described by any model, that is based entirely on local motion signals. We speculate that the greater apparent speed of the radial motion has to do with apparent motion in depth.

Computation of surface slant from optic flow: orthogonal components of speed gradient can be combined

In previous work [Meese et al. (1995). Vision Research, 35, 2879-2888)] we showed that one-dimensional (1D) speed gradients are sufficient to produce a compelling impression of surface slant. Summing a 1D vertical shearing gradient or, less intuitively, a 1D horizontal shearing gradient with a random field of horizontally translating dots produces perceived slant about a horizontal axis. Similarly, a 1D vertical or horizontal compression gradient produces perceived slant about a vertical axis. Appropriately combining orthogonal 1D shears or compressions produces a purely deforming flow pattern. Here we asked whether both the vertical and horizontal components in such a stimulus contribute to perceived slant. Using a matching technique we found that for surfaces inclined about a vertical axis, this was indeed the case and that horizontal and vertical compression gradients contributed roughly equally to perceived slant. Similarly, for surfaces inclined about a horizontal axis, both vertical and horizontal shearing gradients contributed to the perceived slant, though here the horizontal gradient was given less weight than the vertical. We conclude that under appropriate conditions, the human visual system combines orthogonal speed gradients prior to the computation of slant from retinal flow.

Spatial layout affects speed discrimination

We address a surprising result in a previous study of speed discrimination with multiple moving gratings: discrimination thresholds decreased when the number of stimuli was increased, but remained unchanged when the area of a single stimulus was increased [Verghese & Stone (1995). Vision Research, 35, 2811-2823]. In this study, we manipulated the spatial- and phase relationship between multiple grating patches to determine their effect on speed discrimination thresholds. In a fusion experiment, we merged multiple stimulus patches, in stages, into a single patch. Thresholds increased as the patches were brought closer and their phase relationship was adjusted to be consistent with a single patch. Thresholds increased further still as these patches were fused into a single patch. In a fission experiment, we divided a single large patch into multiple patches by superimposing a cross with luminance equal to that of the background. Thresholds decreased as the large patch was divided into quadrants and decreased further as the quadrants were maximally separated. However, when the cross luminance was darker than the background, it was perceived as an occluder and thresholds, on average, were unchanged from that for the single large patch. A control experiment shows that the observed trend in discrimination thresholds is not due to the differences in perceived speed of the stimuli. These results suggest that the parsing of the visual image into entities affects the combination of speed information across space, and that each discrete entity effectively provides a single independent estimate of speed.