Two mechanisms underlie processing of stochastic motion stimuli

The efficiency of second order orientation coherence detection

Neurons in early visual cortex respond to both luminance- (1st order) and contrast-modulated (2nd order) local features in the visual field. In later extra-striate areas neurons with larger receptive fields integrate information across the visual field. For example, local luminance-defined features can be integrated into contours and shapes. Evidence for the global integration of features defined by contrast-modulation is less well established. While good performance in some shape tasks has been demonstrated with 2nd order stimuli, the integration of contours fails with 2nd order elements. Recently we developed a global orientation coherence task that is more basic than contour integration, bearing similarity to the well-established global motion coherence task. Similar to our previous 1st order result for this task, we find 2nd order coherence detection to be scale-invariant. There was a small but significant threshold elevation for 2nd order relative to 1st order. We used a noise masking approach to compare the efficiency of orientation integration for the 1st and 2nd order. We find a significant deficit for 2nd order detection at both the local and global level, however the small size of this effect stands in stark contrast against previous results from contour-integration experiments, which are almost impossible with 2nd order stimuli.

The amblyopic deficit for global motion is spatial scale invariant

Humans with amblyopia display anomalous performance for global motion discrimination. Attempts have been made to rule out an explanation based solely on the visibility loss in lower visual areas. However, it remains a possibility that the altered scale over which local motion is processed in V1 might lead to reduced efficiency of global motion processing in extra-striate cortex. We use stimuli composed of spatial frequency bandpass elements, equated for visibility, to show that the global motion deficit in amblyopia for both fellow and amblyopic eyes is still present once impairments in low-level processing have been factored out. This residual deficit appears to be spatial scale invariant and the relative deficit between the eyes shows a dependence on stimulus speed. We believe that this rules out an explanation of the amblyopic global motion deficit based solely on local motion input. We suggest instead that, in addition to low-level deficits, motion processing in a broadband, extra-striate, global motion mechanism is impaired in amblyopia.

Binocular influences on global motion processing in the human visual system

This study investigates four key issues concerning the binocular properties of the mechanisms that encode global motion in human vision: (1) the extent of any binocular advantage; (2) the possible site of this binocular summation; (3) whether or not purely monocular inputs exist for global motion perception; (4) the extent of any dichoptic interaction. Global motion coherence thresholds were measured using random-dot-kinematograms as a function of the dot modulation depth (contrast) for translational, radial and circular flow fields. We found a marked binocular advantage of approximately 1.7, comparable for all three types of motion and the performance benefit was due to a contrast rather than a global motion enhancement. In addition, we found no evidence for any purely monocular influences on global motion detection. The results suggest that the site of binocular combination for global motion perception occurs prior to the extra-striate cortex where motion integration occurs. All cells involved are binocular and exhibit dichoptic interactions, suggesting the existence of a neural mechanism that involves more than just simple summation of the two monocular inputs.

S-cone contributions to linear and non-linear motion processing

We investigated the characteristics of mechanisms mediating motion discrimination of S-cone isolating stimuli and found a double dissociation between the effects of luminance noise, which masks linear but not non-linear motion, and chromatic noise, which masks non-linear but not linear motion. We conclude that S-cones contribute to motion via two different pathways: a non-linear motion mechanism via a chromatic pathway and a linear motion mechanism via a luminance pathway. Additionally, motion discrimination and detection thresholds for drifting, S-cone isolating Gabors are unaffected by luminance noise, indicating that grating motion is mediated via chromatic mechanisms and based on higher-order motion processing.

No effect of spatial phase randomisation on direction discrimination in dense random element patterns

Two computational strategies have been proposed for motion analysis in the human visual system. Energy-based schemes involve detection of spatiotemporal Fourier energy in the frequency components comprising a moving pattern. Edge-based schemes track shifts in the position of local edges in the pattern over time. This paper describes a stimulus manipulation, spatial phase randomisation, that acts as a diagnostic test for the involvement of energy-based processes, and describes the results of two experiments which apply the manipulation to random element patterns. Both experiments compared direction discrimination performance in patterns before and after the spatial phase of their components was randomised in the Fourier domain. For dense patterns, there was no effect of phase randomisation on the maximum displacement supporting reliable direction discrimination, indicating that energy-based responses were dominant. For sparse patterns, a significant effect of phase randomisation was obtained, indicating a greater role for edge-based responses.

Investigating local network interactions underlying first- and second-order processing

We compared the spatial lateral interactions for first-order cues to those for second-order cues, and investigated spatial interactions between these two types of cues. We measured the apparent modulation depth of a target Gabor at fixation, in the presence and the absence of horizontally flanking Gabors. The Gabors' gratings were either added to (first-order) or multiplied with (second-order) binary 2-D noise. Apparent "contrast" or modulation depth (i.e., the perceived difference between the high and low luminance regions for the first-order stimulus, or between the high and low contrast regions for the second-order stimulus) was measured with a modulation depth-matching paradigm. For each observer, the first- and second-order Gabors were equated for apparent modulation depth without the flankers. Our results indicate that at the smallest inter-element spacing, the perceived reduction in modulation depth is significantly smaller for the second-order than for the first-order stimuli. Further, lateral interactions operate over shorter distances and the spatial frequency and orientation tuning of the suppression effect are broader for second- than first-order stimuli. Finally, first- and second-order information interact in an asymmetrical fashion; second-order flankers do not reduce the apparent modulation depth of the first-order target, whilst first-order flankers reduce the apparent modulation depth of the second-order target.

Deficits to global motion processing in human amblyopia

We investigated global motion processing in a group of adult amblyopes using a method that allows us to factor out any influence of the known contrast sensitivity deficit. We show that there are independent global motion processing deficits in human amblyopia that are unrelated to the contrast sensitivity deficit, and that are more extensive for contrast-defined than for luminance-defined stimuli. We speculate that the site of these deficits must include the extra-striate cortex and in particular the dorsal pathway.

Motion detection and the coincidence of structure at high and low spatial frequencies

We used filtered random dot kinematograms and natural images to examine how motion detection depends the relative locations of structures defined at low and high spatial frequencies. The upper displacement limit of motion (D(max)), the lower displacement limit (D(min)) and motion coherence thresholds were unaffected by the degree of spatial coincidence between high and low spatial frequency structures i.e. whether they were consistent or inconsistent with a single feature. However motion detection was possible between band-pass filtered random dot patterns whose peak frequencies were separated by up to 4 octaves. The first result implicates spatial frequency selective motion detectors that operate independently. The second result implicates a motion system that can integrate the displacements of edges defined by widely separated spatial frequencies. Both are required to account for the two results, and they appear to operate under very similar conditions.

Comparison of the spatial-frequency selectivity of local and global motion detectors

Convergent physiological and behavioral evidence indicates that the initial receptive fields responsible for motion detection are spatially localized. Consequently, the perception of global patterns of movement (such as expansion) requires that the output of these local mechanisms be integrated across visual space. We have differentiated local and global motion processes, with mixtures of coherent and incoherent moving patterns composed of bandpass filtered dots, and have measured their spatial-frequency selectivity. We report that local motion detectors show narrow-band spatial-frequency tuning (i.e., they respond only to a narrow range of spatial frequencies) but that global motion detectors show broadband spatial-frequency tuning (i.e., they integrate across a broad range of spatial frequencies), with a preference for low spatial frequencies.

Processing of second-order stimuli in the visual cortex

Naturally occurring visual stimuli are rich in examples of objects delineated from their backgrounds simply by differences in luminance, so-called first-order stimuli, as well as those defined by differences of contrast or texture, referred to as second-order stimuli. Here we provide a brief overview of visual cortical processing of second-order stimuli, as well as some comparative background on first-order processing, concentrating on single-unit neurophysiology, but also discussing relationships to human psychophysics and to neuroimaging. The selectivity of visual cortical neurons to orientation, spatial frequency, and direction of movement of first-order, luminance-defined stimuli is conventionally understood in terms of simple linear filter models, albeit with some minor nonlinearities such as thresholding and gain control. However, these kinds of models fail entirely to account for responses of neurons to second-order stimuli such as contrast envelopes, illusory contours, or texture borders. Second-order stimuli constructed from sinusoidal components have been used to analyze the neurophysiological mechanisms of such responses; these experiments demonstrate that the same neuron can exhibit three distinct kinds of tuning to spatial frequency, and also to orientation. These results can be understood in terms of a type of nonlinear 'filter-->rectify-->filter' model, which has been widely used in human psychophysics. Finally, several general issues will be discussed, including potential artifacts in experiments with second-order stimuli, and strategies for avoiding or controlling for them; caveats about definitions of first- vs. second-order mechanisms and stimuli; the concept of form-cue invariance; and the functional significance of second-order processing.

Centrifugal bias for second-order but not first-order motion

Limited-lifetime Gabor stimuli were used to assess both first- and second-order motion in peripheral vision. Both first- and second-order motion mechanisms were present at a 20-deg eccentricity. Second-order motion, unlike first-order, exhibits a bias for centrifugal motion, suggesting a role for the second-order mechanism in optic flow processing.

Global motion integration in the cat's lateral posterior-pulvinar complex

Our laboratory previously showed that thalamic neurons in an extrageniculate nucleus, the lateral posterior-pulvinar complex (LP-pulvinar) could perform higher-order neuronal operations that had until then only been attributed to higher-level cortical areas. To further assess the role of the thalamus in the analysis of complex percepts, we have investigated whether neurons in the LP-pulvinar complex can signal the direction of motion of random-dot kinematograms wherein the individual elements of the pattern do not provide coherent motion cues. Our results indicate that a subset of LP-pulvinar cells can integrate the displacement of individual elements into a global motion percept and that their large receptive fields permit the integration of motion for elements separated by large spatial intervals. We also found that almost all of the global motion-sensitive neurons were not systematically pattern-motion-selective when tested with plaid patterns. The results indicate that LP-pulvinar cells can perform the higher-level spatio-temporal integration required to detect the global displacement of objects in a complex visual scene, further supporting the notion that extrageniculate thalamic cells are involved in higher-order motion processing. Furthermore, these results provide some evidence that there may be specialized mechanisms for processing different types of complex motion within the LP-pulvinar complex.

The properties of the motion-detecting mechanisms mediating perceived direction in stochastic displays

Previous studies [e.g. Baker & Hess, 1998. Vision Research, 38, 1211-1222] have shown that perceived direction in displays composed of multiple, limited-lifetime, Gabor micropatterns (G) is influenced by movement both at the fine spatial scale of the internal luminance modulation (first-order motion) and the coarse spatial scale of the Gaussian, contrast window (second-order motion). However it is presently indeterminate as to whether this pattern of results is indicative of the processes by which first-order and second-order motion signals interact within the visual system per se or those by which motion information, irrespective of how it is defined, is utilised across different spatial scales. To address this issue, and more generally the properties of the mechanisms that analyse motion in such displays, we employed stochastic motion sequences composed of either G, G added to a static carrier (G + C) or G multiplied with a carrier (G*C). Crucially G*C, unlike both G and G + C, micropatterns contain no net first-order motion and second-order motion only at the scale of the internal contrast modulation. For small displacements perceived direction in all cases showed a dependence on the internal sinusoidal spatial structure of the micropatterns and characteristic oscillations were typically observed, consistent with models in which first-order motion and second-order motion are encoded on the basis of similar low-level mechanisms. Importantly for larger displacements, and also when the internal spatial structure was randomised on successive exposures (so that motion at this spatial scale was unreliable), performance tended to be veridical for all types of micropattern, even though under these conditions displacements of the G*C micropatterns should have been invisible to current, low-level, motion-detecting schemes. This suggests that both low-level motion sensors and mechanisms utilising a different motion-detecting strategy such as high-level, attentive, feature-tracking may mediate perceptual judgements in stochastic displays.

Motion perception over long interstimulus intervals

Recent studies using moving arrays of textured micropatterns have suggested that motion perception can be supported by two mechanisms, one quasilinear and sensitive to the motion of luminance-defined local texture, the other nonlinear and coding motion of contrast-defined envelopes of texture (Baker & Hess, 1998; Boulton & Baker, 1993b). Here we used similar patterns to study motion perception under conditions previously shown to isolate the nonlinear mechanism (low micropattern densities and positive interstimulus intervals [ISIs]. We measured direction discrimination for two-flash apparent motion over a much larger range of ISIs, and susceptibility to masking by incoherently moving "distractor" micropatterns. The results suggest that two nonlinear mechanisms can support motion perception under these conditions. One operates only for relatively short ISIs (less than c. 100 msec), is sensitive to small spatial displacements, and is relatively insensitive to distractor masking. The other operates over much longer ISIs, is insensitive to small spatial displacements, and is highly disrupted by distractor masking. These results are in line with previous studies suggesting that three mechanisms support motion perception.

Comparison of motion and stereopsis: linear and nonlinear performance

To address the issue of whether the luminance-dependent (linear) and contrast-dependent (nonlinear) processes in stereo and motion have a common computational basis, we compare both carrier-dependent and envelope-dependent performance for these two modalities by using the same stimulus and task: two-flash apparent motion/depth for a wide range of displacements. We do this for different densities, bandwidths, contrasts, spatial frequencies, and exposure durations. The results suggest that there is concordance not only between the luminance-dependent (linear) processes of motion and stereo but also between the envelope-dependent (nonlinear) processes of both modalities. Only one exception was found, but we show this to be amenable to an explanation based on a different contrast dependence for the nonlinear mechanisms of stereo and motion. This suggests that the computational basis of linear and nonlinear processes may be similar for stereopsis and motion.