Envelope-responsive neurons in areas 17 and 18 of cat

Influences of local and global context on local orientation perception

Visual context modulates perception of local orientation attributes. These spatially very localised effects are considered to correspond to specific excitatory-inhibitory connectivity patterns of early visual areas as V1, creating perceptual tilt repulsion and attraction effects. Here, orientation misperception of small Gabor stimuli was used as a probe of this computational structure by sampling a large spatio-orientation space to reveal expected asymmetries due to the underlying neuronal processing. Surprisingly, the results showed a regular iso-orientation pattern of nearby location effects whose reference point was globally modulated by the spatial structure, without any complex interactions between local positions and orientation. This pattern of results was confirmed by the two perceptual parameters of bias and discrimination ability. Furthermore, the response times to stimulus configuration displayed variations that further provided evidence of how multiple early visual stages affect perception of simple stimuli.

Macaque V1 responses to 2nd-order contrast-modulated stimuli and the possible subcortical and cortical contributions

Natural images comprise contours and boundaries defined by 1st-order luminance-modulated (LM) cues that are readily encoded by V1 neurons, and 2nd-order contrast-modulated (CM) cues that carry local, but not over-the-space, luminance changes. The neurophysiological foundations for CM processing remain unsolved. Here we used two-photon calcium imaging to demonstrate that V1 superficial-layer neurons respond to both LM and CM gratings in awake, fixating, macaques, with overall LM responses stronger than CM responses. Furthermore, adaptation experiments revealed that LM responses were similarly suppressed by LM and CM adaptation, with moderately larger effects by iso-orientation adaptation than by orthogonal adaptation, suggesting that LM and CM orientation responses likely share a strong orientation-non-selective subcortical origin. In contrast, CM responses were substantially more suppressed by iso-orientation than by orthogonal LM and CM adaptation, likely suggesting stronger orientation-specific intracortical influences for CM responses than for LM responses, besides shared orientation-non-selective subcortical influences. These results thus may indicate a subcortical-to-V1 filter-rectify-filter mechanism for CM processing: Local luminance changes in CM stimuli are initially encoded by orientation-non-selective subcortical neurons, and the outputs are half-wave rectified, and then summed by V1 neurons to signal CM orientation, which may be further substantially refined by intracortical influences.

Integration of contours defined by second-order contrast-modulation of texture

Boundaries in the visual world can be defined by changes in luminance and texture in the input image. A "contour integration" process joins together local changes into percepts of lines or edges. A previous study tested the integration of contours defined by second-order contrast-modulation. Their contours were placed in a background of random wavelets. Participants performed near chance. We re-visited second-order contour integration with a different task. Participants distinguished contours with "good continuation" from distractors. We measured thresholds in different amounts of external orientation or position noise. This gave two noise-masking functions. We also measured thresholds for contours with a baseline curvature to assess performance with more curvy targets. Our participants were able to discriminate the good continuation of second-order contours. Thresholds were higher than for first-order contours. In our modelling, we found this was due to multiple factors. There was a doubling of equivalent internal noise between first- and second-order contour integration. There was also a reduction in efficiency. The efficiency difference was only significant in our orientation noise condition. For both first- and second-order stimuli, participants were also able to perform our task with more curved contours. We conclude that humans can integrate second-order contours, even when they are curved. There is however reduced performance compared to first-order contours. We find both an impaired input to the integrating mechanism, and reduced efficiency seem responsible. Second-order contour integration may be more affected by the noise background used in the previous study. Difficulty segregating that background may explain their result.

Phase-Dependent Interactions in Visual Cortex to Combinations of First- and Second-Order Stimuli

A fundamental task of the visual system is to extract figure-ground boundaries between objects, which are often defined, not only by differences in luminance, but also by "second-order" contrast or texture differences. Responses of cortical neurons to both first- and second-order patterns have been studied extensively, but only for responses to either type of stimulus in isolation. Here, we examined responses of visual cortex neurons to the spatial relationship between superimposed periodic luminance modulation (LM) and contrast modulation (CM) stimuli, the contrasts of which were adjusted to give equated responses when presented alone. Extracellular single-unit recordings were made in area 18 of the cat, the neurons of which show responses to CM and LM stimuli very similar to those in primate area V2 (Li et al., 2014). Most neurons showed a significant dependence on the relative phase of the combined LM and CM patterns, with a clear overall optimal response when they were approximately phase aligned. The degree of this phase preference, and the contributions of suppressive and/or facilitatory interactions, varied considerably from one neuron to another. Such phase-dependent and phase-invariant responses were evident in both simple- and complex-type cells. These results place important constraints on any future model of the underlying neural circuitry for second-order responses. The diversity in the degree of phase dependence between LM and CM stimuli that we observed could help to disambiguate different kinds of boundaries in natural scenes.

SIGNIFICANCE STATEMENT

Many visual cortex neurons exhibit orientation-selective responses to boundaries defined by differences either in luminance or in texture contrast. Previous studies have examined responses to either type of boundary in isolation, but here we measured systematically responses of cortical neurons to the spatial relationship between superimposed periodic luminance-modulated (LM) and contrast-modulated (CM) stimuli with contrasts adjusted to give equated responses. We demonstrate that neuronal responses to these compound stimuli are highly dependent on the relative phase between the LM and CM components. Diversity in the degree of such phase dependence could help to disambiguate different kinds of boundaries in natural scenes, for example, those arising from surface reflectance changes or from illumination gradients such as shading or shadows.

Neural Processing of Second-Order Motion in the Suprasylvian Cortex of the Cat

Neuronal responses to second-order motion, that is, to spatiotemporal variations of texture or contrast, have been reported in several cortical areas of mammals, including the middle-temporal (MT) area in primates. In this study, we investigated whether second-order responses are present in the cat posteromedial lateral suprasylvian (PMLS) cortex, a possible homolog of the primate area MT. The stimuli used were luminance-based sine-wave gratings (first-order) and contrast-modulated carrier stimuli (second-order), which consisted of a high-spatial-frequency static grating (carrier) whose contrast was modulated by a low-spatial-frequency drifting grating (envelope). Results indicate that most PMLS neurons responded to second-order motion and for the vast majority of cells, first- and second-order preferred directions were conserved. However, responses to second-order stimuli were significantly reduced when compared to those evoked by first-order gratings. Circular variance was increased for second-order stimuli, indicating that PMLS direction selectivity was weaker for this type of stimulus. Finally, carrier orientation selectivity was either absent or very broad and had no influence on the envelope's orientation selectivity. In conclusion, our data show that PMLS neurons exhibit similar first- and second-order response profiles and that, akin primate area MT cells, they perform a form-cue invariant analysis of motion signals.

Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception

Visual processing along the primate ventral stream takes place in a hierarchy of areas, characterized by an increase in both complexity of neuronal preferences and invariance to changes of low-level stimulus attributes. A basic type of invariance is form-cue invariance, where neurons have similar preferences in response to first-order stimuli, defined by changes in luminance, and global features of second-order stimuli, defined by changes in texture or contrast. Whether in mice, a now popular model system for early visual processing, visual perception can be guided by second-order stimuli is currently unknown. Here, we probed mouse visual perception and neural responses in areas V1 and LM using various types of second-order, contrast-modulated gratings with static noise carriers. These gratings differ in their spatial frequency composition and thus in their ability to invoke first-order mechanisms exploiting local luminance features. We show that mice can transfer learning of a coarse orientation discrimination task involving first-order, luminance-modulated gratings to the contrast-modulated gratings, albeit with markedly reduced discrimination performance. Consistent with these behavioral results, we demonstrate that neurons in area V1 and LM are less responsive and less selective to contrast-modulated than to luminance-modulated gratings, but respond with broadly similar preferred orientations. We conclude that mice can, at least in a rudimentary form, use second-order stimuli to guide visual perception.

SIGNIFICANCE STATEMENT

To extract object boundaries in natural scenes, the primate visual system does not only rely on differences in local luminance but can also take into account differences in texture or contrast. Whether the mouse, which has a much simpler visual system, can use such second-order information to guide visual perception is unknown. Here we tested mouse perception of second-order, contrast-defined stimuli and measured their neural representations in two areas of visual cortex. We find that mice can use contrast-defined stimuli to guide visual perception, although behavioral performance and neural representations were less robust than for luminance-defined stimuli. These findings shed light on basic steps of feature extraction along the mouse visual cortical hierarchy, which may ultimately lead to object recognition.

Categorically distinct types of receptive fields in early visual cortex

In the visual cortex, distinct types of neurons have been identified based on cellular morphology, response to injected current, or expression of specific markers, but neurophysiological studies have revealed visual receptive field (RF) properties that appear to be on a continuum, with only two generally recognized classes: simple and complex. Most previous studies have characterized visual responses of neurons using stereotyped stimuli such as bars, gratings, or white noise and simple system identification approaches (e.g., reverse correlation). Here we estimate visual RF models of cortical neurons using visually rich natural image stimuli and regularized regression system identification methods and characterize their spatial tuning, temporal dynamics, spatiotemporal behavior, and spiking properties. We quantitatively demonstrate the existence of three functionally distinct categories of simple cells, distinguished by their degree of orientation selectivity (isotropic or oriented) and the nature of their output nonlinearity (expansive or compressive). In addition, these three types have differing average values of several other properties. Cells with nonoriented RFs tend to have smaller RFs, shorter response durations, no direction selectivity, and high reliability. Orientation-selective neurons with an expansive output nonlinearity have Gabor-like RFs, lower spontaneous activity and responsivity, and spiking responses with higher sparseness. Oriented RFs with a compressive nonlinearity are spatially nondescript and tend to show longer response latency. Our findings indicate multiple physiologically defined types of RFs beyond the simple/complex dichotomy, suggesting that cortical neurons may have more specialized functional roles rather than lying on a multidimensional continuum.

Encoding and estimation of first- and second-order binocular disparity in natural images

•

First- and second-order responses to natural binocular images are correlated.

•

Second-order mechanisms can improve the accuracy of disparity estimation.

•

Second-order mechanisms can extend the depth range of binocular stereopsis.

The first stage of processing of binocular information in the visual cortex is performed by mechanisms that are bandpass-tuned for spatial frequency and orientation. Psychophysical and physiological evidence have also demonstrated the existence of second-order mechanisms in binocular processing, which can encode disparities that are not directly accessible to first-order mechanisms. We compared the responses of first- and second-order binocular filters to natural images. We found that the responses of the second-order mechanisms are to some extent correlated with the responses of the first-order mechanisms, and that they can contribute to increasing both the accuracy, and depth range, of binocular stereopsis.

The efficiency of second order orientation coherence detection

Neurons in early visual cortex respond to both luminance- (1st order) and contrast-modulated (2nd order) local features in the visual field. In later extra-striate areas neurons with larger receptive fields integrate information across the visual field. For example, local luminance-defined features can be integrated into contours and shapes. Evidence for the global integration of features defined by contrast-modulation is less well established. While good performance in some shape tasks has been demonstrated with 2nd order stimuli, the integration of contours fails with 2nd order elements. Recently we developed a global orientation coherence task that is more basic than contour integration, bearing similarity to the well-established global motion coherence task. Similar to our previous 1st order result for this task, we find 2nd order coherence detection to be scale-invariant. There was a small but significant threshold elevation for 2nd order relative to 1st order. We used a noise masking approach to compare the efficiency of orientation integration for the 1st and 2nd order. We find a significant deficit for 2nd order detection at both the local and global level, however the small size of this effect stands in stark contrast against previous results from contour-integration experiments, which are almost impossible with 2nd order stimuli.

Processing deficits of motion of contrast-modulated gratings in anisometropic amblyopia

Several studies have indicated substantial processing deficits for static second-order stimuli in amblyopia. However, less is known about the perception of second-order moving gratings. To investigate this issue, we measured the contrast sensitivity for second-order (contrast-modulated) moving gratings in seven anisometropic amblyopes and ten normal controls. The measurements were performed with non-equated carriers and a series of equated carriers. For comparison, the sensitivity for first-order motion and static second-order stimuli was also measured. Most of the amblyopic eyes (AEs) showed reduced sensitivity for second-order moving gratings relative to their non-amblyopic eyes (NAEs) and the dominant eyes (CEs) of normal control subjects, even when the detectability of the noise carriers was carefully controlled, suggesting substantial processing deficits of motion of contrast-modulated gratings in anisometropic amblyopia. In contrast, the non-amblyopic eyes of the anisometropic amblyopes were relatively spared. As a group, NAEs showed statistically comparable performance to CEs. We also found that contrast sensitivity for static second-order stimuli was strongly impaired in AEs and part of the NAEs of anisometropic amblyopes, consistent with previous studies. In addition, some amblyopes showed impaired performance in perception of static second-order stimuli but not in that of second-order moving gratings. These results may suggest a dissociation between the processing of static and moving second-order gratings in anisometropic amblyopia.

Form-cue invariant second-order neuronal responses to contrast modulation in primate area V2

A fundamental task of the visual system is to extract figure-ground boundaries between images of objects, which in natural scenes are often defined not only by luminance differences but also by "second-order" contrast or texture differences. Responses to contrast modulation (CM) and other second-order stimuli have been extensively studied in human psychophysics, but the neuronal substrates of second-order responses in nonhuman primates remain poorly understood. In this study, we have recorded single neurons in area V2 of macaque monkeys, using both CM patterns as well as conventional luminance modulation (LM) gratings. CM stimuli were constructed from stationary sine wave grating carrier patterns, which were modulated by drifting envelope gratings of a lower spatial frequency. We found approximately one-third of visually responsive V2 neurons responded to CM stimuli with a pronounced selectivity to carrier spatial frequencies, and often orientations, that were clearly outside the neurons' passbands for LM gratings. These neurons were "form-cue invariant" in that their tuning to CM envelope spatial frequency and orientation was very similar to that for LM gratings. Neurons were tuned to carrier spatial frequencies that were typically 2-4 octaves higher than their optimal envelope spatial frequencies, similar to results from human psychophysics. These results are distinct from CM responses arising from surround suppression, but could be understood in terms of a filter-rectify-filter model. Such neurons could provide a functionally useful and explicit representation of segmentation boundaries as well as a plausible neural substrate for human perception of second-order boundaries.

Possible functions of contextual modulations and receptive field nonlinearities: pop-out and texture segmentation

When analyzing a visual image, the brain has to achieve several goals quickly. One crucial goal is to rapidly detect parts of the visual scene that might be behaviorally relevant, while another one is to segment the image into objects, to enable an internal representation of the world. Both of these processes can be driven by local variations in any of several image attributes such as luminance, color, and texture. Here, focusing on texture defined by local orientation, we propose that the two processes are mediated by separate mechanisms that function in parallel. More specifically, differences in orientation can cause an object to "pop out" and attract visual attention, if its orientation differs from that of the surrounding objects. Differences in orientation can also signal a boundary between objects and therefore provide useful information for image segmentation. We propose that contextual response modulations in primary visual cortex (V1) are responsible for orientation pop-out, while a different kind of receptive field nonlinearity in secondary visual cortex (V2) is responsible for orientation-based texture segmentation. We review a recent experiment that led us to put forward this hypothesis along with other research literature relevant to this notion.

Surround suppression supports second-order feature encoding by macaque V1 and V2 neurons

Single neurons in areas V1 and V2 of macaque visual cortex respond selectively to luminance-modulated stimuli. These responses are often influenced by context, for example when stimuli extend outside the classical receptive field (CRF). These contextual phenomena, observed in many sensory areas, reflect a fundamental cortical computation and may inform perception by signaling second-order visual features which are defined by spatial relationships of contrast, orientation and spatial frequency. In the anesthetized, paralyzed macaque, we measured single-unit responses to a drifting preferred sinusoidal grating; low spatial frequency sinusoidal contrast modulations were applied to the grating, creating contrast-modulated, second-order forms. Most neurons responded selectively to the orientation of the contrast modulation of the preferred grating and were therefore second-order orientation-selective. Second-order selectivity was created by the asymmetric spatial organization of the excitatory CRF and suppressive extraclassical surround. We modeled these receptive field subregions using spatial Gaussians, sensitive to the modulation of contrast (not luminance) of the preferred carrier grating, that summed linearly and were capable of recovering asymmetrical receptive field organizations. Our modeling suggests that second-order selectivity arises both from elongated excitatory CRFs, asymmetrically organized extraclassical surround suppression, or both. We validated the model by successfully testing its predictions against conventional surround suppression measurements and spike-triggered analysis of second-order form responses. Psychophysical adaptation measurements on human observers revealed a pattern of second-order form selectivity consistent with neural response patterns. We therefore propose that cortical cells in primates do double duty, providing signals about both first- and second-order forms.

Responses to orientation discontinuities in V1 and V2: physiological dissociations and functional implications

Segmenting the visual image into objects is a crucial stage of visual processing. Object boundaries are typically associated with differences in luminance, but discontinuities in texture also play an important role. We showed previously that a subpopulation of neurons in V2 in anesthetized macaques responds to orientation discontinuities parallel to their receptive field orientation. Such single-cell responses could be a neurophysiological correlate of texture boundary detection. Neurons in V1, on the other hand, are known to have contextual response modulations such as iso-orientation surround suppression, which also produce responses to orientation discontinuities. Here, we use pseudorandom multiregion grating stimuli of two frame durations (20 and 40 ms) to probe and compare texture boundary responses in V1 and V2 in anesthetized macaque monkeys. In V1, responses to texture boundaries were observed for only the 40 ms frame duration and were independent of the orientation of the texture boundary. However, in transient V2 neurons, responses to such texture boundaries were robust for both frame durations and were stronger for boundaries parallel to the neuron's preferred orientation. The dependence of these processes on stimulus duration and orientation indicates that responses to texture boundaries in V2 arise independently of contextual modulations in V1. In addition, because the responses in transient V2 neurons are sensitive to the orientation of the texture boundary but those of V1 neurons are not, we suggest that V2 responses are the correlate of texture boundary detection, whereas contextual modulation in V1 serves other purposes, possibly related to orientation "pop-out."

Statistics of the electrosensory input in the freely swimming weakly electric fish Apteronotus leptorhynchus

The neural computations underlying sensory-guided behaviors can best be understood in view of the sensory stimuli to be processed under natural conditions. This input is often actively shaped by the movements of the animal and its sensory receptors. Little is known about natural sensory scene statistics taking into account the concomitant movement of sensory receptors in freely moving animals. South American weakly electric fish use a self-generated quasi-sinusoidal electric field for electrolocation and electrocommunication. Thousands of cutaneous electroreceptors detect changes in the transdermal potential (TDP) as the fish interact with conspecifics and the environment. Despite substantial knowledge about the circuitry and physiology of the electrosensory system, the statistical properties of the electrosensory input evoked by natural swimming movements have never been measured directly. Using underwater wireless telemetry, we recorded the TDP of Apteronotus leptorhynchus as they swam freely by themselves and during interaction with a conspecific. Swimming movements caused low-frequency TDP amplitude modulations (AMs). Interacting with a conspecific caused additional AMs around the difference frequency of their electric fields, with the amplitude of the AMs (envelope) varying at low frequencies due to mutual movements. Both AMs and envelopes showed a power-law relationship with frequency, indicating spectral scale invariance. Combining a computational model of the electric field with video tracking of movements, we show that specific swimming patterns cause characteristic spatiotemporal sensory input correlations that contain information that may be used by the brain to guide behavior.

Luminance- and texture-defined information processing in school-aged children with autism

According to the complexity-specific hypothesis, the efficacy with which individuals with autism spectrum disorder (ASD) process visual information varies according to the extensiveness of the neural network required to process stimuli. Specifically, adults with ASD are less sensitive to texture-defined (or second-order) information, which necessitates the implication of several cortical visual areas. Conversely, the sensitivity to simple, luminance-defined (or first-order) information, which mainly relies on primary visual cortex (V1) activity, has been found to be either superior (static material) or intact (dynamic material) in ASD. It is currently unknown if these autistic perceptual alterations are present in childhood. In the present study, behavioural (threshold) and electrophysiological measures were obtained for static luminance- and texture-defined gratings presented to school-aged children with ASD and compared to those of typically developing children. Our behavioural and electrophysiological (P140) results indicate that luminance processing is likely unremarkable in autistic children. With respect to texture processing, there was no significant threshold difference between groups. However, unlike typical children, autistic children did not show reliable enhancements of brain activity (N230 and P340) in response to texture-defined gratings relative to luminance-defined gratings. This suggests reduced efficiency of neuro-integrative mechanisms operating at a perceptual level in autism. These results are in line with the idea that visual atypicalities mediated by intermediate-scale neural networks emerge before or during the school-age period in autism.

Binocular summation of second-order global motion signals in human vision

Although many studies have examined the principles governing first-order global motion perception, the mechanisms that mediate second-order global motion perception remain unresolved. This study investigated the existence, nature and extent of the binocular advantage for encoding second-order (contrast-defined) global motion. Motion coherence thresholds (79.4% correct) were assessed for determining the direction of radial, rotational and translational second-order motion trajectories as a function of local element modulation depth (contrast) under monocular and binocular viewing conditions. We found a binocular advantage for second-order global motion processing for all motion types. This advantage was mainly one of enhanced modulation sensitivity, rather than of motion-integration. However, compared to findings for first-order motion where the binocular advantage was in the region of a factor of around 1.7 (Hess et al., 2007), the binocular advantage for second-order global motion was marginal, being in the region of around 1.2. This weak enhancement in sensitivity with binocular viewing is considerably less than would be predicted by conventional models of either probability summation or neural summation.

Functional organization of envelope-responsive neurons in early visual cortex: organization of carrier tuning properties

It is well established that visual cortex neurons having similar selectivity for orientation, direction of motion, ocular dominance, and other properties of first-order (luminance-defined) stimuli are clustered into a columnar organization. However, the cortical architecture of neuronal responses to second-order (contrast/texture-defined) stimuli is poorly understood. A useful second-order stimulus is a contrast envelope, consisting of a finely detailed pattern (carrier) whose contrast varies on a coarse spatial scale (envelope). In this study, we analyzed the cortical organization of carrier tuning properties of neurons, which responded to contrast-modulated stimuli. We examined whether neurons tuned to similar carrier properties are clustered spatially and whether such spatial clusters are arranged in columns. To address these questions, we recorded single-unit activity, multiunit activity, and local field potentials simultaneously from area 18 of anesthetized cats, using single-channel microelectrodes and multielectrode arrays. Our data showed that neurons tuned to similar carrier spatial frequency are distributed in a highly clustered manner; neurons tuned to similar carrier orientation are also significantly clustered. Neurons along linear arrays perpendicular to the brain surface always exhibited similar optimal carrier spatial frequency, indicating a columnar organization. Multi-pronged tetrode recordings indicated that the diameter of these columns is ≥450 μm. Optimal carrier orientation was also significantly clustered but with finer-grain organization and greater scatter. These results indicate a fine anatomical structure of cortical organization of second-order information processing and suggest that there are probably more maps in cat area 18 than previously believed.

Motion-defined contour processing in the early visual cortex

From our daily experience, it is very clear that relative motion cues can contribute to correctly identifying object boundaries and perceiving depth. Motion-defined contours are not only generated by the motion of objects in a scene but also by the movement of an observer's head and body (motion parallax). However, the neural mechanism involved in detecting these contours is still unknown. To explore this mechanism, we extracellularly recorded visual responses of area 18 neurons in anesthetized and paralyzed cats. The goal of this study was to determine if motion-defined contours could be detected by neurons that have been previously shown to detect luminance-, texture-, and contrast-defined contours cue invariantly. Motion-defined contour stimuli were generated by modulating the velocity of high spatial frequency sinusoidal luminance gratings (carrier gratings) by a moving squarewave envelope. The carrier gratings were outside the luminance passband of a neuron, such that presence of the carrier alone within the receptive field did not elicit a response. Most neurons that responded to contrast-defined contours also responded to motion-defined contours. The orientation and direction selectivity of these neurons for motion-defined contours was similar to that of luminance gratings. A given neuron also exhibited similar selectivity for the spatial frequency of the carrier gratings of contrast- and motion-defined contours. These results suggest that different second-order contours are detected in a form-cue invariant manner, through a common neural mechanism in area 18.

Direction-selective patterns of activity in human visual cortex suggest common neural substrates for different types of motion

A sense of motion can be elicited by the movement of both luminance- and texture-defined patterns, what is commonly referred to as first- and second-order, respectively. Although there are differences in the perception of these two classes of motion stimuli, including differences in temporal and spatial sensitivity, it is debated whether common or separate direction-selective mechanisms are responsible for processing these two types of motion. Here, we measured direction-selective responses to luminance- and texture-defined motion in the human visual cortex by using functional MRI (fMRI) in conjunction with multivariate pattern analysis (MVPA). We found evidence of direction selectivity for both types of motion in all early visual areas (V1, V2, V3, V3A, V4, and MT+), implying that none of these early visual areas is specialized for processing a specific type of motion. More importantly, linear classifiers trained with cortical activity patterns to one type of motion (e.g., first-order motion) could reliably classify the direction of motion defined by the other type (e.g., second-order motion). Our results suggest that the direction-selective mechanisms that respond to these two types of motion share similar spatial distributions in the early visual cortex, consistent with the possibility that common mechanisms are responsible for processing both types of motion.

Neuronal responses to texture-defined form in macaque visual area V2

Human and macaque observers can detect and discriminate visual forms defined by differences in texture. The neurophysiological correlates of visual texture perception are not well understood and have not been studied extensively at the single-neuron level in the primate brain. We used a novel family of texture patterns to measure the selectivity of neurons in extrastriate cortical area V2 of the macaque (Macaca nemestrina, Macaca fascicularis) for the orientation of texture-defined form, and to distinguish responses to luminance- and texture-defined form. Most V2 cells were selective for the orientation of luminance-defined form; they signaled the orientation of the component gratings that made up the texture patterns but not the overall pattern orientation. In some cells, these luminance responses were modulated by the direction or orientation of the texture envelope, suggesting an interaction of luminance and texture signals. We found little evidence for a "cue-invariant" representation in monkey V2. Few cells showed selectivity for the orientation of texture-defined form; they signaled the orientation of the texture patterns and not that of the component gratings. Small datasets recorded in monkey V1 and cat area 18 showed qualitatively similar patterns of results. Consistent with human functional imaging studies, our findings suggest that signals related to texture-defined form in primate cortex are most salient in areas downstream of V2. V2 may still provide the foundation for texture perception, through the interaction of luminance- and texture-based signals.

Visual responses to contrast-defined contours with equally spatial-scaled carrier in cat area 18

Contrast-defined contours are one type of second-order contours, across which there are no differences in luminance. Although they can be always perceived, their responses have been only investigated when the spatial frequency of carrier, the background texture whose contrast is modulated to form contours, is much higher than that of contrast-defined contours, due to the interference of responses to luminance contours in other cases. In the present study, we examined visual responses in cat area 18 to the contrast-defined contours with carrier at same spatial frequency equal to neuron's preferred value for luminance contours, by establishing a control stimulus including all the luminance components but lack of the contrast contour information. Using single unit recording and intrinsic optical imaging, we demonstrated that contrast gratings with equally spatial-scaled carrier induced responses in a proportion of cat area 18 neurons with the preferred orientation similar to that for luminance contours, and the responses generated orientation maps similar to those for luminance contours. Our finding suggests that early visual cortex can process second-order contours regardless of the spatial frequency of carriers, in a way similar to the processing of luminance contours. This uniform manner of early visual processing might underlie the visual detection of both luminance contours and non-luminance second-order contours.

Development of sensitivity to visual texture modulation in macaque monkeys

In human and non-human primates, higher form vision matures substantially later than spatial acuity and contrast sensitivity, as revealed by performance on such tasks as figure-ground segregation and contour integration. Our goal was to understand whether delayed maturation on these tasks was intrinsically form-dependent or, rather, related to the nature of spatial integration necessary for extracting task-relevant cues. We used an intermediate-level form task that did not call for extensive spatial integration. We trained monkeys (6-201 weeks) to discriminate the orientation of pattern modulation in a two-alternative forced choice paradigm. We presented two families of form patterns, defined by texture or contrast variations, and luminance-defined patterns for comparison. Infant monkeys could discriminate texture- and contrast-defined form as early as 6 weeks; sensitivity improved up to 40 weeks. Surprisingly, sensitivity for texture- and contrast-defined form matured earlier than for luminance-defined form. These results suggest that intermediate-level form vision develops in concert with basic spatial vision rather than following sequentially. Comparison with earlier results reveals that different aspects of form vision develop over different time courses, with processes that depend on comparing local image content maturing earlier than those requiring "global" linking of multiple visual elements across a larger spatial extent.

Spatial summation of first-order and second-order motion in human vision

This study assessed spatial summation of first-order (luminance-defined) and second-order (contrast-defined) motion. Thresholds were measured for identifying the drift direction of 1c/deg., luminance-modulated and contrast-modulated dynamic noise drifting at temporal frequencies of 0.5, 2 and 8Hz. Image size varied from 0.125 degrees to 16 degrees . The effects of increasing image size on thresholds for luminance-modulated noise were also compared to those for luminance-defined gratings. In all cases, performance improved as image size increased. The rate at which performance improved with increasing image size was similar for all stimuli employed although the slopes corresponding to the initial improvement were steeper for first-order compared to second-order motion. The image sizes at which performance for first-order motion asymptote were larger than for second-order motion. In addition, findings showed that the minimum image size required to support reliable identification of the direction of moving stimuli is greater for second-order than first-order motion. Thus, although first-order and second-order motion processing have a number of properties in common, the visual system's sensitivity to each type of motion as a function of image size is quite different.

Subcortical representation of non-Fourier image features

A fundamental goal of visual neuroscience is to identify the neural pathways representing different image features. It is widely argued that the early stages of these pathways represent linear features of the visual scene and that the nonlinearities necessary to represent complex visual patterns are introduced later in cortex. We tested this by comparing the responses of subcortical and cortical neurons to interference patterns constructed by summing sinusoidal gratings. Although a linear mechanism can detect the component gratings, a nonlinear mechanism is required to detect an interference pattern resulting from their sum. Consistent with in vitro retinal ganglion cell recordings, we found that interference patterns are represented subcortically by cat LGN Y-cells, but not X-cells. Linear and nonlinear tuning properties of LGN Y-cells were then characterized and compared quantitatively with those of cortical area 18 neurons responsive to interference patterns. This comparison revealed a high degree of similarity between the two neural populations, including the following: (1) the representation of similar spatial frequencies in both their linear and nonlinear responses, (2) comparable orientation selectivity for the high spatial frequency carrier of interference patterns, and (3) the same difference in their temporal frequency selectivity for drifting gratings versus the envelope of interference patterns. The present findings demonstrate that the nonlinear subcortical Y-cell pathway represents complex visual patterns and likely underlies cortical responses to interference patterns. We suggest that linear and nonlinear mechanisms important for encoding visual scenes emerge in parallel through distinct pathways originating at the retina.

Visual Processing in Amblyopia: Human Studies

Within the last five years, there have been a number of exciting new advances in our knowledge and understanding of amblyopia. This article reviews recent psychophysical studies of naturally occurring amblyopia in humans. These studies suggest that: 1) There are significant differences in the patterns of visual loss among the clinically defined categories of amblyopes. A key factor in determining the nature of the loss is the presence or absence of binocularity. 2) Dysfunction within the amblyopic visual system first occurs in area V1, and the effects of amblyopia may be amplified downstream. 3) There appears to be substantial neural plasticity in the amblyopic brain beyond the "critical period."

Three-dimensional shape from second-order orientation flows

In images of textured surfaces, orientation flows formed by perspective convergence invariably convey 3D shape. We show that orientation flows formed by contrast-modulated (CM) and illusory contours (IC) convey 3D shape, and that both stimulus types induce 3D shape aftereffects on CM and IC test stimuli. Adaptation to luminance-modulated (LM) orientation flows induce robust 3D shape aftereffects on CM and IC tests, however, aftereffects using CM/IC adapting stimuli on LM tests were substantially weaker. These results can be explained by the adaptation of 3D shape-selective neurons that invariantly extract first- and second-order orientation flows from striate and extra-striate signals, which receive stronger input from neurons selective for first-order orientation flows.

Surround suppression of V1 neurons mediates orientation-based representation of high-order visual features

Neurons with surround suppression have been implicated in processing high-order visual features such as contrast- or texture-defined boundaries and subjective contours. However, little is known regarding how these neurons encode high-order visual information in a systematic manner as a population. To address this issue, we have measured detailed spatial structures of classical center and suppressive surround regions of receptive fields of primary visual cortex (V1) neurons and examined how a population of such neurons allow encoding of various high-order features and shapes in visual scenes. Using a novel method to reconstruct structures, we found that the center and surround regions are often both elongated parallel to each other, reminiscent of on and off subregions of simple cells without surround suppression. These structures allow V1 neurons to extract high-order contours of various orientations and spatial frequencies, with a variety of optimal values across neurons. The results show that a wide range of orientations and widths of the high-order features are systematically represented by the population of V1 neurons with surround suppression.

Models and Measurements of Functional Maps in V1

The organization of primary visual cortex has been heavily studied for nearly 50 years, and in the last 20 years functional imaging has provided high-resolution maps of its tangential organization. Recently, however, the usefulness of maps like those of orientation and spatial frequency (SF) preference has been called into question because they do not, by themselves, predict how moving images are represented in V1. In this review, we discuss a model for cortical responses (the spatiotemporal filtering model) that specifies the types of cortical maps needed to predict distributed activity within V1. We then review the structure and interrelationships of several of these maps, including those of orientation, SF, and temporal frequency preference. Finally, we discuss tests of the model and the sufficiency of the requisite maps in predicting distributed cortical responses. Although the spatiotemporal filtering model does not account for all responses within V1, it does, with reasonable accuracy, predict population responses to a variety of complex stimuli.

Eye Movements in Response to Dichoptic Motion: Evidence for a Parallel-Hierarchical Structure of Visual Motion Processing in Primates

Brief movements of a large-field visual stimulus elicit short-latency tracking eye movements termed “ocular following responses” (OFRs). To address the question of whether OFRs can be elicited by purely binocular motion signals in the absence of monocular motion cues, we measured OFRs from monkeys using dichoptic motion stimuli, the monocular inputs of which were flickering gratings in spatiotemporal quadrature, and compared them with OFRs to standard motion stimuli including monocular motion cues. Dichoptic motion did elicit OFRs, although with longer latencies and smaller amplitudes. In contrast to these findings, we observed that other types of motion stimuli categorized as non-first-order motion, which is undetectable by detectors for standard luminance-defined (first-order) motion, did not elicit OFRs, although they did evoke the sensation of motion. These results indicate that OFRs can be driven solely by cortical visual motion processing after binocular integration, which is distinct from the process incorporating non-first-order motion for elaborated motion perception. To explore the nature of dichoptic motion processing in terms of interaction with monocular motion processing, we further recorded OFRs from both humans and monkeys using our novel motion stimuli, the monocular and dichoptic motion signals of which move in opposite directions with a variable motion intensity ratio. We found that monocular and dichoptic motion signals are processed in parallel to elicit OFRs, rather than suppressing each other in a winner-take-all fashion, and the results were consistent across the species.

Contour discontinuities subserve two types of form analysis that underlie motion processing

Form analysis subserves motion processing in at least two ways: first, in terms of figural segmentation dedicated to solving the problem of figure-to-figure matching over time, and second, in terms of defining trackable features whose unambiguous motion signals can be generalized to ambiguously moving portions of an object. The former is a primarily ventral process involving the lateral occipital complex and also retinotopic areas such as V2 and V4, and the latter is a dorsal process involving V3A. Contour discontinuities, such as corners, deep concavities, maxima of positive curvature, junctions, and terminators, play a central role in both types of form analysis. Transformational apparent motion will be discussed in the context of figural segmentation and matching, and rotational motion in the context of trackable features. In both cases the analysis of form must proceed in parallel with the analysis of motion, in order to constrain the ongoing analysis of motion.

Processing of first-order motion in marmoset visual cortex is influenced by second-order motion

We measured the responses of single neurons in marmoset visual cortex (V1, V2, and the third visual complex) to moving first-order stimuli and to combined first- and second-order stimuli in order to determine whether first-order motion processing was influenced by second-order motion. Beat stimuli were made by summing two gratings of similar spatial frequency, one of which was static and the other was moving. The beat is the product of a moving sinusoidal carrier (first-order motion) and a moving low-frequency contrast envelope (second-order motion). We compared responses to moving first-order gratings alone with responses to beat patterns with first-order and second-order motion in the same direction as each other, or in opposite directions to each other in order to distinguish first-order and second-order direction-selective responses. In the majority (72%, 67/93) of cells (V1 73%, 45/62; V2 70%, 16/23; third visual complex 75%, 6/8), responses to first-order motion were significantly influenced by the addition of a second-order signal. The second-order envelope was more influential when moving in the opposite direction to the first-order stimulus, reducing first-order direction sensitivity in V1, V2, and the third visual complex. We interpret these results as showing that first-order motion processing through early visual cortex is not separate from second-order motion processing; suggesting that both motion signals are processed by the same system.

Receptive field properties of neurons in the early visual cortex revealed by local spectral reverse correlation

We introduce a novel class of white-noise analyses, named local spectral reverse correlation (LSRC), which is capable of revealing various aspects of visual receptive field profiles that were undetectable previously in a single simple measurement. The method is based on spectral analyses in a two-dimensional spatial frequency domain for spatially localized areas within and around their receptive fields. Extracellular single-unit recordings were performed for area 17 and 18 neurons in anesthetized cats. A dynamic dense noise pattern was presented in which the pattern covered an area two to three times larger than the classical receptive field. Spike trains were then cross-correlated with frequency spectra of localized noise pattern to obtain spatially localized selectivity maps in the two-dimensional frequency domain. Our findings are as follows. (1) The new LSRC method allows measurements of two-dimensional frequency tunings and their spatial extent even for cells with substantial nonlinearity. (2) A small subset of neurons shows spatial inhomogeneity in the two-dimensional frequency tunings. (3) In addition to facilitatory response profiles, we can also visualize suppressive profiles localized both in space and spatial frequency domains. Our results suggest that the new analysis technique can be a powerful tool for measuring visual response profiles that contain inhomogeneity in space, as well as for studying neurons with substantial nonlinearities. These features make the method particularly suitable for studying response profiles of neurons in early as well as intermediate extrastriate visual areas.

Orientation-selective adaptation to first- and second-order patterns in human visual cortex

Second-order textures-patterns that cannot be detected by mechanisms sensitive only to luminance changes-are ubiquitous in visual scenes, but the neuronal mechanisms mediating perception of such stimuli are not well understood. We used an adaptation protocol to measure neural activity in the human brain selective for the orientation of second-order textures. Functional MRI (fMRI) responses were measured in three subjects to presentations of first- and second-order probe gratings after adapting to a high-contrast first- or second-order grating that was either parallel or orthogonal to the probe gratings. First-order (LM) stimuli were generated by modulating the stimulus luminance. Second-order stimuli were generated by modulating the contrast (CM) or orientation (OM) of a first-order carrier. We used four combinations of adapter and probe stimuli: LM:LM, CM:CM, OM:OM, and LM:OM. The fourth condition tested for cross-modal adaptation with first-order adapter and second-order probe stimuli. Attention was diverted from the stimulus by a demanding task at fixation. Both first- and second-order stimuli elicited orientation-selective adaptation in multiple cortical visual areas, including V1, V2, V3, V3A/B, a newly identified visual area anterior to dorsal V3 that we have termed LO1, hV4, and VO1. For first-order stimuli (condition LM:LM), the adaptation was no larger in extrastriate areas than in V1, implying that the orientation-selective first-order (luminance) adaptation originated in V1. For second-order stimuli (conditions CM:CM and OM:OM), the magnitude of adaptation, relative to the absolute response magnitude, was significantly larger in VO1 (and for condition CM:CM, also in V3A/B and LO1) than in V1, suggesting that second-order stimulus orientation was extracted by additional processing after V1. There was little difference in the amplitude of adaptation between the second-order conditions. No consistent effect of adaptation was found in the cross-modal condition LM:OM, in agreement with psychophysical evidence for weak interactions between first- and second-order stimuli and computational models of separate mechanisms for first- and second-order visual processing.

Spatial interactions reveal inhibitory cortical networks in human amblyopia

Humans with amblyopia have a well-documented loss of sensitivity for first-order, or luminance defined, visual information. Recent studies show that they also display a specific loss of sensitivity for second-order, or contrast defined, visual information; a type of image structure encoded by neurons found predominantly in visual area A18/V2. In the present study, we investigate whether amblyopia disrupts the normal architecture of spatial interactions in V2 by determining the contrast detection threshold of a second-order target in the presence of second-order flanking stimuli. Adjacent flanks facilitated second-order detectability in normal observers. However, in marked contrast, they suppressed detection in each eye of the majority of amblyopic observers. Furthermore, strabismic observers with no loss of visual acuity show a similar pattern of detection suppression. We speculate that amblyopia results in predominantly inhibitory cortical interactions between second-order neurons.

Second-order spatial summation in amblyopia

Amblyopes show bilateral loss of sensitivity for second-order (contrast defined) stimuli that can be further suppressed by flanking second-order stimuli (whereas flanks facilitate sensitivity in normal observers). The suppressive flank effect in amblyopes might be explained by abnormal pooling of second-order contrast across visual space. In this study, we investigate whether amblyopes show abnormal second-order spatial summation by measuring contrast detection thresholds for 1c/deg modulations of random noise (stimuli 1-12 cycles) in amblyopic observers, strabismic observers with no visual acuity loss, and normal (control) observers. Non-control observers showed substantial bilateral loss of sensitivity relative to the control observers, as expected. However, all observers showed essentially equal second-order spatial summation: contrast detection threshold decreased with approximately the square root of the number of cycles, and then became independent of size at 6-8 cycles (similar asymptotes). We conclude that the pooling of second-order contrast across visual space is unaffected by amblyopia.

Is the direction of second-order, contrast-defined motion patterns visible to standard motion-energy detectors: a model answer?

Previous psychophysical studies (e.g., Smith & Ledgeway, 1997) have provided evidence that under some conditions, the detection of a particular class of stimuli (contrast-modulated static noise) widely employed to study second-order motion processing may be inadvertently based on encoding local imbalances in luminance motion energy. In particular when static noise composed of relatively large noise elements is used, direction-identification performance at threshold may actually be mediated by the same mechanisms that respond to first-order motion, due to the presence of persistent spatial clusters of noise elements of the same polarity. However, Benton and Johnson (1997) modeled the responses of conventional motion-energy detectors to contrast-modulated static noise patterns and found no evidence of any systematic directional biases in such stimuli when the mean opponent motion energy was used to quantify performance. In the present paper we sought to resolve this discrepancy and show that the precise manner in which computational models are implemented is crucial in determining their response to contrast-modulated, second-order motion patterns. In particular we demonstrate that by considering the information encapsulated by the peak (rather than the mean) opponent motion energy and the predominantly local nature of imbalances in motion energy that can arise in contrast-modulated static noise, it is possible to readily model the patterns of empirical results found.

The direction-selective contrast response of area 18 neurons is different for first- and second-order motion

Cortical neurons selective for the direction of motion often exhibit some limited response to motion in their nonpreferred directions. Here we examine the dependence of neuronal direction selectivity on stimulus contrast, both for first-order (luminance-modulated, sine-wave grating) and second-order (contrast-modulated envelope) stimuli. We measured responses from single neurons in area 18 of cat visual cortex to both kinds of moving stimuli over a wide range of contrasts (1.25-80%). Direction-selective contrast response functions (CRFs) were calculated as the preferred-minus-null difference in average firing frequency as a function of contrast. We also applied receiver operating characteristic analysis to our CRF data to obtain neurometric functions characterizing the potential ability of each neuron to discriminate motion direction at each contrast level tested. CRFs for sine-wave gratings were usually monotonic; however, a substantial minority of neurons (35%) exhibited nonmonotonic CRFs (such that the degree of direction selectivity decreased with increasing contrast). The underlying preferred and nonpreferred direction CRFs were diverse, often having different shapes in a given neuron. Neurometric functions for direction discrimination showed a similar degree of heterogeneity, including instances of nonmonotonicity. For contrast-modulated stimuli, however, CRFs for either carrier or envelope contrast were always monotonic. In a given neuron, neurometric thresholds were typically much higher for second- than for first-order stimuli. These results demonstrate that the degree of a cell's direction selectivity depends on the contrast at which it is measured, and therefore is not a characteristic parameter of a neuron. In general, contrast response functions for first-order stimuli were very heterogeneous in shape and sensitivity, while those for second-order stimuli showed less sensitivity and were quite stereotyped in shape.

“Crowding” in normal and amblyopic vision assessed with Gaussian and Gabor C’s

The purpose of this study was to investigate the extent and specificity of crowding in the normal fovea and periphery, and the central field of amblyopes, using "C"-like patterns. In the first experiment we measured the extent of crowding for C-patterns comprised of Gaussian patches, over a range of target sizes using a four-alternative forced-choice (up, down, left, right) method. We found that the extent of foveal crowding is proportional to target size. In contrast, in normal periphery and in the central field of amblyopes, crowding extends over large spatial distances and is not size dependent. Crowding for our stimuli occurred with both same-polarity and opposite polarity patches. To test whether the extended crowding in amblyopia resulted from a shift in the spatial scale of analysis, we measured crowding with band-limited C-patterns (comprised of Gabor patches) in a gap localization task (2-AFC). With band-limited stimuli, and a task that does not involve judging the orientation of the gap, the amblyopic eyes showed crowding over a longer distance than that of normal observers. We also tested the orientation specificity of crowding by varying the orientation of the flanks. In normal fovea, crowding is orientation specific: in amblyopia it is not. While crowding in normal fovea can be explained by simple pattern masking, crowding seen in normal periphery and amblyopes cannot. Instead we suggest that crowding in amblyopic and peripheral vision is a result of extended pooling at a stage following the stage of feature detection.

Spatial frequency selective masking of first-order and second-order motion in the absence of off-frequency 'looking'

Converging evidence suggests that, at least initially, first-order (luminance defined) and second-order (e.g. contrast defined) motion are processed independently in human vision. However, adaptation studies suggest that second-order motion, like first-order motion, may be encoded by spatial frequency selective mechanisms each operating over a limited range of scales. Nonetheless, the precise properties of these mechanisms are indeterminate since the spatial frequency selectivity of adaptation aftereffects may not necessarily represent the frequency tuning of the underlying units [Vision Research 37 (1997) 2685]. To address this issue we used visual masking to investigate the spatial-frequency tuning of the mechanisms that encode motion. A dual-masking paradigm was employed to derive estimates of the spatial tuning of motion sensors, in the absence of off-frequency 'looking'. Modulation-depth thresholds for identifying the direction of a sinusoidal test pattern were measured over a 4-octave range (0.125-2 c/deg) in both the absence and presence of two counterphasing masks, simultaneously positioned above and below the test frequency. For second-order motion, the resulting masking functions were spatially bandpass in character and remained relatively invariant with changes in test spatial frequency, masking pattern modulation depth and the temporal properties of the noise carrier. As expected, bandpass spatial frequency tuning was also found for first-order motion. This provides compelling evidence that the mechanisms responsible for encoding each variety of motion exhibit spatial frequency selectivity. Thus, although first-order and second-order motion may be encoded independently, they must utilise similar computational principles.

Contour integration and cortical processing

Our understanding of visual processing in general, and contour integration in particular, has undergone great change over the last 10 years. There is now an accumulation of psychophysical and neurophysiological evidence that the outputs of cells with conjoint orientation preference and spatial position are integrated in the process of explication of rudimentary contours. Recent neuroanatomical and neurophysiological results suggest that this process takes place at the cortical level V1. The code for contour integration may be a temporal one in that it may only manifest itself in the latter part of the spike train as a result of feedback and lateral interactions. Here we review some of the properties of contour integration from a psychophysical perspective and we speculate on their underlying neurophysiological substrate.

Pulling the other one: 1st- and 2nd-order visual information interact to determine perceived location

We demonstrate that the 1st- and 2nd-order characteristics of a visual stimulus can have a profound influence on each other in terms of perceived position. We use the parameter of spatial separation to selectively manipulate the effect of one characteristic upon the other. 1st-order features have their largest effect upon the perceived position of 2nd-order structure when separation is small, whilst the reciprocal effect is maximal at large separations. Implications for models of 1st- and 2nd-order interaction are discussed.

Neuroimaging of direction-selective mechanisms for second-order motion

Psychophysical findings have revealed a functional segregation of processing for 1st-order motion (movement of luminance modulation) and 2nd-order motion (e.g., movement of contrast modulation). However neural correlates of this psychophysical distinction remain controversial. To test for a corresponding anatomical segregation, we conducted a new functional magnetic resonance imaging (fMRI) study to localize direction-selective cortical mechanisms for 1st- and 2nd-order motion stimuli, by measuring direction-contingent response changes induced by motion adaptation, with deliberate control of attention. The 2nd-order motion stimulus generated direction-selective adaptation in a wide range of visual cortical areas, including areas V1, V2, V3, VP, V3A, V4v, and MT+. Moreover, the pattern of activity was similar to that obtained with 1st-order motion stimuli. Contrary to expectations from psychophysics, these results suggest that in the human visual cortex, the direction of 2nd-order motion is represented as early as V1. In addition, we found no obvious anatomical segregation in the neural substrates for 1st- and 2nd-order motion processing that can be resolved using standard fMRI.

Deficits to global motion processing in human amblyopia

We investigated global motion processing in a group of adult amblyopes using a method that allows us to factor out any influence of the known contrast sensitivity deficit. We show that there are independent global motion processing deficits in human amblyopia that are unrelated to the contrast sensitivity deficit, and that are more extensive for contrast-defined than for luminance-defined stimuli. We speculate that the site of these deficits must include the extra-striate cortex and in particular the dorsal pathway.