Evolving concepts of spatial channels in vision: from independence to nonlinear interactions

Illusory optical defocus generated by shaded surface texture

The human visual system is tasked with the problem of extracting information about the world from images that contain a conflated mixture of environmental sources and optical artifacts generated by the focal properties of our eyes. In most contexts, our brains manage to distinguish these sources, but this is not always the case. Recent work showed that shading gradients generated by smooth three-dimensional (3D) surfaces can elicit strong illusory percepts of optical defocus1,2 - the perception of illusory blur is only eliminated when the surface appears attached to self-occluding contours3, surface discontinuities1, or sharp specular reflections1,2, which all generate sharp ('high spatial frequency') image structure. This suggests that it should also be possible to eliminate the illusory blur elicited by shaded surfaces by altering the surface geometry to include small-scale surface relief, which would also generate high-frequency image structure. We report the surprising result here that this manipulation fails to eliminate the perception of blur; the fine texture fails to perceptually 'bind' to the low-frequency image structure when there is a sufficient gap between the spatial scales of the fine and coarse surface structure. These findings suggest that discontinuous 'gaps' in the spatial scale of textures are a segmentation cue the visual system uses to extract multiple causes of image structure.

The role of color contrast gain control in global form perception

A Glass pattern consists of randomly distributed dot pairs, or dipoles, whose orientation is determined by a geometric transform, which defines the global percept perceived by an observer. The perception of Glass patterns involves a local process that associates dot pairs into dipoles and a global process that groups the dipoles into a global structure. In the present study, we used a variant of Glass patterns, which was composed of randomly distributed tripoles instead of dipoles, to estimate the influence of color contrast on perceptual grouping. Each tripole contained an anchor dot and two context dots. Grouping the anchor dot with one of the context dots resulted in a global percept of a clockwise spiral, while grouping with the other dot, a counter-clockwise spiral. All dots in each pattern were modulated in the same color direction but different contrasts. Four colors were involved, namely, red, green, blue, and yellow. The observers were to determine whether the spiral in each trial was clockwise or counter-clockwise. The probability of a context dot being grouped with the anchoring dot increased with its color contrast to a certain level, then decreased when the contrast continued to increase. Such probability decreased as the contrast of the other context dot increased. Our result cannot be explained by existing models in the literature, but with a divisive inhibition model. The equiluminance contrast result observed here is similar to the inverted U-shaped function for luminance contrast result previously reported by us, except that the color contrast model comprises a weaker self-inhibition component.

Effects of Spatial Frequency Similarity and Dissimilarity on Contour Integration

We examined the effects of spatial frequency similarity and dissimilarity on human contour integration under various conditions of uncertainty. Participants performed a temporal 2AFC contour detection task. Spatial frequency jitter up to 3.0 octaves was applied either to background elements, or to contour and background elements, or to none of both. Results converge on four major findings. (1) Contours defined by spatial frequency similarity alone are only scarcely visible, suggesting the absence of specialized cortical routines for shape detection based on spatial frequency similarity. (2) When orientation collinearity and spatial frequency similarity are combined along a contour, performance amplifies far beyond probability summation when compared to the fully heterogenous condition but only to a margin compatible with probability summation when compared to the fully homogenous case. (3) Psychometric functions are steeper but not shifted for homogenous contours in heterogenous backgrounds indicating an advantageous signal-to-noise ratio. The additional similarity cue therefore not so much improves contour detection performance but primarily reduces observer uncertainty about whether a potential candidate is a contour or just a false positive. (4) Contour integration is a broadband mechanism which is only moderately impaired by spatial frequency dissimilarity.

The role of the foreshortening cue in the perception of 3D object slant

Slant is the degree to which a surface recedes or slopes away from the observer about the horizontal axis. The perception of surface slant may be derived from static monocular cues, including linear perspective and foreshortening, applied to single shapes or to multi-element textures. It is still unclear the extent to which color vision can use these cues to determine slant in the absence of achromatic contrast. Although previous demonstrations have shown that some pictures and images may lose their depth when presented at isoluminance, this has not been tested systematically using stimuli within the spatio-temporal passband of color vision. Here we test whether the foreshortening cue from surface compression (change in the ratio of width to length) can induce slant perception for single shapes for both color and luminance vision. We use radial frequency patterns with narrowband spatio-temporal properties. In the first experiment, both a manual task (lever rotation) and a visual task (line rotation) are used as metrics to measure the perception of slant for achromatic, red-green isoluminant and S-cone isolating stimuli. In the second experiment, we measure slant discrimination thresholds as a function of depicted slant in a 2AFC paradigm and find similar thresholds for chromatic and achromatic stimuli. We conclude that both color and luminance vision can use the foreshortening of a single surface to perceive slant, with performances similar to those obtained using other strong cues for slant, such as texture. This has implications for the role of color in monocular 3D vision, and the cortical organization used in 3D object perception.

The neural signature of spatial frequency-based information integration in scene perception

Spatial frequency-based information plays an important role in visual perception. By combining behavioral and electroencephalogram (EEG) measurements, we investigated the mechanisms of the interaction and information integration between different spatial frequency bands. The observers performed a scene categorization task on hybrid images that were generated by combining the low spatial frequency (LSF) component of one image with the high spatial frequency (HSF) component of another image. The results showed that the recognition of the HSF component was interfered by the non-attended LSF component at semantic level. The strength of the semantic interference was modulated by the physical similarity between the LSF and HSF components. Analyses of the EEG data revealed an early anterior N1 component (122 ms from stimulus onset) that was related to the observed interaction of the semantic and physical information between the LSF and HSF components. These findings demonstrate that the semantic information from different spatial frequency bands can be integrated at early stage of the perceptual processing. This early integration is likely to occur at frontal areas in order to initiate top-down facilitation.

Neural representation of feature synergy

Interactive non-linear cooperation of different feature dimensions, feature synergy, has been studied in psychophysics, but the neural mechanism is unknown. The present study investigated the neural representation of feature synergy of two second-order visual features by combining electroencephalography (EEG) with the signal detection theory (SDT). Two kinds of a 27-by-27 array of Gabor patches were presented in a random order; a reference stimulus which has no segregated region, and a target stimulus whose inner region differed in spatial frequency, orientation, or both from the surround. Subjects performed a Yes-No discrimination of whether the inner region was different from the surround, while EEG signals were recorded from 62 locations. When the SDT measure showed feature synergy, EEG activity showed a long-lasting enhancement starting at 130 ms around the inferior temporal region. In contrast, no EEG modulation was observed when feature synergy was not present. Thus, our combined approach demonstrates that non-linear cooperation between different features is represented by neural activity starting at 130 ms post-stimulus in the ventral visual stream.

Spatial frequency summation in visual noise

Kersten [Vision Res. 27, 1029 (1987)] reported that absolute efficiency for the detection of static, one-dimensional bandpass noise was high and approximately constant for stimulus bandwidths ranging from 1 to 6 octaves. This result implies that human observers integrated information efficiently across a wide range of spatial frequency. One interpretation of this result--and similar results obtained with auditory stimuli [J. Acoust. Soc. Am. 32, 121 (1960)]--is that human observers, like ideal observers, can detect stimuli using an internal filter that has an adjustable bandwidth. The current experiments replicate Kersten's findings, extend them to the case where observers are uncertain about stimulus bandwidth, and use the classification image technique to estimate the filter used to detect noise stimuli that differ in bandwidth. Our results suggest that observers do not adjust channel bandwidth to match the stimulus and that detection thresholds are consistent with the predictions of a multiple-channel model.

Making perceptual learning practical to improve visual functions

Task-specific improvement in performance after training is well established. The finding that learning is stimulus-specific and does not transfer well between different stimuli, between stimulus locations in the visual field, or between the two eyes has been used to support the notion that neurons or assemblies of neurons are modified at the earliest stage of cortical processing. However, a debate regarding the proposed mechanism underlying perceptual learning is an ongoing issue. Nevertheless, generalization of a trained task to other functions is an important key, for both understanding the neural mechanisms and the practical value of the training. This manuscript describes a structured perceptual learning method that previously used (amblyopia, myopia) and a novel technique and results that were applied for presbyopia. In general, subjects were trained for contrast detection of Gabor targets under lateral masking conditions. Training improved contrast sensitivity and diminished the lateral suppression when it existed (amblyopia). The improvement was transferred to unrelated functions such as visual acuity. The new results of presbyopia show substantial improvement of the spatial and temporal contrast sensitivity, leading to improved processing speed of target detection as well as reaction time. Consequently, the subjects, who were able to eliminate the need for reading glasses, benefited. Thus, here we show that the transfer of functions indicates that the specificity of improvement in the trained task can be generalized by repetitive practice of target detection, covering a sufficient range of spatial frequencies and orientations, leading to an improvement in unrelated visual functions. Thus, perceptual learning can be a practical method to improve visual functions in people with impaired or blurred vision.

Sensibilidade ao contraste a grades senoidais de freqüências espaciais baixas em crianças

O objetivo deste trabalho foi determinar a função de sensibilidade ao contraste para freqüências espaciais de 0,25; 0,5; 1,0 e 2,0 ciclos por grau em crianças de 4 a 13 anos. Foram estimados limiares de contraste para 60 participantes (50 crianças e 10 adultos jovens), utilizando o método psicofísico da escolha forçada e nível baixo de luminância. Todos os participantes apresentavam acuidade visual normal e se encontravam livres de doenças oculares identificáveis. Os resultados mostraram que a função de sensibilidade ao contraste de crianças de 4-5, 6-7, 8-9, 10-11 e 12-13 anos melhora significativamente com a idade. Os resultados mostraram ainda que a função de sensibilidade ao contraste de crianças de 12-13 anos é semelhante à de adultos jovens (19-22 anos). Estes resultados sugerem que o desenvolvimento da função de sensibilidade ao contraste para grade senoidal em nível baixo de luminância melhora até os 12-13 anos.

Channel surfing in the visual brain

Vision provides us with an ever-changing neural representation of the world from which we must extract stable object categorizations. We argue that visual analysis involves a fundamental interaction between the observer's top-down categorization goals and the incoming stimulation. Specifically, we discuss the information available for categorization from an analysis of different spatial scales by a bank of flexible, interacting spatial-frequency (SF) channels. We contend that the activity of these channels is not determined simply bottom-up by the stimulus. Instead, we argue that, following perceptual learning a specification of the diagnostic, object-based, SF information dynamically influences the top-down processing of retina-based SF information by these channels. Our analysis of SF processing provides a case study that emphasizes the continuity between higher-level cognition and lower-level perception.

Cue combination in a combined feature contrast detection and figure identification task

Target figures defined by feature contrast in spatial frequency, orientation or both cues had to be detected in Gabor random fields and their shape had to be identified in a dual task paradigm. Performance improved with increasing feature contrast and was strongly correlated among both tasks. Subjects performed significantly better with combined cues than with single cues. The improvement due to cue summation was stronger than predicted by the assumption of independent feature specific mechanisms, and increased with the performance level achieved with single cues until it was limited by ceiling effects. Further, cue summation was also strongly correlated among tasks: when there was benefit due to the additional cue in feature contrast detection, there was also benefit in figure identification. For the same performance level achieved with single cues, cue summation was generally larger in figure identification than in feature contrast detection, indicating more benefit when processes of shape and surface formation are involved. Our results suggest that cue combination improves spatial form completion and figure-ground segregation in noisy environments, and therefore leads to more stable object vision.

Interhemispheric integration at different spatial scales: the evidence from EEG coherence and FMRI

The early visual system processes different spatial frequencies (SFs) separately. To examine where in the brain the scale-specific information is integrated, we mapped the neural assemblies engaged in interhemispheric coupling with electroencephalographic (EEG) coherence and blood-oxygen-level dependent (BOLD) signal. During similar EEG and functional magnetic resonance imaging (fMRI) experiments, our subjects viewed centrally presented bilateral gratings of different SF (0.25-8.0 cpd), which either obeyed Gestalt grouping rules (iso-oriented, IG) or violated them (orthogonally oriented, OG). The IG stimuli (0.5-4.0 cpd) synchronized EEG at discrete beta frequencies (beta1, beta2) and increased BOLD (0.5 and 2.0 cpd tested) in ventral (around collateral sulcus) and dorsal (parieto-occipital fissure) regions compared with OG. At both SF, the beta1 coherence correlated with the ventral activations, whereas the beta2 coherence correlated with the dorsal ones. Thus distributed neural substrates mediated interhemispheric integration at single SF. The relative impact of the ventral versus dorsal networks was modulated by the SF of the stimulus.

Sistema visual humano: evidência psicofísica para filtros de freqüência angular baixa

O objetivo deste trabalho foi mensurar curvas de resposta ao contraste para os filtros de freqüências angulares de banda estreita de 1, 2, 3 e 4 ciclos/360º. Foram estimadas nove curvas para cada filtro com o método psicofísico de somação de resposta de supralimiar aliado ao método da escolha forçada. Tomaram parte neste experimento cinco participantes adultos com acuidade visual normal ou corrigida. Os resultados demonstraram somações máximas de limiar de contraste na freqüência de teste dos filtros de 1, 2, 3 e 4 ciclos/360º circundadas por inibições nas freqüências vizinhas às freqüências angulares de teste de cada filtro. Estes resultados são consistentes com a existência de filtros de freqüências angulares de banda estreita operando no sistema visual humano através do processo de somação ou inibição na faixa de freqüências angular baixa.

Detection of contour continuity and closure in three-month-olds

The present study used an operant conditioning procedure and contour integration stimuli to test three-month-olds' sensitivity to both contour continuity and contour closure. The data demonstrate an immaturity of continuity detection and a lack of closure detection at that age, relative to a previous finding of a heightened sensitivity to closed contours in adult observers. This finding modifies the general view of infant visual perception that has been more focused on the quantitative development of various aspects of visual perception, including contrast sensitivity, binocular disparity processing, perceptual completion, and other perceptual skills. These results suggest qualitative change in terms of the organization of visual information during development, and implications of this finding for visual maturation of mechanisms suggested to underlie these detection abilities are discussed.

Characterization of mouse cortical spatial vision

Little is known about the spatial vision of mice or of the role the visual cortex plays in mouse visual perception. In order to provide baseline information upon which to evaluate the spatial vision of experimentally and genetically altered mice, we used the visual water task to assess the contrast sensitivity and grating acuity of normal C57BL/6 mice. We then ablated striate cortex (V1) bilaterally and re-measured the same visual functions. Intact mice displayed an inverse "U"-shaped contrast sensitivity curve with a maximum sensitivity near 0.2 cycles/degree (c/d). Grating acuity, measured either by discriminating a sine-wave grating from an equiluminant gray, or vertical from horizontal sine wave gratings, was near 0.55 c/d. Grating acuity and contrast sensitivity were reduced significantly following aspiration of V1. The mouse visual system exhibits fundamental mammalian characteristics, including the feature that striate cortex is involved in processing visual information with the highest sensitivity and spatial frequency.

Neural processing of amplitude-modulated sounds

Amplitude modulation (AM) is a temporal feature of most natural acoustic signals. A long psychophysical tradition has shown that AM is important in a variety of perceptual tasks, over a range of time scales. Technical possibilities in stimulus synthesis have reinvigorated this field and brought the modulation dimension back into focus. We address the question whether specialized neural mechanisms exist to extract AM information, and thus whether consideration of the modulation domain is essential in understanding the neural architecture of the auditory system. The available evidence suggests that this is the case. Peripheral neural structures not only transmit envelope information in the form of neural activity synchronized to the modulation waveform but are often tuned so that they only respond over a limited range of modulation frequencies. Ascending the auditory neuraxis, AM tuning persists but increasingly takes the form of tuning in average firing rate, rather than synchronization, to modulation frequency. There is a decrease in the highest modulation frequencies that influence the neural response, either in average rate or synchronization, as one records at higher and higher levels along the neuraxis. In parallel, there is an increasing tolerance of modulation tuning for other stimulus parameters such as sound pressure level, modulation depth, and type of carrier. At several anatomical levels, consideration of modulation response properties assists the prediction of neural responses to complex natural stimuli. Finally, some evidence exists for a topographic ordering of neurons according to modulation tuning. The picture that emerges is that temporal modulations are a critical stimulus attribute that assists us in the detection, discrimination, identification, parsing, and localization of acoustic sources and that this wide-ranging role is reflected in dedicated physiological properties at different anatomical levels.

Recognizing spatial patterns: a noisy exemplar approach

Models of categorization typically rely on the use of stimuli composed of well-defined dimensions (e.g., Ashby & Maddox (1998) in Choice, decision, and measurement: Essays in honor of R. Duncan Luce, p. 251-301, Mahwah, NJ: Erlbaum). We apply a similar approach to the analysis of recognition memory. Using a version of short-term recognition paradigm (Sternberg, Science 153 (1966) 652), we asked whether NEMO Sternberg's, a noisy exemplar summed-similarity model, could account for variation in mean performance on individual trials. NEMO provided a very good overall fit to recognition data from three experiments. However, its failure to fit data for certain lists of stimuli suggested a revision of the summed-similarity assumption. Our model-based analysis showed that subjects used interitem similarity, in addition to probe-item similarity, as the basis for their decisions. This represents a major departure from existing recognition models that assume subjects' judgments depend exclusively on the summed similarity of the probe to the study items.

Eye movements in iconic visual search

Visual cognition depends critically on the moment-to-moment orientation of gaze. To change the gaze to a new location in space, that location must be computed and used by the oculomotor system. One of the most common sources of information for this computation is the visual appearance of an object. A crucial question is: How is the appearance information contained in the photometric array is converted into a target position? This paper proposes a such a model that accomplishes this calculation. The model uses iconic scene representations derived from oriented spatiochromatic filters at multiple scales. Visual search for a target object proceeds in a coarse-to-fine fashion with the target's largest scale filter responses being compared first. Task-relevant target locations are represented as saliency maps which are used to program eye movements. A central feature of the model is that it separates the targeting process, which changes gaze, from the decision process, which extracts information at or near the new gaze point to guide behavior. The model provides a detailed explanation for center-of-gravity saccades that have been observed in many previous experiments. In addition, the model's targeting performance has been compared with the eye movements of human subjects under identical conditions in natural visual search tasks. The results show good agreement both quantitatively (the search paths are strikingly similar) and qualitatively (the fixations of false targets are comparable).

Comparison of color and luminance vision on a global shape discrimination task

We compared the performances of the blue-yellow, red-green and luminance systems on a shape discrimination task. Stimuli were radial frequency patterns (radially modulated fourth derivative of a Gaussian) with a peak spatial frequency of 0.75 cpd. Stimuli isolated the chromatic (red-green and blue-yellow) and achromatic post-receptoral mechanisms. We showed that in all cases performance, measured as a radial modulation threshold for discrimination between a circular and non-circular stimulus, improves with contrast. Performance was compared across radial frequencies with contrast matched in multiples of stimulus detection threshold. We find that blue-yellow color system performs the worse on this shape discrimination task, followed by the red-green, with the achromatic system performing best. The average difference is a factor of 2 between achromatic and blue-yellow performance, and a factor of 1.7 between red-green and achromatic. Despite these performance losses, chromatic shape discrimination can still reach hyperacuity performance levels. In a secondary experiment we contrast modulate the radial contour to eliminate either the "corners" or "sides" of an RF4 (square) pattern. We find that for the achromatic system, the sides are more important for the task than the corners. However, for the chromatic system, removal of sides or corners produces similar performance deficits. We conclude that color vision has a selective although relatively mild deficit for two-dimensional form perception.

Narrow-band 1, 2, 3, 4, 8, 16 and 24 cycles/360 degrees angular frequency filters

We measured human frequency response functions for seven angular frequency filters whose test frequencies were centered at 1, 2, 3, 4, 8, 16 or 24 cycles/360 degree using a supra-threshold summation method. The seven functions of 17 experimental conditions each were measured nine times for five observers. For the arbitrarily selected filter phases, the maximum summation effect occurred at test frequency for filters at 1, 2, 3, 4 and 8 cycles/360 degree. For both 16 and 24 cycles/360 degree test frequencies, maximum summation occurred at the lower harmonics. These results allow us to conclude that there are narrow-band angular frequency filters operating somehow in the human visual system either through summation or inhibition of specific frequency ranges. Furthermore, as a general result, it appears that addition of higher angular frequencies to lower ones disturbs low angular frequency perception (i.e., 1, 2, 3 and 4 cycles/360 degree), whereas addition of lower harmonics to higher ones seems to improve detection of high angular frequency harmonics (i.e., 8, 16 and 24 cycles/360 degree). Finally, we discuss the possible involvement of coupled radial and angular frequency filters in face perception using an example where narrow-band low angular frequency filters could have a major role.

The emergence of visual objects in space-time

It is natural to think that in perceiving dynamic scenes, vision takes a series of snapshots. Motion perception can ensue when the snapshots are different. The snapshot metaphor suggests two questions: (i) How does the visual system put together elements within each snapshot to form objects? This is the spatial grouping problem. (ii) When the snapshots are different, how does the visual system know which element in one snapshot corresponds to which element in the next? This is the temporal grouping problem. The snapshot metaphor is a caricature of the dominant model in the field-the sequential model-according to which spatial and temporal grouping are independent. The model we propose here is an interactive model, according to which the two grouping mechanisms are not separable. Currently, the experiments that support the interactive model are not conclusive because they use stimuli that are excessively specialized. To overcome this weakness, we created a new type of stimulus-spatiotemporal dot lattices-which allow us to independently manipulate the strength of spatial and temporal groupings. For these stimuli, sequential models make one fundamental assumption: if the spatial configuration of the stimulus remains constant, the perception of spatial grouping cannot be affected by manipulations of the temporal configuration of the stimulus. Our data are inconsistent with this assumption.

A multiscale dynamic programming procedure for boundary detection in ultrasonic artery images

Ultrasonic measurements of human carotid and femoral artery walls are conventionally obtained by manually tracing interfaces between tissue layers. The drawbacks of this method are the interobserver variability and inefficiency. In this paper, we present a new automated method which reduces these problems. By applying a multiscale dynamic programming (DP) algorithm, approximate vessel wall positions are first estimated in a coarse-scale image, which then guide the detection of the boundaries in a fine-scale image. In both cases, DP is used for finding a global optimum for a cost function. The cost function is a weighted sum of terms, in fuzzy expression forms, representing image features and geometrical characteristics of the vessel interfaces. The weights are adjusted by a training procedure using human expert tracings. Operator interventions, if needed, also take effect under the framework of global optimality. This reduces the amount of human intervention and, hence, variability due to subjectiveness. By incorporating human knowledge and experience, the algorithm becomes more robust. A thorough evaluation of the method in the clinical environment shows that interobserver variability is evidently decreased and so is the overall analysis time. We conclude that the automated procedure can replace the manual procedure and leads to an improved performance.

Detection of temporal structure depends on spatial structure

Observers can more easily detect correlated patterns of temporal contrast modulation within hybrid visual images composed of two components when those components are drawn from the same original picture (Blake, R., & Yang, Y. (1997). Proceedings of the National Academy of Science, 94, 7115-7119). To learn whether spatial phase is a mediating variable, we measured thresholds for detection of contrast modulation over time among component gratings while manipulating spatial phase among those components. In Experiment 1, observers more easily detected correlated contrast modulation when two component gratings were aligned in peaks-subtract phase. Experiment 2 showed that this phase-dependent detectability of synchronized contrast modulation is mediated by the phase-dependent, non-linear interaction among spatial frequency channels. The rigorous evaluation of several a priori reasonable hypotheses indicates that the phase-dependent detectability is not based on local spatial features such as local luminance, contrast or luminance gradient. Taken together, our results indicate that the spatial phase relationship and the temporal correlation of contrast modulation of two component gratings are both important for triggering facilitatory interaction between neural analyzers tuned to those gratings.

Attention activates winner-take-all competition among visual filters

Shifting attention away from a visual stimulus reduces, but does not abolish, visual discrimination performance. This residual vision with 'poor' attention can be compared to normal vision with 'full' attention to reveal how attention alters visual perception. We report large differences between residual and normal visual thresholds for discriminating the orientation or spatial frequency of simple patterns, and smaller differences for discriminating contrast. A computational model, in which attention activates a winner-take-all competition among overlapping visual filters, quantitatively accounts for all observations. Our model predicts that the effects of attention on visual cortical neurons include increased contrast gain as well as sharper tuning to orientation and spatial frequency.

Rectification nonlinearity in cortical end-stopped perceptive fields

End-stopped perceptive fields associated with line targets were demonstrated previously with length and width Westheimer functions. In this study we investigated rectifying non-linearity in these perceptive fields to examine whether they directly reflect the organization of cortical receptive fields. Specifically, we reversed the polarity of parts of the background field associated with a specific perceptive field sub-region and examined threshold changes in corresponding length or width Westheimer functions. Results showed full-wave rectification in end-stopping and half-wave rectification in center summation and flank-inhibition preceding linear summation in end-stopped perceptive fields. Half-wave rectification in center summation and surround-inhibition preceding linear summation was also found in circular perceptive fields associated with spot targets. These results are inconsistent with direct links between perceptive fields and cortical receptive fields. Rather they suggest that these perceptive fields are likely the second-order fields formed by pooled non-linearly rectified outputs from cortical receptive fields.

Spatial scale interactions in stereo sensitivity and the neural representation of binocular disparity

How are binocular disparities encoded and represented in the human visual system? An 'encoding cube' diagram is introduced to visualise differences between competing models. To distinguish the models experimentally, the depth-increment-detection function (discriminating disparity d from d +/- delta d) was measured as a function of standing disparity (d) with spatially filtered random-dot stereograms of different centre spatial frequencies. Stereothresholds degraded more quickly as standing disparity was increased with stimuli defined by high rather than low centre spatial frequency. This is consistent with a close correlation between the spatial scale of detection mechanisms and the disparities they process. It is shown that a simple model, where discrimination is limited by the noisy ratio of outputs of three disparity-selective mechanisms at each spatial scale, can account for the data. It is not necessary to invoke a population code for disparity to model the depth-increment-detection function. This type of encoding scheme implies insensitivity to large interocular phase differences. Might the system have developed a strategy to disambiguate or shift the matches made at fine scales with those made at the coarse scales at large standing disparities? In agreement with Rohaly and Wilson, no evidence was found that this is so. Such a scheme would predict that stereothresholds determined with targets composed of compounds of high and low frequency should be superior to those of either component alone. Although a small stereoacuity benefit was found at small disparities, the more striking result was that stereothresholds for compound-frequency targets were actually degraded at large standing disparities. The results argue against neural shifting of the matching range of fine scales by coarse-scale matches posited by certain stereo models.

Discrimination of complex patterns: orientation information is integrated across spatial scale; spatial-frequency and contrast information are not

Real-world objects are complex, containing information at multiple orientations and spatial scales. It is well established that at initial cortical stages of processing, local information about an image is separately represented at multiple spatial scales. However, it is not yet established how these early representations are later integrated across scale to signal useful information about complex stimulus features, such as edges and textures. In the studies reported here, we investigate the scale-integration processes involved in distinguishing among complex patterns. We use a concurrent-response paradigm in which observers simultaneously judge two components of compound gratings that differ widely in spatial frequency. In different experiments, each component takes one of two slightly different values along the dimensions of spatial frequency, contrast, or orientation. Using analyses developed within the framework of a multivariate extension of signal-detection theory, we ask how information about the frequency, contrast, or orientation of the components is or is not integrated across the two grating components. Our techniques permit us to isolate and identify interactions due to excitatory or inhibitory processes from effects due to noise, and to separately assess any attentional limitations that might occur in processing. Results indicate that orientation information is fully integrated across spatial scales within a limited orientation band and that decisions are based entirely on the summed information. Information about spatial frequency and contrast is not summed over spatial scale; cross-scale results show sensory independence. However, our results suggest that observers cannot simultaneously use information about frequency or contrast when it is presented at different spatial scales. Our results provide direct evidence for the existence of a higher-level summing circuit tailored to signal information about orientation. The properties of this mechanism differ substantially from edge-detector mechanisms proposed by Marr and others.