Detection mechanisms in L-, M-, and S-cone contrast space

castleCSF - A contrast sensitivity function of color, area, spatiotemporal frequency, luminance and eccentricity

The contrast sensitivity function (CSF) is a fundamental visual model explaining our ability to detect small contrast patterns. CSFs found many applications in engineering, where they can be used to optimize a design for perceptual limits. To serve such a purpose, CSFs must explain possibly a complete set of stimulus parameters, such as spatial and temporal frequency, luminance, and others. Although numerous contrast sensitivity measurements can be found in the literature, none fully explains the complete space of stimulus parameters. Therefore, in this work, we first collect and consolidate contrast sensitivity measurements from 18 studies, which explain the sensitivity variation across the parameters of interest. Then, we build an analytical contrast sensitivity model that explains the data from all those studies. The proposed castleCSF model explains the sensitivity as the function of spatial and temporal frequencies, an arbitrary contrast modulation direction in the color space, mean luminance, and chromaticity of the background, eccentricity, and stimulus area. The proposed model uses the same set of parameters to explain the data from 18 studies with an error of 3.59 dB. The consolidated contrast sensitivity data and the code for the model are publicly available at https://github.com/gfxdisp/castleCSF/.

It's not easy seeing green: The veridical perception of small spots

When single cones are stimulated with spots of 543-nm light presented against a white background, subjects report percepts that vary between predominately red, white, and green. However, light of the same spectral composition viewed over a large field under normal viewing conditions looks invariably green and highly saturated. It remains unknown what stimulus parameters are most important for governing the color appearance in the transition between these two extreme cases. The current study varied the size, intensity and retinal motion of stimuli presented in an adaptive optics scanning laser ophthalmoscope. Stimuli were either stabilized on target locations or allowed to drift across the retina with the eye's natural motion. Increasing both stimulus size and intensity led to higher likelihoods that monochromatic spots of light were perceived as green, whereas only higher intensities led to increases in perceived saturation. The data also show an interaction between size and intensity, suggesting that the balance between magnocellular and parvocellular activation may be critical factors for color perception. Surprisingly, under the range of conditions tested, color appearance did not depend on whether stimuli were stabilized. Sequential activation of many cones does not appear to drive hue and saturation perception as effectively as simultaneous activation of many cones.

Protocol for isolation of melanopsin and rhodopsin in the human eye using silent substitution

Melanopsin-mediated visual and non-visual functions are difficult to study in vivo. To isolate melanopsin responses, non-standard light stimulation instruments are required, with at least as many primaries as photoreceptor classes in the eye. In this protocol, we describe the physical light calibrations of the display instrumentation, control of stimulus artefacts, and correction of individual between-eye differences in human observers. The protocol achieves complete photoreceptor silent substitution in psychophysical, pupillometry, and electroretinographic experiments for probing melanopsin, rod, and cone function. For complete details on the use and execution of this protocol, please refer to Uprety et al. (2022).1.

Human visual gamma for color stimuli

Strong gamma-band oscillations in primate early visual cortex can be induced by homogeneous color surfaces (Peter et al., 2019; Shirhatti and Ray, 2018). Compared to other hues, particularly strong gamma oscillations have been reported for red stimuli. However, precortical color processing and the resultant strength of input to V1 have often not been fully controlled for. Therefore, stronger responses to red might be due to differences in V1 input strength. We presented stimuli that had equal luminance and cone contrast levels in a color coordinate system based on responses of the lateral geniculate nucleus, the main input source for area V1. With these stimuli, we recorded magnetoencephalography in 30 human participants. We found gamma oscillations in early visual cortex which, contrary to previous reports, did not differ between red and green stimuli of equal L-M cone contrast. Notably, blue stimuli with contrast exclusively on the S-cone axis induced very weak gamma responses, as well as smaller event-related fields and poorer change-detection performance. The strength of human color gamma responses for stimuli on the L-M axis could be well explained by L-M cone contrast and did not show a clear red bias when L-M cone contrast was properly equalized.

Linking perceived to physical contrast: Comparing results from discrimination and difference-scaling experiments

Psychophysical approaches that allow us to estimate how perceived stimulus intensity is linked to physical intensity are import tools for studying nonlinear transformations of visual signals within different visual pathways. Here, we investigated how stimulus contrast is encoded in achromatic and chromatic pathways using simple grating stimuli. We compared two experimental approaches to this question: contrast discrimination (increment detection thresholds measured on contrast pedestals) and the maximum likelihood difference scaling (MLDS) approach introduced by Maloney and Yang (2003). The results of both experiments are expressed using simple models that include a transducer function mapping physical contrast to an internal signal the observer uses in making judgments, and an estimate of the variability of this representation (internal "noise"). We found that the transducers derived from both experiments have a similar form, but occupy different ranges of physical contrast in different stimulus conditions, reflecting difference in contrast sensitivity. This is consistent with past discrimination results, and in the difference-scaling case provides new evidence supporting the idea that suprathreshold chromatic and achromatic contrast are processed similarly, once differences in contrast sensitivity are taken into account. Model estimates of internal noise were higher in the difference-scaling experiment than the discrimination experiment, a finding we attribute to a difference in task complexity. Finally, we fit an alternative version of the MLDS model in which internal noise increased with response level. This alternative was no better at predicting holdout data in a cross-validation analysis than the original constant-variance model.

A multiplicity of color-responsive cortical mechanisms revealed by the dynamics of cVEPs

Our results connect higher-order color mechanisms deduced from psychophysics with the known diversity of populations of double-opponent, color-responsive cells in V1. We used the chromatic visual evoked potential, the cVEP, to study responses in human visual cortex to equiluminant color patterns. Stimuli were modulated along three directions in color space: the cardinal directions, L-M and S, and along the line in color space from the white point to the color of the Red LED in the display screen (the Red direction). The Red direction is roughly intermediate between L-M and S in DKL space in cone-contrast coordinates. While cVEP response amplitude, latency, and width--and their dependences on cone contrast-- were similar in the L-M and Red directions, the Transientness of the Red response was significantly greater than for responses to stimuli in the L-M direction and in the S direction. This difference in response dynamics supports the concept that there are multiple, distinct neuronal populations, so-called higher- order color mechanisms, for color perception within human V1 cortex.

Enhanced luminance sensitivity on color and luminance pedestals: Threshold measurements and a model of parvocellular luminance processing

Psychophysical interactions between chromatic and achromatic stimuli may inform our understanding of the cortical processing of signals of parvocellular origin, which carry both luminance and color information. We measured observers' sensitivity in discriminating the luminance of circular patch stimuli with a range of baseline ("pedestal") luminance and chromaticity. Pedestal stimuli were defined along vectors in cone-contrast space in a plane spanned by the red-green cone-opponent (L-M) and achromatic (L + M + S) axes. For a range of pedestal directions and intensities within this plane, we measured thresholds for discriminating increments from decrements along the achromatic axis. Low-contrast pedestals lowered luminance thresholds for every pedestal type. Thresholds began to increase with higher pedestal contrasts, forming a "dipper"-shaped function. Dipper functions varied systematically with pedestal chromaticity: Compared to the achromatic case, chromatic pedestals were effective at lower contrast. We suggest that the enhancement of luminance sensitivity caused by both achromatic and chromatic pedestals stems from a single mechanism, which is maximally sensitive to chromatic stimuli. We fit our data with a computational model of such a mechanism, in which luminance is computed from the rectified output of cone-opponent mechanisms similar to parvocellular neurons.

Spatio-chromatic contrast sensitivity under mesopic and photopic light levels

Contrast sensitivity functions (CSFs) characterize the sensitivity of the human visual system at different spatial scales, but little is known as to how contrast sensitivity for achromatic and chromatic stimuli changes from a mesopic to a highly photopic range reflecting outdoor illumination levels. The purpose of our study was to further characterize the CSF by measuring both achromatic and chromatic sensitivities for background luminance levels from 0.02 cd/m² to 7,000 cd/m². Stimuli consisted of Gabor patches of different spatial frequencies and angular sizes, varying from 0.125 to 6 cpd, which were displayed on a custom high dynamic range (HDR) display with luminance levels up to 15,000 cd/m². Contrast sensitivity was measured in three directions in color space, an achromatic direction, an isoluminant “red-green” direction, and an S-cone isolating “yellow-violet” direction, selected to isolate the luminance, L/M-cone opponent, and S-cone opponent pathways, respectively, of the early postreceptoral processing stages. Within each session, observers were fully adapted to the fixed background luminance (0.02, 2, 20, 200, 2,000, or 7,000 cd/m²). Our main finding is that the background luminance has a differential effect on achromatic contrast sensitivity compared to chromatic contrast sensitivity. The achromatic contrast sensitivity increases with higher background luminance up to 200 cd/m² and then shows a sharp decline when background luminance is increased further. In contrast, the chromatic sensitivity curves do not show a significant sensitivity drop at higher luminance levels. We present a computational luminance-dependent model that predicts the CSF for achromatic and chromatic stimuli of arbitrary size.

Negative afterimages facilitate the detection of real images

Negative, or complementary afterimages are experienced following brief adaptation to chromatic or achromatic stimuli, and are believed to be formed in the post-receptoral layers of the retinae. Afterimages can be cancelled by the addition of real images, suggesting that afterimages and real images are processed by similar mechanisms. However given their retinal origin, afterimage signals represented at the cortical level might have different spatio-temporal properties from their real images counterparts. To test this we determined whether afterimages reduce the contrast threshold of added real images, i.e. produce the classic "dipper" function characteristic of contrast discrimination, a behavior believed to be cortically mediated. Stimuli were chromatic and achromatic disks on a grey background. Observers adapted for 1.0 s to two side-by-side disks of a particular color. Following stimulus offset, a test disk added to one side was ramped downwards for 1.5 s to approximately match the temporal characteristic of the afterimage, and the observer was required to indicate the side containing the test disk. The test hue/brightness was either the same as that of the afterimage or a different hue/brightness. The independent variable was the contrast of the adaptor. A dipper followed by masking was observed in most conditions in which the afterimage and test colors had the same hue or brightness. We conclude that afterimages are represented similarly to their real image counterparts at the cortical level.

Columnar organization of mid-spectral and end-spectral hue preferences in human visual cortex

Multiple color-selective areas have been described in visual cortex, in both humans and non-human primates. In macaques, hue-selective columns have been reported in several areas. In V2, it has been proposed that such hue-selective columns are mapped so as to mirror the order of wavelength through the visible spectrum, within thin-type stripes. Other studies have suggested a neural segregation of mid-spectral vs. end-spectral hue preferences (e.g. red and blue vs. green and yellow), within thin- and thick-type stripes, respectively. This latter segregation could reduce the spatial 'blur' due to chromatic aberration in the encoding of fine spatial details in the thick-type stripes. To distinguish between these and related models, we tested the organization of hue preferences in human visual cortex using fMRI at high spatial resolution. We used a high field (7T) scanner in humans (n = 7), measuring responses to four independent hues, including end-spectral (i.e. red-gray and blue-gray) and mid-spectral (i.e. green-gray and yellow-gray) isoluminant gratings, and also relative to achromatic luminance-varying (control) stimuli. In each subject, thin- and thick-type columns in V2 and V3 were localized using an independent set of stimuli and scans. We found distinct hue-selective differences along the dimension of mid-vs. end-spectral hues, in striate and early extrastriate visual cortex. First, as reported previously in macaques, V1 responded more strongly to end-spectral hues, compared to mid-spectral hues. Second, the color-selective thin-type stripes in V2 and V3 showed a greater response to end- and mid-spectral hues, relative to luminance-varying gratings. Third, thick-type stripes in V2/V3 showed a significantly stronger response to mid-spectral (compared to end-spectral) hues. Fourth, in the higher-tier color-selective area in occipital temporal cortex (n = 4), responses to all four hues were statistically equivalent to each other. These results suggest that early visual cortex segregates the processing of mid-vs. end-spectral hues, perhaps to counter the challenging optical constraint of chromatic aberration.

Evidence for chromatic edge detectors in human vision using classification images

Edge detection plays an important role in human vision, and although it is clear that there are luminance edge detectors, it is not known whether there are chromatic edge detectors as well. We showed observers a horizontal edge blurred by a Gaussian filter (with widths of σ = 0.1125, 0.225, or 0.45°) embedded in blurred Brown noise. Observers had to choose which of two stimuli contained the edge. Brown noise was used in preference to white noise to reveal localized edge detectors. Edges and noise were defined by either luminance or chromatic contrast (isoluminant L/M and S-cone opponent). Classification image analysis was applied to observer responses. In this analysis, the random components of the stimulus are correlated with observer responses to reveal a template that shows how observers weighted different parts of the stimulus to arrive at their decision. We found classification images for both luminance and isoluminant chromatic stimuli that had shapes very similar to derivatives of Gaussian filters. The widths of these classification images tracked the widths of the edges, but the chromatic edge classification images were wider than the luminance ones. These results are consistent with edge detection filters sensitive to luminance contrast and isoluminant chromatic contrast.

Sensitivity to S-Cone Stimuli and the Development of Myopia

Purpose

Longitudinal chromatic aberration (LCA) is a color signal available to the emmetropization process that causes greater myopic defocus of short wavelengths than long wavelengths. We measured individual differences in chromatic sensitivity to explore the role LCA may play in the development of refractive error.

Methods

Forty-four observers were tested psychophysically after passing color screening tests and a questionnaire for visual defects. Refraction was measured and only subjects with myopia or hyperopia without severe astigmatism participated. Psychophysical detection thresholds for 3 cyc/deg achromatic, L-, M-, and S-cone-isolating Gabor patches and low-frequency S-cone increment (S+) and decrement (S-) blobs were measured. Parametric Pearson correlations for refractive error versus threshold were calculated and nonparametric bootstrap 95% percentage confidence intervals (BCIs) for r were computed.

Results

S-cone Gabor detection thresholds were higher than achromatic, L-, and M-cone Gabors. S-cone Gabor thresholds were higher than either S+ or S- blobs. These results are consistent with studies using smaller samples of practiced observers. None of the thresholds for the Gabor stimuli were correlated with refractive error (RE). A negative correlation with RE was observed for both S+ (r = -0.28; P = 0.06; BCI: r = -0.5, -0.04) and S- (r = -0.23; P = 0.13; BCI = -0.46, 0.01) blobs, although this relationship did not reach conventional statistical significance.

Conclusions

Thresholds for S+ and S- stimuli were negatively related to RE, indicating that myopes may have reduced sensitivity to low spatial frequency S-cone stimuli. This reduced S-cone sensitivity might have played a role in their failure to emmetropize normally.

Measurements of neuronal color tuning: Procedures, pitfalls, and alternatives

Measuring the color tuning of visual neurons is important for understanding the neural basis of vision, but it is challenging because of the inherently three-dimensional nature of color. Color tuning cannot be represented by a one-dimensional curve, and measuring three-dimensional tuning curves is difficult. One approach to addressing this challenge is to analyze neuronal color tuning data through the lens of mathematical models that make assumptions about the shapes of tuning curves. In this paper, we discuss the linear-nonlinear cascade model as a platform for measuring neuronal color tuning. We compare fitting this model by three techniques: two using response-weighted averaging and one using numerical optimization of likelihood. We highlight the advantages and disadvantages of each technique and emphasize the effects of the stimulus distribution on color tuning measurements.

The Whole is Other Than the Sum: Perceived Contrast Summation Within Color and Luminance Plaids

The apparent contrast of a plaid is a reflection of the neural relationship between the responses to its two orthogonal component gratings. To investigate the perceived contrast summation of the responses to component gratings in plaids, we compared the apparent contrasts of monocular plaids to a component grating presented alone across chromaticity and spatial frequency. Observers performed a contrast-matching task for red-green color and luminance stimuli at low- and medium-spatial frequencies. Using the measured points of subjective equality between plaids and gratings, we evaluate perceived contrast summation across conditions, which may vary between 1 (no summation) and 2 (full summation). We show that achromatic plaids have higher perceived contrast summation than chromatic plaids. The greatest difference occurs at the medium-spatial frequency, with summation highest for achromatic plaids (1.87) and lowest for chromatic plaids (1.49), while at low-spatial frequencies, there is a smaller summation difference between achromatic (1.72) and chromatic (1.65) plaids. These results are consistent with recent theories of distinct cross-orientation suppression and summation mechanisms in color and luminance vision. Two control experiments for binocular versus monocular viewing, and the overall size of the stimulus patches did not reveal any differences from our main results.

The Appropriateness of Contrast Metric for Reaction Times

We analyzed different contrast metrics to scale the stimulus strength for suprathreshold reaction times (RTs) when it is modulated along an achromatic channel (L + M) and both chromatic channels L/M and S/(L + M) considering increments and decrements along these axes. RTs were examined as a function of the Weber luminance contrast; spatial luminance ratio (SRL) and, in terms of threshold units. The results show that when there is only luminance decreasing or increasing, RTs cluster around a single RT/luminance contrast function regardless the stimulus sign and our results indicate that both SRL, Weber luminance contrast or threshold units, equate RT values. While, if the stimulus is modulated along an isoluminant plane, the appropriate contrast is Weber (RMS) or SRL for stimuli modulated along L/M axis and for stimuli modulated along S/L + M, showing an asymmetry between S-cone decrements and increments in L/M cone pathway. Threshold units are not appropriate, showing inconsistencies: The stimulus with chromatic direction equal to 90° appears as the most informative with a maximum gain. Even more so, the shared contrast gain grows as the size of the stimulus decreases.

Human Visual Cortex Responses to Rapid Cone and Melanopsin-Directed Flicker

Signals from cones are recombined in postreceptoral channels [luminance, L + M; red-green, L - M; blue-yellow, S - (L + M)]. The melanopsin-containing retinal ganglion cells are also active at daytime light levels and recent psychophysical results suggest that melanopsin contributes to conscious vision in humans. Here, we measured BOLD fMRI responses to spectral modulations that separately targeted the postreceptoral cone channels and melanopsin. Responses to spatially uniform (27.5° field size, central 5° obscured) flicker at 0.5, 1, 2, 4, 8, 16, 32, and 64 Hz were recorded from areas V1, V2/V3, motion-sensitive area MT, and the lateral occipital complex. In V1 and V2/V3, higher temporal sensitivity was observed to L + M + S (16 Hz) compared with L - M flicker (8 Hz), consistent with psychophysical findings. Area MT was most sensitive to rapid (32 Hz) flicker of either L + M + S or L - M. We found S cone responses only in areas V1 and V2/V3 (peak frequency: 4-8 Hz). In addition, we studied an L + M modulation and found responses that were effectively identical at all temporal frequencies to those recorded for the L + M + S modulation. Finally, we measured the cortical response to melanopsin-directed flicker and compared this response with control modulations that addressed stimulus imprecision and the possibility of stimulation of cones in the shadow of retinal blood vessels (penumbral cones). For our stimulus conditions, melanopsin flicker did not elicit a cortical response exceeding that of the control modulations. We note that failure to control for penumbral cone stimulation could be mistaken for a melanopsin response.

SIGNIFICANCE STATEMENT

The retina contains cone photoreceptors and ganglion cells that contain the photopigment melanopsin. Cones provide brightness and color signals to visual cortex. Melanopsin influences circadian rhythm and the pupil, but its contribution to cortex and perception is less clear. We measured the response of human visual cortex with fMRI using spectral modulations tailored to stimulate the cones and melanopsin separately. We found that cortical responses to cone signals vary systematically across visual areas. Differences in temporal sensitivity for achromatic, red-green, and blue-yellow stimuli generally reflect the known perceptual properties of vision. We found that melanopsin signals do not produce a measurable response in visual cortex at temporal frequencies between 0.5 and 64 Hz at daytime light levels.

Fluctuation scaling in the visual cortex at threshold

Fluctuation scaling relates trial-to-trial variability to the average response by a power function in many physical processes. Here we address whether fluctuation scaling holds in sensory psychophysics and its functional role in visual processing. We report experimental evidence of fluctuation scaling in human color vision and form perception at threshold. Subjects detected thresholds in a psychophysical masking experiment that is considered a standard reference for studying suppression between neurons in the visual cortex. For all subjects, the analysis of threshold variability that results from the masking task indicates that fluctuation scaling is a global property that modulates detection thresholds with a scaling exponent that departs from 2, β=2.48±0.07. We also examine a generalized version of fluctuation scaling between the sample kurtosis K and the sample skewness S of threshold distributions. We find that K and S are related and follow a unique quadratic form K=(1.19±0.04)S^{2}+(2.68±0.06) that departs from the expected 4/3 power function regime. A random multiplicative process with weak additive noise is proposed based on a Langevin-type equation. The multiplicative process provides a unifying description of fluctuation scaling and the quadratic S-K relation and is related to on-off intermittency in sensory perception. Our findings provide an insight into how the human visual system interacts with the external environment. The theoretical methods open perspectives for investigating fluctuation scaling and intermittency effects in a wide variety of natural, economic, and cognitive phenomena.

The dynamics of cross-orientation masking at monocular and interocular sites

We investigated the temporal properties of monocular and dichoptic cross-orientation masking (XOM) mediating suppressive or facilitatory cross-channel interactions between the neural detectors for the test and orthogonal mask stimuli. We measured the evolution of masking as a function of the duration of the test and mask stimuli to determine its time constant, and determined its dependence on stimulus onset asynchrony (SOA), for three contrast combinations: color-only (red-green color test and mask), luminance-only (luminance test and mask) and color-luminance (color test and luminance mask). Results show that the temporal properties of monocular and dichoptic masking differ markedly from each other and across contrast type. For the color-only condition, the dichoptic suppressive interaction is significantly longer than for the monocular one and both are largely independent of SOA. For the luminance-only condition, the suppressive interactions in both presentations are faster than for color, have similar time constants, but have different dependencies on SOA. For the color-luminance condition under the monocular conditions, cross-orientation facilitation (XOF) occurs with the luminance mask speeding up the processing of the color test with greatest XOF when the luminance mask precedes the color test by around 22 ms. No significant effects are observed for the dichoptic condition. Effects are invariant across spatial frequency. These strongly differential dynamic effects suggest that there is separate encoding of color contrast, luminance contrast, and their combination at the relatively early within-eye stage of processing, which is distinct from the dichoptic site.

Reduced Discrimination in the Tritanopic Confusion Line for Congenital Color Deficiency Adults

In congenital color blindness the red–green discrimination is impaired resulting in an increased confusion between those colors with yellow. Our post-receptoral physiological mechanisms are organized in two pathways for color perception, a red–green (protanopic and deuteranopic) and a blue–yellow (tritanopic). We argue that the discrimination losses in the yellow area in congenital color vision deficiency subjects could generate a subtle loss of discriminability in the tritanopic channel considering discrepancies with yellow perception. We measured color discrimination thresholds for blue and yellow of tritanopic channel in congenital color deficiency subjects. Chromaticity thresholds were measured around a white background (0.1977 u′, 0.4689 v′ in the CIE 1976) consisting of a blue–white and white–yellow thresholds in a tritanopic color confusion line of 21 congenital colorblindness subjects (mean age = 27.7; SD = 5.6 years; 14 deuteranomalous and 7 protanomalous) and of 82 (mean age = 25.1; SD = 3.7 years) normal color vision subjects. Significant increase in the whole tritanopic axis was found for both deuteranomalous and protanomalous subjects compared to controls for the blue–white (F_2,100 = 18.80; p < 0.0001) and white–yellow (F_2,100 = 22.10; p < 0.0001) thresholds. A Principal Component Analysis (PCA) found a weighting toward to the yellow thresholds induced by deuteranomalous subjects. In conclusion, the discrimination in the tritanopic color confusion axis is significantly reduced in congenital color vision deficiency compared to normal subjects. Since yellow discrimination was impaired the balance of the blue–yellow channels is impaired justifying the increased thresholds found for blue–white discrimination. The weighting toward the yellow region of the color space with the deuteranomalous contributing to that perceptual distortion is discussed in terms of physiological mechanisms.

Stereo chromatic contrast sensitivity model to blue-yellow gratings

As a fundamental metric of human visual system (HVS), contrast sensitivity function (CSF) is typically measured by sinusoidal gratings at the detection of thresholds for psychophysically defined cardinal channels: luminance, red-green, and blue-yellow. Chromatic CSF, which is a quick and valid index to measure human visual performance and various retinal diseases in two-dimensional (2D) space, can not be directly applied into the measurement of human stereo visual performance. And no existing perception model considers the influence of chromatic CSF of inclined planes on depth perception in three-dimensional (3D) space. The main aim of this research is to extend traditional chromatic contrast sensitivity characteristics to 3D space and build a model applicable in 3D space, for example, strengthening stereo quality of 3D images. This research also attempts to build a vision model or method to check human visual characteristics of stereo blindness. In this paper, CRT screen was clockwise and anti-clockwise rotated respectively to form the inclined planes. Four inclined planes were selected to investigate human chromatic vision in 3D space and contrast threshold of each inclined plane was measured with 18 observers. Stimuli were isoluminant blue-yellow sinusoidal gratings. Horizontal spatial frequencies ranged from 0.05 to 5 c/d. Contrast sensitivity was calculated as the inverse function of the pooled cone contrast threshold. According to the relationship between spatial frequency of inclined plane and horizontal spatial frequency, the chromatic contrast sensitivity characteristics in 3D space have been modeled based on the experimental data. The results show that the proposed model can well predicted human chromatic contrast sensitivity characteristics in 3D space.

Is discrimination enhanced at a category boundary? The case of unique red

Is chromatic discrimination enhanced at the boundary between different hues? In previous studies, we gave a positive answer for the case of the locus of unique blues and yellows, the boundary that divides color space into reddish and greenish hues. But we did not find enhancement at the locus of unique green, the boundary between yellowish and bluish hues. In the present study, we examined discrimination near the locus of unique red. In interleaved experimental runs, we obtained (1) discrimination thresholds using a four-alternative spatial forced choice and (2) phenomenological judgments of the locus of unique red. When measurements were made along lines parallel to the locus of unique blues and yellows in a MacLeod-Boynton diagram, the locus of minimal thresholds coincided approximately with the locus of unique red; however, this was not the case when measurements were made along lines orthogonal to the locus of unique blues and yellows. To account for these and earlier results, we suppose that the neural channel that determines the discrimination threshold will sometimes coincide with the channel that determines the perceptual hue equilibrium and sometimes will not. If a given point in chromaticity space is a unique hue, then it is expected to remain a unique hue independently of the direction in which measurements are made; however, discrimination thresholds almost certainly will depend on different underlying channels when measurements are made in different directions through the same point in chromaticity space.

Chromatic detection from cone photoreceptors to V1 neurons to behavior in rhesus monkeys

Chromatic sensitivity cannot exceed limits set by noise in the cone photoreceptors. To determine how close neurophysiological and psychophysical chromatic sensitivity come to these limits, we developed a parameter-free model of stimulus encoding in the cone outer segments, and we compared the sensitivity of the model to the psychophysical sensitivity of monkeys performing a detection task and to the sensitivity of individual V1 neurons. Modeled cones had a temporal impulse response and a noise power spectrum that were derived from in vitro recordings of macaque cones, and V1 recordings were made during performance of the detection task. The sensitivity of the simulated cone mosaic, the V1 neurons, and the monkeys were tightly yoked for low-spatiotemporal-frequency isoluminant modulations, indicating high-fidelity signal transmission for this class of stimuli. Under the conditions of our experiments and the assumptions for our model, the signal-to-noise ratio for these stimuli dropped by a factor of ∼3 between the cones and perception. Populations of weakly correlated V1 neurons narrowly exceeded the monkeys' chromatic sensitivity but fell well short of the cones' chromatic sensitivity, suggesting that most of the behavior-limiting noise lies between the cone outer segments and the output of V1. The sensitivity gap between the cones and behavior for achromatic stimuli was larger than for chromatic stimuli, indicating greater postreceptoral noise. The cone mosaic model provides a means to compare visual sensitivity across disparate stimuli and to identify sources of noise that limit visual sensitivity.

S-cone psychophysics

We review the features of the S-cone system that appeal to the psychophysicist and summarize the celebrated characteristics of S-cone mediated vision. Two factors are emphasized: First, the fine stimulus control that is required to isolate putative visual mechanisms and second, the relationship between physiological data and psychophysical approaches. We review convergent findings from physiology and psychophysics with respect to asymmetries in the retinal wiring of S-ON and S-OFF visual pathways, and the associated treatment of increments and decrements in the S-cone system. Beyond the retina, we consider the lack of S-cone projections to superior colliculus and the use of S-cone stimuli in experimental psychology, for example to address questions about the mechanisms of visually driven attention. Careful selection of stimulus parameters enables psychophysicists to produce entirely reversible, temporary, "lesions," and to assess behavior in the absence of specific neural subsystems.

Texture variations suppress suprathreshold brightness and colour variations

Discriminating material changes from illumination changes is a key function of early vision. Luminance cues are ambiguous in this regard, but can be disambiguated by co-incident changes in colour and texture. Thus, colour and texture are likely to be given greater prominence than luminance for object segmentation, and better segmentation should in turn produce stronger grouping. We sought to measure the relative strengths of combined luminance, colour and texture contrast using a suprathreshhold, psychophysical grouping task. Stimuli comprised diagonal grids of circular patches bordered by a thin black line and contained combinations of luminance decrements with either violet, red, or texture increments. There were two tasks. In the Separate task the different cues were presented separately in a two-interval design, and participants indicated which interval contained the stronger orientation structure. In the Combined task the cues were combined to produce competing orientation structure in a single image. Participants had to indicate which orientation, and therefore which cue was dominant. Thus we established the relative grouping strength of each cue pair presented separately, and compared this to their relative grouping strength when combined. In this way we observed suprathreshold interactions between cues and were able to assess cue dominance at ecologically relevant signal levels. Participants required significantly more luminance and colour compared to texture contrast in the Combined compared to Separate conditions (contrast ratios differed by about 0.1 log units), showing that suprathreshold texture dominates colour and luminance when the different cues are presented in combination.

Contrast normalization in colour vision: the effect of luminance contrast on colour contrast detection

While contrast normalization is well known to occur in luminance vision between overlaid achromatic contrasts, and in colour vision between overlaid colour contrasts, it is unknown whether it transfers between colour and luminance contrast. Here we investigate whether contrast detection in colour vision can be normalized by achromatic contrast, or whether this is a selective process driven only by colour contrast. We use a method of cross-orientation masking, in which colour detection is masked by cross-oriented achromatic contrast, over a range of spatio-temporal frequencies (0.375–1.5 cpd, 2–8 Hz). We find that there is virtually no cross-masking of colour by achromatic contrast under monocular or binocular conditions for any of the spatio-temporal frequencies tested, although we find significant facilitation at low spatio-temporal conditions (0.375 cpd, 2 Hz). These results indicate that the process of contrast nornalization is colour selective and independent of achromatic contrast, and imply segregated chromatic signals in early visual processing. Under dichoptic conditions, however, we find a strikingly different result with significant masking of colour by achromatic contrast. This indicates that the dichoptic site of suppression is unselective, responding similarly to colour and luminance contrast, and suggests that dichoptic suppression has a different origin from monocular or binocular suppression.

Noise masking of S-cone increments and decrements

S-cone increment and decrement detection thresholds were measured in the presence of bipolar, dynamic noise masks. Noise chromaticities were the L-, M-, and S-cone directions, as well as L-M, L+M, and achromatic (L+M+S) directions. Noise contrast power was varied to measure threshold Energy versus Noise (EvN) functions. S+ and S- thresholds were similarly, and weakly, raised by achromatic noise. However, S+ thresholds were much more elevated by S, L+M, L-M, L- and M-cone noises than were S- thresholds, even though the noises consisted of two symmetric chromatic polarities of equal contrast power. A linear cone combination model accounts for the overall pattern of masking of a single test polarity well. L and M cones have opposite signs in their effects upon raising S+ and S- thresholds. The results strongly indicate that the psychophysical mechanisms responsible for S+ and S- detection, presumably based on S-ON and S-OFF pathways, are distinct, unipolar mechanisms, and that they have different spatiotemporal sampling characteristics, or contrast gains, or both.

Spectral sensitivity differences between rhesus monkeys and humans: implications for neurophysiology

Spectral sensitivity of humans and rhesus monkeys was compared using identical displays and similar procedures. Detection thresholds were measured for the following: 1) 15-Hz modulation of a blue and a green cathode-ray tube phosphor; 2) 15-Hz modulation of all three phosphors together; and 3) slow (<1 Hz) modulations of a blue and a green phosphor under scotopic conditions. Monkeys had lower blue-to-green threshold ratios than humans at all eccentricities tested (0.5 to 7°), consistent with a lower lens optical density in monkeys. In addition to apparently having a lower lens density than humans, monkeys were more sensitive to 15-Hz red-green isoluminant modulations than humans, an effect that cannot be explained by optical factors.

Orientation tuning in human colour vision at detection threshold

We measure the orientation tuning of red-green colour and luminance vision at low (0.375 c/deg) and mid (1.5 c/deg) spatial frequencies using the low-contrast psychophysical method of subthreshold summation. Orientation bandwidths of the underlying neural detectors are found using a model involving Minkowski summation of the rectified outputs of a bank of oriented filters. At 1.5 c/deg, we find orientation-tuned detectors with similar bandwidths for chromatic and achromatic contrast. At 0.375 c/deg, orientation tuning is preserved with no change in bandwidth for achromatic stimuli, however, for chromatic stimuli orientation tuning becomes extremely broad, compatible with detection by non-oriented colour detectors. A non-oriented colour detector, previously reported in single cells in primate V1 but not psychophysically in humans, can transmit crucial information about the color of larger areas or surfaces whereas orientation-tuned detectors are required to detect the colour or luminance edges that delineate an object's shape.

Abnormal late visual responses and alpha oscillations in neurofibromatosis type 1: a link to visual and attention deficits

Background

Neurofibromatosis type 1 (NF1) affects several areas of cognitive function including visual processing and attention. We investigated the neural mechanisms underlying the visual deficits of children and adolescents with NF1 by studying visual evoked potentials (VEPs) and brain oscillations during visual stimulation and rest periods.

Methods

Electroencephalogram/event-related potential (EEG/ERP) responses were measured during visual processing (NF1 n = 17; controls n = 19) and idle periods with eyes closed and eyes open (NF1 n = 12; controls n = 14). Visual stimulation was chosen to bias activation of the three detection mechanisms: achromatic, red-green and blue-yellow.

Results

We found significant differences between the groups for late chromatic VEPs and a specific enhancement in the amplitude of the parieto-occipital alpha amplitude both during visual stimulation and idle periods. Alpha modulation and the negative influence of alpha oscillations in visual performance were found in both groups.

Conclusions

Our findings suggest abnormal later stages of visual processing and enhanced amplitude of alpha oscillations supporting the existence of deficits in basic sensory processing in NF1. Given the link between alpha oscillations, visual perception and attention, these results indicate a neural mechanism that might underlie the visual sensitivity deficits and increased lapses of attention observed in individuals with NF1.

Saliency interactions between the 'L-M' and 'S' cardinal colour directions

Two sub-systems characterize the early stages of human colour vision, the 'L-M' system that differences L and M cone signals and the 'S' system that differences S cone signals from the sum of L and M cone signals. How do they interact at suprathreshold contrast levels? To address this question we employed the method used by Kingdom et al. (2010) to study suprathreshold interactions between luminance and colour contrast. The stimulus employed in one condition was similar to that used by Regan and Mollon (1997) for studying the relative 'organizing power' of the two sub-systems, and consisted of obliquely-oriented red-cyan (to isolate the L-M sub-system) and violet-chartreuse (to isolate the S sub-system) stripes within a lattice of circles. In our experiment there were two conditions, (1) the Separated condition, in which the L-M and S modulations were of opposite orientation and presented separately as a forced-choice pair, and (2) the Combined condition, in which the L-M and S modulations were added. In the Separated condition the task was to indicate the stimulus with the more salient orientation structure, whereas in the Combined condition the task was to indicate the orientation that was more salient. Psychometric functions were used to estimate the ratio of L-M to S contrast at the 'balance-point' i.e. point-of-subjective-equality (PSE) in both conditions. We found that across 20 subjects an average of 8% more S than L-M contrast was needed to achieve a PSE in the Combined compared to Separated condition. We consider possible reasons for this PSE difference and conclude that it is either due to an early-stage interaction between the S and L-M sub-systems, or to a later stage in which new colours that arise from their combination are selectively grouped.

Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Until recently induced gamma-band activity (GBA) was considered a neural marker of cortical object representation. However, induced GBA in the electroencephalogram (EEG) is susceptible to artifacts caused by miniature fixational saccades. Recent studies have demonstrated that fixational saccades also reflect high-level representational processes. Do high-level as opposed to low-level factors influence fixational saccades? What is the effect of these factors on artifact-free GBA? To investigate this, we conducted separate eye tracking and EEG experiments using identical designs. Participants classified line drawings as objects or non-objects. To introduce low-level differences, contours were defined along different directions in cardinal color space: S-cone-isolating, intermediate isoluminant, or a full-color stimulus, the latter containing an additional achromatic component. Prior to the classification task, object discrimination thresholds were measured and stimuli were scaled to matching suprathreshold levels for each participant. In both experiments, behavioral performance was best for full-color stimuli and worst for S-cone isolating stimuli. Saccade rates 200-700 ms after stimulus onset were modulated independently by low and high-level factors, being higher for full-color stimuli than for S-cone isolating stimuli and higher for objects. Low-amplitude evoked GBA and total GBA were observed in very few conditions, showing that paradigms with isoluminant stimuli may not be ideal for eliciting such responses. We conclude that cortical loops involved in the processing of objects are preferentially excited by stimuli that contain achromatic information. Their activation can lead to relatively early exploratory eye movements even for foveally-presented stimuli.

The role of the foreshortening cue in the perception of 3D object slant

Slant is the degree to which a surface recedes or slopes away from the observer about the horizontal axis. The perception of surface slant may be derived from static monocular cues, including linear perspective and foreshortening, applied to single shapes or to multi-element textures. It is still unclear the extent to which color vision can use these cues to determine slant in the absence of achromatic contrast. Although previous demonstrations have shown that some pictures and images may lose their depth when presented at isoluminance, this has not been tested systematically using stimuli within the spatio-temporal passband of color vision. Here we test whether the foreshortening cue from surface compression (change in the ratio of width to length) can induce slant perception for single shapes for both color and luminance vision. We use radial frequency patterns with narrowband spatio-temporal properties. In the first experiment, both a manual task (lever rotation) and a visual task (line rotation) are used as metrics to measure the perception of slant for achromatic, red-green isoluminant and S-cone isolating stimuli. In the second experiment, we measure slant discrimination thresholds as a function of depicted slant in a 2AFC paradigm and find similar thresholds for chromatic and achromatic stimuli. We conclude that both color and luminance vision can use the foreshortening of a single surface to perceive slant, with performances similar to those obtained using other strong cues for slant, such as texture. This has implications for the role of color in monocular 3D vision, and the cortical organization used in 3D object perception.

V1 mechanisms underlying chromatic contrast detection

To elucidate the cortical mechanisms of color vision, we recorded from individual primary visual cortex (V1) neurons in macaque monkeys performing a chromatic detection task. Roughly 30% of the neurons that we encountered were unresponsive at the monkeys' psychophysical detection threshold (PT). The other 70% were responsive at threshold but on average, were slightly less sensitive than the monkey. For these neurons, the relationship between neurometric threshold (NT) and PT was consistent across the four isoluminant color directions tested. A corollary of this result is that NTs were roughly four times lower for stimuli that modulated the long- and middle-wavelength sensitive cones out of phase. Nearly one-half of the neurons that responded to chromatic stimuli at the monkeys' detection threshold also responded to high-contrast luminance modulations, suggesting a role for neurons that are jointly tuned to color and luminance in chromatic detection. Analysis of neuronal contrast-response functions and signal-to-noise ratios yielded no evidence for a special set of "cardinal color directions," for which V1 neurons are particularly sensitive. We conclude that at detection threshold--as shown previously with high-contrast stimuli-V1 neurons are tuned for a diverse set of color directions and do not segregate naturally into red-green and blue-yellow categories.

The visual effects of intraocular colored filters

Modern life is associated with a myriad of visual problems, most notably refractive conditions such as myopia. Human ingenuity has addressed such problems using strategies such as spectacle lenses or surgical correction. There are other visual problems, however, that have been present throughout our evolutionary history and are not as easily solved by simply correcting refractive error. These problems include issues like glare disability and discomfort arising from intraocular scatter, photostress with the associated transient loss in vision that arises from short intense light exposures, or the ability to see objects in the distance through a veil of atmospheric haze. One likely biological solution to these more long-standing problems has been the use of colored intraocular filters. Many species, especially diurnal, incorporate chromophores from numerous sources (e.g., often plant pigments called carotenoids) into ocular tissues to improve visual performance outdoors. This review summarizes information on the utility of such filters focusing on chromatic filtering by humans.

Nonlinear analysis of macaque V1 color tuning reveals cardinal directions for cortical color processing

Understanding color vision requires knowing how signals from the three classes of cone photoreceptor are combined in the cortex. We recorded from individual neurons in the primary visual cortex (V1) of awake monkeys while an automated, closed-loop system identified stimuli that differed in cone contrast but evoked the same response. We found that isoresponse surfaces for half the neurons were planar, which is consistent with linear processing. The remaining isoresponse surfaces were nonplanar. Some were cup-shaped, indicating sensitivity to only a narrow region of color space. Others were ellipsoidal, indicating sensitivity to all color directions. The major and minor axes of these nonplanar surfaces were often aligned to a set of three color directions that were previously identified in perceptual experiments. These results suggest that many V1 neurons combine cone signals nonlinearly and provide a new framework in which to decipher color processing in V1.

Neurogeometry of color vision

In neurogeometry, principles of differential geometry and neuron dynamics are used to model the representation of forms in the primary visual cortex, V1. This approach is well-suited for explaining the perception of illusory contours such as Kanizsa's figure (see Petitot (2008) for a review). In its current version, neurogeometry uses achromatic inputs to the visual system as the starting-point for form estimation. Here we ask how neurogeometry operates when the input is chromatic as in color vision. We propose that even when considering only the perception of form, the random nature of the cone mosaic must be taken into account. The main challenge for neurogeometry is to explain how achromatic information could be estimated from the sparse chromatic sampling provided by the cone mosaic. This article also discusses the non-linearity involved in a neural geometry for chromatic processing. We present empirical results on color discrimination to illustrate the geometric complexity for the discrimination contour when the adaptation state of the observer is not conditioned. The underlying non-linear geometry must conciliate both mosaic sampling and regulation of visual information in the visual system.

Combination of texture and color cues in visual segmentation

The visual system can use various cues to segment the visual scene into figure and background. We studied how human observers combine two of these cues, texture and color, in visual segmentation. In our task, the observers identified the orientation of an edge that was defined by a texture difference, a color difference, or both (cue combination). In a fourth condition, both texture and color information were available, but the texture and color edges were not spatially aligned (cue conflict). Performance markedly improved when the edges were defined by two cues, compared to the single-cue conditions. Observers only benefited from the two cues, however, when they were spatially aligned. A simple signal-detection model that incorporates interactions between texture and color processing accounts for the performance in all conditions. In a second experiment, we studied whether the observers are able to ignore a task-irrelevant cue in the segmentation task or whether it interferes with performance. Observers identified the orientation of an edge defined by one cue and were instructed to ignore the other cue. Three types of trial were intermixed: neutral trials, in which the second cue was absent; congruent trials, in which the second cue signaled the same edge as the target cue; and conflict trials, in which the second cue signaled an edge orthogonal to the target cue. Performance improved when the second cue was congruent with the target cue. Performance was impaired when the second cue was in conflict with the target cue, indicating that observers could not discount the second cue. We conclude that texture and color are not processed independently in visual segmentation.

Contrast edge colors under different natural illuminations

Essential to sensory processing in the human visual system is natural illumination, which can vary considerably not only across space but also along the day depending on the atmospheric conditions and the sun's position in the sky. In this work, edges derived from the three postreceptoral Luminance, Red-Green, and Blue-Yellow signals were computed from hyperspectral images of natural scenes rendered with daylights of Correlated Color Temperatures (CCTs) from 2735 to 25,889 K; for low CCT, the same analysis was performed using Planckian illuminants up to 800 K. It was found that average luminance and chromatic edge contrasts were maximal for low correlated color temperatures and almost constants above 10,000 K. The magnitude of these contrast changes was, however, only about 2% across the tested daylights. Results suggest that the postreceptoral opponent and nonopponent color vision mechanisms produce almost constant responses for color edge detection under natural illumination.

1/f Noise in human color vision: the role of S-cone signals

We examine the functional role of S-cone signals on reaction time (RT) variability in human color vision. Stimuli were selected along red-green and blue-yellow cardinal directions and at random directions in the isoluminant plane of the color space. Trial-to-trial RT variability was not statistically independent but correlated across experimental conditions and exhibited 1/f noise spectra with an exponent close to unity in most of the cases. Regarding contrast coding, 1/f noise for random chromatic stimuli at isoluminance was similar to that for achromatic stimuli, thus suggesting that S-cone signals reduce variability of higher order color mechanisms. If we regard spatial coding, the effect of S-cone density in the retina on RT variability was investigated. The magnitude of 1/f noise at 16 min of arc (S-cone free zone) was higher than at 90 min of arc in the blue-yellow channel, and it was similar for the red-green channel. The results suggest that S-cone signals are beneficial and they modulate 1/f noise spectra at postreceptoral stages. The implications related to random multiplicative processes as a possible source of 1/f noise and the optimal information processing in color vision are discussed.

The perceptual balance of color

The cone contrasts carrying different dimensions of color vision vary greatly in magnitude, yet the perceived contrast of color and luminance in the world appears similar. We examined how this perceptual balance is adjusted by adaptation to the contrast in images. Observers set the level of L vs. M and S vs. LM contrast in 1/f noise images to match the perceived strength of a fixed level of luminance contrast. The perceptual balance of color in the images was roughly consistent with the range of contrast characteristic of natural images. Relative perceived contrast could be strongly biased by brief prior exposure to images with lower or higher levels of chromatic contrast. Similar adaptation effects were found for luminance contrast in images of natural scenes. For both, observers reliably chose the contrast balance that appeared correct, and these choices were rapidly recalibrated by adaptation. This recalibration of the norm for contrast could reflect both changes in sensitivity and shifts in criterion. Our results are consistent with the possibility that color mechanisms adjust the range of their responses to match the range of signals in the environment, and that contrast adaptation plays an important role in these adjustments.

Uniform color spaces and natural image statistics

Many aspects of visual coding have been successfully predicted by starting from the statistics of natural scenes and then asking how the stimulus could be efficiently represented. We started from the representation of color characterized by uniform color spaces, and then asked what type of color environment they implied. These spaces are designed to represent equal perceptual differences in color discrimination or appearance by equal distances in the space. The relative sensitivity to different axes within the space might therefore reflect the gamut of colors in natural scenes. To examine this, we projected perceptually uniform distributions within the Munsell, CIE L(*)u(*)v(*) or CIE L(*)a(*)b(*) spaces into cone-opponent space. All were elongated along a bluish-yellowish axis reflecting covarying signals along the L-M and S-(L+M) cardinal axes, a pattern typical (though not identical) to many natural environments. In turn, color distributions from environments were more uniform when projected into the CIE L(*)a(*)b(*) perceptual space than when represented in a normalized cone-opponent space. These analyses suggest the bluish-yellowish bias in environmental colors might be an important factor shaping chromatic sensitivity, and also suggest that perceptually uniform color metrics could be derived from natural scene statistics and potentially tailored to specific environments.

Nonlinear two-stage model for color discrimination

We modified a two-stage model for color discrimination proposed in a previous study [Color Res. Appl.25, 105 (2000)]; in order to extend the model to wider conditions, we considered the conditions with luminance modulations in addition to color modulations. Using the modified model, we successfully predicted color discrimination data with test color changes along both the chromatic and luminance axes under a variety of background colors. Both qualitative and quantitative assessments in modeling showed that nonlinearity is required in both the cone and the cone-opponent stages to interpret adaptation effects of both color and luminance on color discrimination. This fact suggests that the nonlinear properties at each stage have different roles in color perception.

S-cone excitation ratios for reaction times to blue-yellow suprathreshold changes at isoluminance

We examined different contrast metrics to scale visual latencies for suprathreshold stimuli modulated along tritan confusion lines. S-cone increments ('blue') and decrements ('yellow') were isolated along two different tritan confusion lines, each one having a different luminance value. Reaction times (RT) were evaluated as a function of the Weber contrast and the S-cone excitation ratio between the test stimulus and the background. RTs were described using a model that generalizes Piéron's law and incorporates the notion of threshold units and power law scaling. Our results show that RTs for S-cone increments and decrements equate better when using the S-cone excitation ratio. However, a single function did not describe all RT data. S-cone RTs are better described by separate functions. We conclude that S-cone increments and decrements do not scale in the same manner. Both Weber contrast and the S-cone excitation ratio are plausible metrics at isoluminance. The implications for the S-cone pathways are discussed.

Visual pathways and psychophysical channels in the primate

The main cell systems of the retina that provide input to the striate cortex are now well described, although certain aspects of their anatomy and physiology remain contentious. Under simple stimulus conditions and in a threshold context psychophysical performance can often be assigned to one or other of these systems, and an identification of psychophysical channels with afferent pathways is justifiable. However, results from psychophysical studies using more complex stimulus conditions are more difficult to relate to 'front end' channels, and it is more difficult to separate the physiological contributions of afferent pathways from those of cortical mechanisms, in particular the separation of dorsal and ventral streams.