Spatial structure of chromatically opponent receptive fields in the human visual system

Signals from Single-Opponent Cortical Cells in the Human cVEP

We used the chromatic visual evoked potential (cVEP) to study responses in human visual cortex evoked by equiluminant color stimuli for 6 male and 11 female observers. Large-area, colored squares were used to stimulate Single-Opponent cells preferentially, and fine color-checkerboard stimuli were used to activate Double-Opponent responses preferentially. Stimuli were modulated along the following two directions in color space: (1) the cardinal direction, L-M or M-L of DKL (Derrington, Krauskopf, and Lennie) space; and (2) the line from the white point to the color of the Red LED in the display screen, which was approximately intermediate between the L-M and -S directions in DKL space in cone-contrast coordinates. The amplitudes of cVEPs to large squares were smaller than those to checkerboards, and the latency of the cVEP response to squares was significantly less than the checkerboard latency. The latency of cVEP responses to the squares varied little with cone-contrast unlike the steep reduction of latency with cone-contrast observed in responses to color checkerboard patterns. The dynamic differences between cVEPs to squares and checkerboards support the hypothesis that a distinct neuronal mechanism responded to squares: Single-Opponent cells. Response amplitude, latency, and transientness-and their dependence on cone-contrast-were similar in the responses in the L-M and Red color directions. The similarity supports the hypothesis that the Single-Opponent signals in the cVEP come from a distinct population of cells that receives subtractive inputs from L and M cones, either L-M or M-L.SIGNIFICANCE STATEMENT This article is about characterizing the visual behavior of a distinct population of neurons in the human visual cortex, the Single-Opponent color cells. Based on single-cell results in the visual cortex of macaque monkeys, we used large uniformly colored stimuli to isolate the responses of Single-Opponent cells in the chromatic visual evoked potential (cVEP) recorded on the scalp of human observers. VEP signals recorded under conditions believed to reveal Single-Opponent responses are small and transient. Their time course is relatively unaffected by cone-contrast, and they are relatively insensitive to stimulus modulation of short wavelength-sensitive S cones. Because Single-Opponent cells convey signals that can be used to judge the color of scene illumination, knowing their visual properties is important for understanding color vision.

Spatial receptive field structure of double-opponent cells in macaque V1

The spatial processing of color is important for visual perception. Double-opponent (DO) cells likely contribute to this processing by virtue of their spatially opponent and cone-opponent receptive fields (RFs). However, the representation of visual features by DO cells in the primary visual cortex of primates is unclear because the spatial structure of their RFs has not been fully characterized. To fill this gap, we mapped the RFs of DO cells in awake macaques with colorful, dynamic white noise patterns. The spatial RF of each neuron was fitted with a Gabor function and three versions of the difference of Gaussians (DoG) function. The Gabor function provided the more accurate description for most DO cells, a result that is incompatible with a center-surround RF organization. A nonconcentric version of the DoG function, in which the RFs have a circular center and a crescent-shaped surround, performed nearly as well as the Gabor model thus reconciling results from previous reports. For comparison, we also measured the RFs of simple cells. We found that the superiority of the Gabor fits over DoG fits was slightly more decisive for simple cells than for DO cells. The implications of these results on biological image processing and visual perception are discussed.NEW & NOTEWORTHY Double-opponent cells in macaque area V1 respond to spatial chromatic contrast in visual scenes. What information they carry is debated because their receptive field organization has not been characterized thoroughly. Using white noise analysis and statistical model comparisons, De and Horwitz show that many double-opponent receptive fields can be captured by either a Gabor model or a center-with-an-asymmetric-surround model but not by a difference of Gaussians model.

BOLD human responses to chromatic spatial features

Animal physiological and human psychophysical studies suggest that an early step in visual processing involves the detection and identification of features such as lines and edges, by neural mechanisms with even- and odd-symmetric receptive fields. Functional imaging studies also demonstrate mechanisms with even- and odd-receptive fields in early visual areas, in response to luminance-modulated stimuli. In this study we measured fMRI BOLD responses to 2-D stimuli composed of only even or only odd symmetric features, and to an amplitude-matched random noise control, modulated in red-green equiluminant colour contrast. All these stimuli had identical power but different phase spectra, either highly congruent (even or odd symmetry stimuli) or random (noise). At equiluminance, V1 BOLD activity showed no preference between congruent- and random-phase stimuli, as well as no preference between even and odd symmetric stimuli. Areas higher in the visual hierarchy, both along the dorsal pathway (caudal part of the intraparietal sulcus, dorsal LO and V3A) and the ventral pathway (V4), responded preferentially to odd symmetry over even symmetry stimuli, and to congruent over random phase stimuli. Interestingly, V1 showed an equal increase in BOLD activity at each alternation between stimuli of different symmetry, suggesting the existence of specialised mechanisms for the detection of edges and lines such as even- and odd-chromatic receptive fields. Overall the results indicate a high selectivity of colour-selective neurons to spatial phase along both the dorsal and the ventral pathways in humans.

Color in the cortex: single- and double-opponent cells

This is a review of the research during the past 25years on cortical processing of color signals. At the beginning of the period the modular view of cortical processing predominated. However, at present an alternative view, that color and form are linked inextricably in visual cortical processing, is more persuasive than it seemed in 1985. Also, the role of the primary visual cortex, V1, in color processing now seems much larger than it did in 1985. The re-evaluation of the important role of V1 in color vision was caused in part by investigations of human V1 responses to color, measured with functional magnetic resonance imaging, fMRI, and in part by the results of numerous studies of single-unit neurophysiology in non-human primates. The neurophysiological results have highlighted the importance of double-opponent cells in V1. Another new concept is population coding of hue, saturation, and brightness in cortical neuronal population activity.

The orientation selectivity of color-responsive neurons in macaque V1

Form has a strong influence on color perception. We investigated the neural basis of the form-color link in macaque primary visual cortex (V1) by studying orientation selectivity of single V1 cells for pure color patterns. Neurons that responded to color were classified, based on cone inputs and spatial selectivity, into chromatically single-opponent and double-opponent groups. Single-opponent cells responded well to color but weakly to luminance contrast; they were not orientation selective for color patterns. Most double-opponent cells were orientation selective to pure color stimuli as well as to achromatic patterns. We also found non-opponent cells that responded weakly or not at all to pure color; most were orientation selective for luminance patterns. Double-opponent and non-opponent cells' orientation selectivities were not contrast invariant; selectivity usually increased with contrast. Double-opponent cells were approximately equally orientation selective for luminance and equiluminant color stimuli when stimuli were matched in average cone contrast. V1 double-opponent cells could be the neural basis of the influence of form on color perception. The combined activities of single- and double-opponent cells in V1 are needed for the full repertoire of color perception.

The effect of attended color on the P1/N1 component of visual event-related potentials

Ten subjects were asked to pay attention to green or to red, when each visual stimulus was presented as two small squares, one green and the other red. They were instructed to push a button with the right hand, when the attended color was on the right side, and to push a button with the left hand, when the attended color was on the left side. The P1/N1 peak-to-peak amplitudes of visual event-related potentials were significantly higher when subjects focused attention on green rather than on red. We assume that the attended color had the effect of modulating the P1/N1 components.

Visual evoked potentials for red–green gratings reversing at different temporal frequencies: Asymmetries with respect to isoluminance

Human visual evoked potentials (VEPs) were recorded for abrupt reversals of 2 cycles/deg (c/deg) square-wave gratings combining high red–green contrast with different levels of luminance contrast. Response characteristics—2nd harmonic amplitudes and peak latencies as a function of luminance contrast—were compared for four different reversal rates ranging from 6.25 Hz to 12.5 Hz. At every reversal frequency, the VEP amplitude and latency plots were nonsymmetrical with respect to isoluminance. The amplitude dropped to a minimum within a region of rapid phase change, always at a red–green luminance contrast for which the green color had the higher luminance, at about 40% or 50% Michelson luminance contrast. The rapid phase shift around this contrast suggested a sudden change in the relative impact of VEP generators with different latencies, possibly dominated by parvocellular or magnocellular input. The most prominent VEP waveform through most of the luminance contrast range, P110, is interpreted in terms of a parvo-mediated response that is attenuated with increasing reversal frequency. Contrast-dependent changes in the P110 amplitude appear to be responsible for the VEP asymmetries reported here.

Visual evoked potentials for reversals of red–green gratings with different chromatic contrasts: Asymmetries with respect to isoluminance

Human visual evoked potentials (VEPs) were recorded for abrupt 6.25-Hz reversals of 2 c/deg square-wave gratings combining red–green contrast with different levels of luminance contrast. Response characteristics— amplitudes and peak latencies as a function of luminance contrast—were compared for four different pairs of red–green colors and an isochromatic yellow grating. For each of the red–green color pairs, the plots of VEP amplitudes and latencies were nonsymmetrical with respect to isoluminance. The amplitude dropped to a minimum within a region of rapid phase change, at a different contrast for each color pair but always at a luminance contrast for which the greener color had the higher luminance. When the contrast-response curve for each of the four red–green pairs was modeled by a simple |CL− CM| opponency of L- and M-cone contrast using a fixed CL/CMweighting ratio of about two, there was a close correspondence between the contrast giving a null in the modeled response and that giving a minimum in the VEP amplitude. So for the stimulus parameters applied here, the reversal VEP appeared to be dominated by L/M-opponent response contributions for which the signed CL/CM-cone weighting ratio was close to a value of minus two rather than to a value of minus one, which is characteristic of the psychophysical red–green detection mechanism and representative of CL/CMweighting ratios for precortical cells in the parvocellular pathway.

Cone Inputs in Macaque Primary Visual Cortex

To understand the role of primary visual cortex (V1) in color vision, we measured directly the input from the 3 cone types in macaque V1 neurons. Cells were classified as luminance-preferring, color-luminance, or color-preferring from the ratio of the peak amplitudes of spatial frequency responses to red/green equiluminant and to black/white (luminance) grating patterns, respectively. In this study we used L-, M-, and S-cone–isolating gratings to measure spatial frequency response functions for each cone type separately. From peak responses to cone-isolating stimuli we estimated relative cone weights and whether cone inputs were the same or opposite sign. For most V1 cells the relative S-cone weight was <0.1. All color-preferring cells were cone opponent and their L/M cone weight ratio was clustered around a value of –1, which is roughly equal and opposite L and M cone signals. Almost all cells (88%) classified as luminance cells were cone nonopponent, with a broad distribution of cone weights. Most cells (73%) classified as color-luminance cells were cone opponent. This result supports our conclusion that V1 color-luminance cells are double-opponent. Such neurons are more sensitive to color boundaries than to areas of color and thereby could play an important role in color perception. The color-luminance population had a broad distribution of L/M cone weight ratios, implying a broad distribution of preferred colors for the double-opponent cells.

Processing time of contour integration: the role of colour, contrast, and curvature

We investigated the temporal properties of the red - green, blue-yellow, and luminance mechanisms in a contour-integration task which required the linking of orientation across space to detect a 'path'. Reaction times were obtained for simple detection of the stimulus regardless of the presence of a path, and for path detection measured by a yes/no procedure with path and no-path stimuli randomly presented. Additional processing times for contour integration were calculated as the difference between reaction times for simple stimulus detection and path detection, and were measured as a function of stimulus contrast for straight and curved paths. We found that processing time shows effects not apparent in choice reaction-time measurements. (i) Processing time for curved paths is longer than for straight paths. (ii) For straight paths, the achromatic mechanism is faster than the two chromatic ones, with no difference between the red-green and blue-yellow mechanisms. For curved paths there is no difference in processing time between mechanisms. (iii) The extra processing time required to detect curved compared to straight paths is longest for the achromatic mechanism, and similar for the red - green and blue-yellow mechanisms. (iv) Detection of the absence of a path requires at least 50 ms of additional time independently of chromaticity, contrast, and path curvature. The significance of these differences and similarities between postreceptoral mechanisms is discussed.

Normative data for onset VEPs to red-green and blue-yellow chromatic contrast

OBJECTIVE

To better characterize the properties of chromatic VEPs to onset-offset of red-green and blue-yellow equiluminant patterns, and establish normative values for a set of stimuli able to elicit robust and reliable responses, suitable for the clinical application.

METHODS

Chromatic VEPs have been recorded (Oz lead) from 28 normal subjects (age range 20-53 years) in response to monocular presentation of both red-green and blue-yellow equiluminant sinusoidal gratings. Stimuli were generated by a Cambridge VSG/2 card and displayed on a Barco CCID monitor (14x14 deg field size). Spatial frequency, chromaticity, contrast and onset-offset duration were varied.

RESULTS

For both red-green and blue-yellow equiluminant stimuli, robust responses have been obtained with gratings of 2 c/deg, presented in onset (300 ms) offset (700 ms) mode, at contrasts ranging from 90 to 6%. In all observers, the VEP waveform consisted mainly of a negative wave at stimulus onset, with a latency rapidly increasing with decreasing contrast. For both red-green and blue-yellow stimuli, the VEP contrast threshold coincided with the psychophysical threshold.

CONCLUSIONS

The results complement previous studies aimed at characterizing the properties of chromatic VEPs. In addition, normative data are provided for a set of stimulus characteristics suitable for the clinical routine.

Temporal analysis of the chromatic flash VEP--separate colour and luminance contrast components

Temporal analysis of the chromatic flash visual evoked potential (VEP) was studied in human subjects with normal and anomalous colour vision using a deterministic pseudo-random binary stimulus (VERIS). Five experiments were carried out on four normal subjects investigating heterochromatic red-green exchange and single colour/achromatic (either red/grey or green/grey) exchange over a wide range of luminance ratios for the two stimuli, the effects of lowered mean luminance on the chromatic VEP and the effects of colour desaturation at constant mean luminance and constant luminance contrast. Finally, the performance of three dichromats, a protanope and two deuteranopes, on heterochromatic exchange VEP and on colour desaturation were investigated. In contrast to the chromatic electroretinogram, which shows great symmetry with respect to luminance ratio on opposite sides of the isoluminant point, the chromatic VEP demonstrated a distinct asymmetry when the colours exchanged included red. On the red side of isoluminance (red more luminant than green), a wave with longer latency and altered waveform became dominant. The effects of green stimulation were indistinguishable from those of achromatic stimulation at the same luminance contrast over the whole range of chromatic contrast and for all levels of desaturation studied. Desaturation of red with constant luminance contrast (desaturated red/grey stimulation) resulted in a systematic alteration in the evoked waveform. Subtraction of the achromatic first- and second-order responses from responses recorded in the red desaturation series resulted in remarkably uniform waveforms, with peak amplitudes growing linearly with saturation. The absence of interaction between achromatic and coloured components for all (including the most intense colour) stimulus parameters used suggests that the generators of these components are separate. Recordings from the dichromats showed that the contrast response minimum shifted from the point of photopic isoluminance to the point of zero cone contrast (at the silent substitution point) for the remaining cone type. The waveforms recorded with a series of luminance ratios were much simpler than those recorded from trichromats and symmetrical with respect to their isoluminant points. Despite the indication of the presence of L cones of apparently normal spectral sensitivity in the deuteranopes (on the basis of flicker photometry), there was no evidence for a red-sensitive component in the desaturation or heterochromatic stimulation series. The results are discussed in terms of the possibility of separate generation of chromatic and achromatic contributions to the VEP.

Development of the temporal properties of visual evoked potentials to luminance and colour contrast in infants

We have studied the development of the temporal characteristics of the pattern visual evoked potentials (P-VEPs) in response to contrast reversal of patterns of low spatial frequency (0.1 c/deg) of either pure luminance contrast (yellow-black plaid patterns) or pure colour contrast (equiluminant red-green plaid patterns) in 15 infants between 6 and 30 weeks of age. High contrast patterns were modulated temporally either sinusoidally at various temporal frequencies to elicit steady-state responses, or abruptly at a low temporal frequency to elicit transient responses. Analysis of both the transient and steady-state responses suggests the existence of three different mechanisms contributing to the infant and adult P-VEP responses at low, medium and high temporal frequencies. The responses at the three different temporal frequency ranges have different time constants, and develop at different rates. The low frequency response predominates at 8 weeks, where it spans the range 1-6 Hz with an apparent latency of about 230 msec, for both colour and luminance stimulation. This response increases in bandwidth and decreases in latency progressively with age, at a similar rate for luminance and colour contrast, up to 14 weeks. After 14 weeks, the luminance response undergoes major changes, with the emergence of a new response with a shorter latency (about 100 msec) and a peak activity near 10 Hz. This mid-frequency response matures further with age, until it dominates the whole response of the adult P-VEP to luminance contrast. It also makes a contribution to the chromatic response at frequencies above 10 Hz, generating the characteristic double-peaked amplitude response in adults. However, its contribution is very limited below 10 Hz, where the response latency is 140 msec in adults, as it was at 14 weeks of age. A third component is evident at very high temporal frequencies of the luminance response as early as 6 weeks, extending up to 15 Hz in 8-week-olds and up to 25 Hz for older infants. It remains apparent up to 18 weeks, thereafter being swamped by the major mid-frequency response. The apparent latency of response over this frequency range is about 70 msec at all ages. The development of transient P-VEPs paralleled that of the steady-state P-VEPs. At all ages there was an early negative component (N70) at about 70 msec, corresponding to the fast steady-state response at high frequencies for luminance contrast. Before 14 weeks, the luminance and chromatic transient response had the same morphology, with a single major peak of similar latency to the apparent latency of the low temporal frequency response. After this age, the morphology of the luminance response changed, particularly in the first 100 msec, consistent with the emergence of the mid-frequency response. We discuss whether the high-frequency component may represent pre- or early post-synaptic cortical activity, already mature by 8 weeks, and how the different maturation rates of the mid and high-frequency components may reflect different intra-cortical circuitry for colour and luminance.

The role of high-order phase correlations in texture processing

Isodipole textures are pairs of texture ensembles whose autocorrelations, and hence power spectra, are equal. Examples of readily discriminable isodipole textures are well known. Such discriminations appear to require feature extraction, since the isodipole condition eliminates ensemble differences in spatial frequency content. We studied the effects of phase decorrelation on VEP indices of discrimination of isodipole texture pairs. Phase decorrelation, which ranged from 0.125 pi radians (slight randomization) to pi radians (complete randomization), was introduced in two ways: by independent jittering of each spatial Fourier component, and by a product method, which preserved correlations among certain quadruples of spatial Fourier components, despite pairwise decorrelation. For the even/random isodipole texture pair, independent phase decorrelation greater than 0.5 pi radians markedly reduced VEP indices of texture discrimination for all check sizes, and eliminated them entirely for check sizes of 8 min or greater. However, the product method preserved texture discrimination signals even with complete pairwise randomization of spatial phases. For the triangle/random isodipole texture pair, both kinds of phase decorrelation eliminated VEP indices of texture discrimination. These results imply that isodipole texture discrimination is based on fundamentally local processing, and not on global Fourier amplitudes-since the phase manipulations which eliminate texture discrimination preserve the Fourier amplitudes. The dependence of the antisymmetric response component (the odd harmonics) on phase decorrelation and texture type is consistent with a previously proposed model for feature extraction, and leads to constraints on how texture processing is modulated by contrast. The limited contribution of global spectral characteristics for small checks is consistent with a previously identified breakdown in scale-invariant processing.

Sensitivity to spatial phase at equiluminance

We have measured sensitivity for discriminating the spatial phase of multi-harmonic and two-harmonic patterns modulated either in luminance or in chromaticity (red-green). The multi-harmonic patterns were either highpass squarewaves, lines or ramps. For all patterns, contrast thresholds for discriminating 0 from 180 deg phase were similar to those for discriminating -90 from 90 deg, for luminance or chromatic modulation (or both). For all types of multi-harmonic patterns, the ratio of contrast thresholds for the phase discrimination to that for pattern detection was the same for luminance and chromatic modulation, and for combinations of both. Similarly, phase thresholds, the minimum detectable differences in phase (about a mean 0 deg), were the same for chromatic and luminance patterns, provided that contrast was scaled to equate detection thresholds of the patterns. Similar results were observed for simple three-harmonic patterns (f + 2f + 3f), and for (f + 2f) two-harmonic patterns. Strangely, however, two-harmonic patterns of f + 3f (first two terms of square-wave) of moderate to high spatial frequency did show a two-fold advantage for luminance over colour, as Troscianko and Harris (1988) have previously reported (Vision Research, 28, 1041-1049), possibly because the two harmonics have a greater separation in frequency. However, for most classes of patterns, sensitivity for spatial phase is as good for chromatic as for luminance modulation, suggesting that similar sorts of mechanisms operate under these two conditions.

Visual latencies in cytochrome oxidase bands of macaque area V2

Cytochrome oxidase bands in area V2 of the primate visual cortex constitute separate relays for parallel channels relaying information from area V1 to other extrastriate cortical areas. We investigated whether information is transferred at the same speed in the different channels by measuring the latencies of neurons in different cytochrome oxidase bands identified by the presence or absence of retrogradely labeled cells from injections in area V4. Results show that neurons in the thick and pale bands respond 20 msec earlier than those in the thin bands. We also found that color-selective neurons respond later than neurons with no selectivity for color and that direction-selective neurons have shorter latencies than neurons with no selectivity for the direction of stimulus movement.