Color processing in macaque striate cortex: electrophysiological properties

Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity

Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when both pure and mixed selectivity representations are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained "exclusive or" (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity.

Perception of color in primates: A conceptual color neurons hypothesis

Perception of color by humans and other primates is a complex problem, studied by neurophysiology, psychophysiology, psycholinguistics, and even philosophy. Being mostly trichromats, simian primates have three types of opsin proteins, expressed in cone neurons in the eye, which allow for the sensing of color as the physical wavelength of light. Further, in neural networks of the retina, the coding principle changes from three types of sensor proteins to two opponent channels: activity of one type of neuron encode the evolutionarily ancient blue-yellow axis of color stimuli, and another more recent evolutionary channel, encoding the axis of red-green color stimuli. Both color channels are distinctive in neural organization at all levels from the eye to the neocortex, where it is thought that the perception of color (as philosophical qualia) emerges from the activity of some neuron ensembles. Here, using data from neurophysiology as a starting point, we propose a hypothesis on how the perception of color can be encoded in the activity of certain neurons in the neocortex. These conceptual neurons, herein referred to as 'color neurons', code only the hue of the color of visual stimulus, similar to place cells and number neurons, already described in primate brains. A case study with preliminary, but direct, evidence for existing conceptual color neurons in the human brain was published in 2008. We predict that the upcoming studies in non-human primates will be more extensive and provide a more detailed description of conceptual color neurons.

Cone opponent functional domains in primary visual cortex combine signals for color appearance mechanisms

Studies of color perception have led to mechanistic models of how cone-opponent signals from retinal ganglion cells are integrated to generate color appearance. But it is unknown how this hypothesized integration occurs in the brain. Here we show that cone-opponent signals transmitted from retina to primary visual cortex (V1) are integrated through highly organized circuits within V1 to implement the color opponent interactions required for color appearance. Combining intrinsic signal optical imaging (ISI) and 2-photon calcium imaging (2PCI) at single cell resolution, we demonstrate cone-opponent functional domains (COFDs) that combine L/M cone-opponent and S/L + M cone-opponent signals following the rules predicted from psychophysical studies of color perception. These give rise to an orderly organization of hue preferences of the neurons within the COFDs and the generation of hue "pinwheels". Thus, spatially organized neural circuits mediate an orderly transition from cone-opponency to color appearance that begins in V1.

Chromatic micromaps in primary visual cortex

The clustering of neurons with similar response properties is a conspicuous feature of neocortex. In primary visual cortex (V1), maps of several properties like orientation preference are well described, but the functional architecture of color, central to visual perception in trichromatic primates, is not. Here we used two-photon calcium imaging in macaques to examine the fine structure of chromatic representation and found that neurons responsive to spatially uniform, chromatic stimuli form unambiguous clusters that coincide with blobs. Further, these responsive groups have marked substructure, segregating into smaller ensembles or micromaps with distinct chromatic signatures that appear columnar in upper layer 2/3. Spatially structured chromatic stimuli revealed maps built on the same micromap framework but with larger subdomains that go well beyond blobs. We conclude that V1 has an architecture for color representation that switches between blobs and a combined blob/interblob system based on the spatial content of the visual scene.

Stimulus feature maps are found in primary visual cortex of many species. Here the authors show color maps in trichromatic primates containing segregated ensembles of neurons with distinct chromatic signatures that associate with cortical modules known as blobs.

Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4

The perception of color is an internal label for the inferred spectral reflectance of visible surfaces. To study how spectral representation is transformed through modular subsystems of successive cortical areas, we undertook simultaneous optical imaging of intrinsic signals in macaque V1, V2, and V4, supplemented by higher-resolution electrophysiology and two-photon imaging in awake macaques. We find a progressive evolution in the scale and precision of chromotopic maps, expressed by a uniform blob-like architecture of hue responses within each area. Two-photon imaging reveals enhanced hue-specific cell clustering in V2 compared with V1. A phenomenon of endspectral (red and blue) responses that is clear in V1, recedes in V2, and is virtually absent in V4. The increase in mid- and extra-spectral hue representations through V2 and V4 reflects the nature of hierarchical processing as higher areas read out locations in chromatic space from progressive integration of signals relayed by V1.

Columnar organization of mid-spectral and end-spectral hue preferences in human visual cortex

Multiple color-selective areas have been described in visual cortex, in both humans and non-human primates. In macaques, hue-selective columns have been reported in several areas. In V2, it has been proposed that such hue-selective columns are mapped so as to mirror the order of wavelength through the visible spectrum, within thin-type stripes. Other studies have suggested a neural segregation of mid-spectral vs. end-spectral hue preferences (e.g. red and blue vs. green and yellow), within thin- and thick-type stripes, respectively. This latter segregation could reduce the spatial 'blur' due to chromatic aberration in the encoding of fine spatial details in the thick-type stripes. To distinguish between these and related models, we tested the organization of hue preferences in human visual cortex using fMRI at high spatial resolution. We used a high field (7T) scanner in humans (n = 7), measuring responses to four independent hues, including end-spectral (i.e. red-gray and blue-gray) and mid-spectral (i.e. green-gray and yellow-gray) isoluminant gratings, and also relative to achromatic luminance-varying (control) stimuli. In each subject, thin- and thick-type columns in V2 and V3 were localized using an independent set of stimuli and scans. We found distinct hue-selective differences along the dimension of mid-vs. end-spectral hues, in striate and early extrastriate visual cortex. First, as reported previously in macaques, V1 responded more strongly to end-spectral hues, compared to mid-spectral hues. Second, the color-selective thin-type stripes in V2 and V3 showed a greater response to end- and mid-spectral hues, relative to luminance-varying gratings. Third, thick-type stripes in V2/V3 showed a significantly stronger response to mid-spectral (compared to end-spectral) hues. Fourth, in the higher-tier color-selective area in occipital temporal cortex (n = 4), responses to all four hues were statistically equivalent to each other. These results suggest that early visual cortex segregates the processing of mid-vs. end-spectral hues, perhaps to counter the challenging optical constraint of chromatic aberration.

Neurochemical responses to chromatic and achromatic stimuli in the human visual cortex

In the present study, we aimed at determining the metabolic responses of the human visual cortex during the presentation of chromatic and achromatic stimuli, known to preferentially activate two separate clusters of neuronal populations (called "blobs" and "interblobs") with distinct sensitivity to color or luminance features. Since blobs and interblobs have different cytochrome-oxidase (COX) content and micro-vascularization level (i.e., different capacities for glucose oxidation), different functional metabolic responses during chromatic vs. achromatic stimuli may be expected. The stimuli were optimized to evoke a similar load of neuronal activation as measured by the bold oxygenation level dependent (BOLD) contrast. Metabolic responses were assessed using functional ¹H MRS at 7 T in 12 subjects. During both chromatic and achromatic stimuli, we observed the typical increases in glutamate and lactate concentration, and decreases in aspartate and glucose concentration, that are indicative of increased glucose oxidation. However, within the detection sensitivity limits, we did not observe any difference between metabolic responses elicited by chromatic and achromatic stimuli. We conclude that the higher energy demands of activated blobs and interblobs are supported by similar increases in oxidative metabolism despite the different capacities of these neuronal populations.

Binocular vs. monocular hue perception

Hue perception has been shown to differ for the same stimulus when presented to the temporal and the nasal areas of the retina. The present study investigated perceptual differences in stimuli viewed binocularly or monocularly in the peripheral retina to determine how hue information combines across the two retinas for a stimulus falling on the temporal retina of one eye and the nasal retina of the other. A hue-scaling procedure was utilized to ascertain hue perception for three color- and binocular-normal observers viewing monochromatic stimuli (450-670nm, 20nm steps) ranging in size from 1.0° to 3.7°. Peripherally-presented binocular stimuli fell upon the nasal retina of one eye and the temporal retina of the other. Hue-scaling results indicated that peripheral binocular hue and saturation perceptions for smaller stimuli were more similar to those of stimuli falling on the temporal retina in the monocular condition. Hue-scaling data were also used to determine perceptive field sizes for the four elemental hues. Binocular perceptive field sizes were more similar to those obtained for stimuli falling on the temporal retina in the monocular conditions. Eye dominance did not appear to have an effect on hue perception. The results seem to indicate that visual information from the temporal retina is weighted more heavily when information from the two eyes is combined cortically. This finding may relate to differences in V1 cortical activation for stimuli presented to the nasal retina versus the temporal retina.

Specificity of V1-V2 orientation networks in the primate visual cortex

The computation of texture and shape involves integration of features of various orientations. Orientation networks within V1 tend to involve cells which share similar orientation selectivity. However, emergent properties in V2 require the integration of multiple orientations. We now show that, unlike interactions within V1, V1-V2 orientation interactions are much less synchronized and are not necessarily orientation dependent. We find V1-V2 orientation networks are of two types: a more tightly synchronized, orientation-preserving network and a less synchronized orientation-diverse network. We suggest that such diversity of V1-V2 interactions underlies the spatial and functional integration required for computation of higher order contour and shape in V2.

Chromatic and Achromatic Spatial Resolution of Local Field Potentials in Awake Cortex

Local field potentials (LFPs) have become an important measure of neuronal population activity in the brain and could provide robust signals to guide the implant of visual cortical prosthesis in the future. However, it remains unclear whether LFPs can detect weak cortical responses (e.g., cortical responses to equiluminant color) and whether they have enough visual spatial resolution to distinguish different chromatic and achromatic stimulus patterns. By recording from awake behaving macaques in primary visual cortex, here we demonstrate that LFPs respond robustly to pure chromatic stimuli and exhibit ∼2.5 times lower spatial resolution for chromatic than achromatic stimulus patterns, a value that resembles the ratio of achromatic/chromatic resolution measured with psychophysical experiments in humans. We also show that, although the spatial resolution of LFP decays with visual eccentricity as is also the case for single neurons, LFPs have higher spatial resolution and show weaker response suppression to low spatial frequencies than spiking multiunit activity. These results indicate that LFP recordings are an excellent approach to measure spatial resolution from local populations of neurons in visual cortex including those responsive to color.

Feature integration and object representations along the dorsal stream visual hierarchy

The visual system is split into two processing streams: a ventral stream that receives color and form information and a dorsal stream that receives motion information. Each stream processes that information hierarchically, with each stage building upon the previous. In the ventral stream this leads to the formation of object representations that ultimately allow for object recognition regardless of changes in the surrounding environment. In the dorsal stream, this hierarchical processing has classically been thought to lead to the computation of complex motion in three dimensions. However, there is evidence to suggest that there is integration of both dorsal and ventral stream information into motion computation processes, giving rise to intermediate object representations, which facilitate object selection and decision making mechanisms in the dorsal stream. First we review the hierarchical processing of motion along the dorsal stream and the building up of object representations along the ventral stream. Then we discuss recent work on the integration of ventral and dorsal stream features that lead to intermediate object representations in the dorsal stream. Finally we propose a framework describing how and at what stage different features are integrated into dorsal visual stream object representations. Determining the integration of features along the dorsal stream is necessary to understand not only how the dorsal stream builds up an object representation but also which computations are performed on object representations instead of local features.

Color opponent receptive fields self-organize in a biophysical model of visual cortex via spike-timing dependent plasticity

Although many computational models have been proposed to explain orientation maps in primary visual cortex (V1), it is not yet known how similar clusters of color-selective neurons in macaque V1/V2 are connected and develop. In this work, we address the problem of understanding the cortical processing of color information with a possible mechanism of the development of the patchy distribution of color selectivity via computational modeling. Each color input is decomposed into a red, green, and blue representation and transmitted to the visual cortex via a simulated optic nerve in a luminance channel and red-green and blue-yellow opponent color channels. Our model of the early visual system consists of multiple topographically-arranged layers of excitatory and inhibitory neurons, with sparse intra-layer connectivity and feed-forward connectivity between layers. Layers are arranged based on anatomy of early visual pathways, and include a retina, lateral geniculate nucleus, and layered neocortex. Each neuron in the V1 output layer makes synaptic connections to neighboring neurons and receives the three types of signals in the different channels from the corresponding photoreceptor position. Synaptic weights are randomized and learned using spike-timing-dependent plasticity (STDP). After training with natural images, the neurons display heightened sensitivity to specific colors. Information-theoretic analysis reveals mutual information between particular stimuli and responses, and that the information reaches a maximum with fewer neurons in the higher layers, indicating that estimations of the input colors can be done using the output of fewer cells in the later stages of cortical processing. In addition, cells with similar color receptive fields form clusters. Analysis of spiking activity reveals increased firing synchrony between neurons when particular color inputs are presented or removed (ON-cell/OFF-cell).

Mixing of Chromatic and Luminance Retinal Signals in Primate Area V1

Vision emerges from activation of chromatic and achromatic retinal channels whose interaction in visual cortex is still poorly understood. To investigate this interaction, we recorded neuronal activity from retinal ganglion cells and V1 cortical cells in macaques and measured their visual responses to grating stimuli that had either luminance contrast (luminance grating), chromatic contrast (chromatic grating), or a combination of the two (compound grating). As with parvocellular or koniocellular retinal ganglion cells, some V1 cells responded mostly to the chromatic contrast of the compound grating. As with magnocellular retinal ganglion cells, other V1 cells responded mostly to the luminance contrast and generated a frequency-doubled response to equiluminant chromatic gratings. Unlike magnocellular and parvocellular retinal ganglion cells, V1 cells formed a unimodal distribution for luminance/color preference with a 2- to 4-fold bias toward luminance. V1 cells associated with positive local field potentials in deep layers showed the strongest combined responses to color and luminance and, as a population, V1 cells encoded a diverse combination of luminance/color edges that matched edge distributions of natural scenes. Taken together, these results suggest that the primary visual cortex combines magnocellular and parvocellular retinal inputs to increase cortical receptive field diversity and to optimize visual processing of our natural environment.

V1 mechanisms underlying chromatic contrast detection

To elucidate the cortical mechanisms of color vision, we recorded from individual primary visual cortex (V1) neurons in macaque monkeys performing a chromatic detection task. Roughly 30% of the neurons that we encountered were unresponsive at the monkeys' psychophysical detection threshold (PT). The other 70% were responsive at threshold but on average, were slightly less sensitive than the monkey. For these neurons, the relationship between neurometric threshold (NT) and PT was consistent across the four isoluminant color directions tested. A corollary of this result is that NTs were roughly four times lower for stimuli that modulated the long- and middle-wavelength sensitive cones out of phase. Nearly one-half of the neurons that responded to chromatic stimuli at the monkeys' detection threshold also responded to high-contrast luminance modulations, suggesting a role for neurons that are jointly tuned to color and luminance in chromatic detection. Analysis of neuronal contrast-response functions and signal-to-noise ratios yielded no evidence for a special set of "cardinal color directions," for which V1 neurons are particularly sensitive. We conclude that at detection threshold--as shown previously with high-contrast stimuli-V1 neurons are tuned for a diverse set of color directions and do not segregate naturally into red-green and blue-yellow categories.

Orientation tuning of cytochrome oxidase patches in macaque primary visual cortex

The abundant concentration of cytochrome oxidase in patches or blobs of primate striate cortex has never been explained. Patches are thought to contain unoriented, color-opponent neurons. Lacking orientation selectivity, these cells might endow patches with high metabolic activity because they respond to all contours in visual scenes. To test this idea, we measured orientation tuning in layer 2/3 of macaque cortical area V1 using acutely implanted 100-electrode arrays. Each electrode recording site was identified and assigned to the patch or interpatch compartment. The mean orientation bandwidth of cells was 28.4° in patches and 25.8° in interpatches. Neurons in patches were indeed less orientation selective, but the difference was subtle, indicating that the processing of form and color is not strictly segregated in V1. The most conspicuous finding was that patch cells had a 49% greater overall firing rate. This global difference in neuronal responsiveness, rather than an absence of orientation tuning, may account for the rich mitochondrial enzyme activity that defines patches.

Color in the cortex: single- and double-opponent cells

This is a review of the research during the past 25years on cortical processing of color signals. At the beginning of the period the modular view of cortical processing predominated. However, at present an alternative view, that color and form are linked inextricably in visual cortical processing, is more persuasive than it seemed in 1985. Also, the role of the primary visual cortex, V1, in color processing now seems much larger than it did in 1985. The re-evaluation of the important role of V1 in color vision was caused in part by investigations of human V1 responses to color, measured with functional magnetic resonance imaging, fMRI, and in part by the results of numerous studies of single-unit neurophysiology in non-human primates. The neurophysiological results have highlighted the importance of double-opponent cells in V1. Another new concept is population coding of hue, saturation, and brightness in cortical neuronal population activity.

Images perceived after chromatic or achromatic contrast sensitivity losses

PURPOSE

We simulate how subjects with losses in chromatic and achromatic contrast sensitivity perceive colored images by using the spatiochromatic corresponding pair algorithm.

METHODS

This is a generalized version of the algorithm by Capilla et al. (J Opt Soc Am (A) 2004;21:176-186) for simulating color perception of color deviant subjects, which incorporates a simple spatial vision model, consisting of a linear filtering stage, with a band-pass achromatic filter and two low-pass chromatic ones, for the red-green and blue-yellow mechanisms. These filters, except for the global scaling, are the subject's contrast sensitivity functions measured along the cardinal directions of the color space. In its present form, the algorithm would serve to simulate alterations both in the spectral sensitivities and in the contrast sensitivities of the visual mechanisms.

RESULTS

After a preliminary theoretical study on the effect of frequency selective and overall reductions in the contrast sensitivity function of a single mechanism, we present cases of real subjects with glaucoma and diabetes, suffering alterations of different magnitude in the three mechanisms.

CONCLUSIONS

The simulations allow us to learn about the different types of distortions that can be experienced by a subject with impaired contrast sensitivities (blur, haloes, color shifts, local or global contrast, brightness and colorfulness reductions, etc.) and highlight the difficulties arising when trying to predict the quality of the final image from the losses in the individual mechanisms.

Mapping of contextual modulation in the population response of primary visual cortex

We review the evidence of long-range contextual modulation in V1. Populations of neurons in V1 are activated by a wide variety of stimuli outside of their classical receptive fields (RF), well beyond their surround region. These effects generally involve extra-RF features with an orientation component. The population mapping of orientation preferences to the upper layers of V1 is well understood, as far as the classical RF properties are concerned, and involves organization into pinwheel-like structures. We introduce a novel hypothesis regarding the organization of V1's contextual response. We show that RF and extra-RF orientation preferences are mapped in related ways. Orientation pinwheels are the foci of both types of features. The mapping of contextual features onto the orientation pinwheel has a form that recapitulates the organization of the visual field: an iso-orientation patch within the pinwheel also responds to extra-RF stimuli of the same orientation. We hypothesize that the same form of mapping applies to other stimulus properties that are mapped out in V1, such as colour and contrast selectivity. A specific consequence is that fovea-like properties will be mapped in a systematic way to orientation pinwheels. We review the evidence that cytochrome oxidase blobs comprise the foci of this contextual remapping for colour and low contrasts. Neurodynamics and motion in the visual field are argued to play an important role in the shaping and maintenance of this type of mapping in V1.

Clustered cortical organization and the enhanced probability of intra-areal functional integration

Similarly responsive neurons organize into submillimeter-sized clusters (domains) across many neocortical areas, notably in Areas V1 and V2 of primate visual cortex. While this clustered organization may arise from wiring minimization or from self-organizing development, it could potentially support important neural computation benefits. Here, we suggest that domain organization offers an efficient computational mechanism for intra-areal functional integration in certain cortical areas and hypothesize that domain proximity could support a higher-than-expected spatial correlation of their respective terminals yielding higher probabilities of integration of differing domain preferences. To investigate this hypothesis we devised a spatial model inspired by known parameters of V2 functional organization, where neighboring domains prefer either colored or oriented stimuli. Preference-selective joint probabilities were calculated for model terminal co-occurrence with configurations encompassing diverse domain proximity, shape, and projection. Compared to random distributions, paired neighboring domains (< or =1200 microm apart) yielded significantly enhanced coincidence of terminals converging from each domain. Using this reference data, a second larger-scale model indicated that V2 domain organization may accommodate relatively complete sets of intra-areal color/orientation integrations. Together, these data indicate that domain organization could support significant and efficient intra-areal integration of different preferences and suggest further experiments investigating prevalence and mechanisms of domain-mediated intra-areal integration.

Functional organization of color domains in V1 and V2 of macaque monkey revealed by optical imaging

Areas V1 and V2 of Macaque monkey visual cortex are characterized by unique cytochrome-oxidase (CO)-staining patterns. Initial electrophysiological studies associated CO blobs in V1 with processing of surface properties such as color and brightness and the interblobs with contour information processing. However, many subsequent studies showed controversial results, some supporting this proposal and others failing to find significant functional differences between blobs and interblobs. In this study, we have used optical imaging to map color-selective responses in V1 and V2. In V1, we find striking "blob-like" patterns of color response. Fine alignment of optical maps and CO-stained tissue revealed that color domains in V1 strongly associate with CO blobs. We also find color domains in V1 align along centers of ocular dominance columns. Furthermore, color blobs in V1 have low orientation selectivity and do not overlap with centers of orientation domains. In V2, color domains coincide with thin stripes; orientation-selective domains coincide with thick and pale stripes. We conclude that color and orientation-selective responses are preferentially located in distinct CO compartments in V1 and V2. We propose that the term "blob" encompasses both the concept of "CO blob" and "color domain" in V1.

The machinery of colour vision

Some fundamental principles of colour vision, deduced from perceptual studies, have been understood for a long time. Physiological studies have confirmed the existence of three classes of cone photoreceptors, and of colour-opponent neurons that compare the signals from cones, but modern work has drawn attention to unexpected complexities of early organization: the proportions of cones of different types vary widely among individuals, without great effect on colour vision; the arrangement of different types of cones in the mosaic seems to be random, making it hard to optimize the connections to colour-opponent mechanisms; and new forms of colour-opponent mechanisms have recently been discovered. At a higher level, in the primary visual cortex, recent studies have revealed a simpler organization than had earlier been supposed, and in some respects have made it easier to reconcile physiological and perceptual findings.

Optical imaging of contrast response in Macaque monkey V1 and V2

Our studies on brightness information processing in Macaque monkey visual cortex suggest that the thin stripes in the secondary visual area (V2) are preferentially activated by brightness stimuli (such as full field luminance modulation and illusory edge-induced brightness modulation). To further examine this possibility, we used intrinsic signal optical imaging to examine contrast response of different functional domains in primary and secondary visual areas (V1 and V2). Color and orientation stimuli were used to map functional domains in V1 (color domains, orientation domains) and V2 (thin stripes, thick/pale stripes). To examine contrast response, sinusoidal gratings at different contrasts and spatial frequencies were presented. We find that, consistent with previous studies, the optical signal increased systematically with contrast level. Unlike single-unit responses, optical signals for both color domains and orientation domains in V1 exhibit linear contrast response functions, thereby providing a large dynamic range for V1 contrast response. In contrast to domains in V1, domains in V2 exhibit nonlinear responses, characterized by high gain at low contrasts, saturating at a mid-high contrast levels. At high contrasts, thin stripes exhibit increasing response, whereas thick/pale stripes saturate, consistent with a strong parvocellular input to thin stripes. These findings suggest that, with respect to contrast encoding, thin stripes have a larger dynamic range than thick/pale stripes and further support a role for thin stripes in processing of brightness information.

Hue maps in primate striate cortex

The macaque striate cortex (V1) contains neurons that respond preferentially to various hues. The properties of these hue-selective neurons have been studied extensively at the single-unit level, but it is unclear how stimulus hue is represented by the distribution of activity across neuronal populations in V1. Here we use the intrinsic optical signal to image V1 responses to spatially uniform stimuli of various hues. We found that (1) each of these stimuli activates an array of patches in the supragranular layers of the parafoveal V1; (2) the patches activated by different hues overlapped partially; 3) the peak locations of these patches were determined by stimulus hue. The peaks associated with various hues form well-separated clusters, in which nearby peaks represent perceptually similar hues. Each cluster represents a full gamut of hue in a small cortical area ( approximately 160 microm long). The hue order is preserved within each peak cluster, but the clusters have various geometrical shapes. These clusters were co-localized with regions that responded preferentially to chromatic gratings compared with achromatic ones. Our results suggest that V1 contains an array of hue maps, in which the hue of a stimulus is represented by the location of the peak response to the stimulus. The orderly, organized hue maps in V1, together with the recently discovered hue maps in the extrastriate cortical area V2, are likely to play an important role in hue perception in primates.

Optical imaging of functional organization of V1 and V2 in marmoset visual cortex

Using optical imaging of intrinsic cortical signals, we examined the functional organization of visual cortical areas V1 and V2 of the marmoset (Callithrix jacchus). Previous studies have reported that adult marmosets do not have ocular dominance columns (ODCs); however, recent studies have called this into question. Using optical imaging methods, we examined whether ODCs could be detected in adult marmosets. We found evidence for functional ODCs in some marmosets but not in others. The activation patterns, when present, were relatively weak and appeared as a mosaic of irregular bands or islands. Consistent with studies in other New World monkeys, these data suggest the presence of ODC variability within the marmoset population. Orientation maps in V1 revealed iso-orientation domains organized in semicontinuous bands oriented orthogonal to the V1/V2 border, a pattern unlike that in Macaque monkey. The presence of directional preference maps in V1 was also suggested. In V2, similar to V2 in Macaque monkeys, stripe-like regions of orientation selectivity overlay the pale cytochrome oxidase regions of V2; zones not selective for orientation overlay the cytochrome thin stripes. However, unlike Macaques, we did not observe clear evidence for orientation maps overlying thick cytochrome oxidase stripes. In sum, our data suggest that significant organizational differences exist between the organization of V1 and V2 in the marmoset and that of Old World primates. Implications for the establishment of functional ocular dominance columns, the coestablishment of multiple featural maps, and cortical magnification factors are discussed.

Predicting the stream of consciousness from activity in human visual cortex

Can the rapid stream of conscious experience be predicted from brain activity alone? Recently, spatial patterns of activity in visual cortex have been successfully used to predict feature-specific stimulus representations for both visible and invisible stimuli. However, because these studies examined only the prediction of static and unchanging perceptual states during extended periods of stimulation, it remains unclear whether activity in early visual cortex can also predict the rapidly and spontaneously changing stream of consciousness. Here, we used binocular rivalry to induce frequent spontaneous and stochastic changes in conscious experience without any corresponding changes in sensory stimulation, while measuring brain activity with fMRI. Using information that was present in the multivariate pattern of responses to stimulus features, we could accurately predict, and therefore track, participants' conscious experience from the fMRI signal alone while it underwent many spontaneous changes. Prediction in primary visual cortex primarily reflected eye-based signals, whereas prediction in higher areas reflected the color of the percept. Furthermore, accurate prediction during binocular rivalry could be established with signals recorded during stable monocular viewing, showing that prediction generalized across viewing conditions and did not require or rely on motor responses. It is therefore possible to predict the dynamically changing time course of subjective experience with only brain activity.

Coding of color and form in the geniculostriate visual pathway (invited review)

We review how neurons in the principal pathway connecting the retina to the visual cortex represent information about the chromatic and spatial characteristics of the retinal image. Our examination focuses particularly on individual neurons: what are their visual properties, how might these properties arise, what do these properties tell us about visual signal transformations, and how might these properties be expressed in perception? Our discussion is inclined toward studies on old-world monkeys and where possible emphasizes quantitative work that has led to or illuminates models of visual signal processing.

Adaptation of oriented and unoriented color-selective neurons in human visual areas

Primary visual cortex contains at least two distinct populations of color-selective cells: neurons in one have circularly symmetric receptive fields and respond best to reddish and greenish light, while neurons in another have oriented receptive fields and a variety of color preferences. The relative prevalence and perceptual roles of the two kinds of neurons remain controversial, however. We used fMRI and a selective adaptation technique to measure responses attributable to these two populations. The technique revealed evidence of adaptation in both populations and indicated that they each produced strong signals in V1 and other human visual areas. The activity of both sets of neurons was also reflected in color appearance measurements made with the same stimuli. Thus, both oriented and unoriented color-selective cells in V1 are important components of the neural pathways that underlie perception of color.

Functional architecture of retinotopy in visual association cortex of behaving monkey

While the receptive field properties of single neurons in the inferior parietal cortex have been quantitatively described from numerous electrical measurements, the visual topography of area 7a and the adjacent dorsal prelunate area (DP) remains unknown. This lacuna may be a technical byproduct of the difficulty of reconstructing tens to hundreds of penetrations, or may be the result of varying functional retinotopic architectures. Intrinsic optical imaging, performed in behaving monkey for extended periods of time, was used to evaluate retinotopy simultaneously at multiple positions across the cortical surface. As electrical recordings through an implanted artificial dura are difficult, the measurement and quantification of retinotopy with long-term recordings was validated by imaging early visual cortex (areas V1 and V2). Retinotopic topography was found in each of the three other areas studied within a single day's experiment. However, the ventral portion of DP (DPv) had a retinotopic topography that varied from day to day, while the more dorsal aspects (DPd) exhibited consistent retinotopy. This suggests that the dorsal prelunate gyrus may consist of more than one visual area. The retinotopy of area 7a also varied from day to day. Possible mechanisms for this variability across days are discussed as well as its impact upon our understanding of the representation of extrapersonal space in the inferior parietal cortex.

Blue-Yellow Signals Are Enhanced by Spatiotemporal Luminance Contrast in Macaque V1

We measured the color tuning of a population of S-cone-driven V1 neurons in awake, fixating monkeys. Analysis of randomly chosen color stimuli that were effective in evoking action potentials showed that these neurons received opposite sign input from the S cones and a combination of L and M cones. Surprisingly, these cells also responded to LM cone contrast irrespective of polarity, a nonlinear sensitivity that was masked by conventional linear analysis methods. Taken together, these observations can be summarized in a nonlinear model that combines nonopponent and opponent signals such that luminance contrast enhances color processing. These findings indicate that important aspects of the cortical representation of color cannot be described by classical linear analysis, and reveal a possible neural correlate of perceptual color-luminance interactions.

Cortical processing of a brightness illusion

Several brightness illusions indicate that borders can affect the perception of surfaces dramatically. In the Cornsweet illusion, two equiluminant surfaces appear to be different in brightness because of the contrast border between them. Here, we report the existence of cells in monkey visual cortex that respond to such an "illusory" brightness. We find that luminance responsive cells are located in color-activated regions (cytochrome oxidase blobs and bridges) of primary visual cortex (V1), whereas Cornsweet responsive cells are found preferentially in the color-activated regions (thin stripes) of second visual area (V2). This colocalization of brightness and color processing within V1 and V2 suggests a segregation of contour and surface processing in early visual pathways and a hierarchy of brightness information processing from V1 to V2 in monkeys.

Functional organization of visual cortex in the owl monkey

In this study, we compared the organization of orientation preference in visual areas V1, V2, and V3. Within these visual areas, we also quantified the relationship between orientation preference and cytochrome oxidase (CO) staining patterns. V1 maps of orientation preference contained both pinwheels and linear zones. The location of CO blobs did not relate in a systematic way to maps of orientation; although, as in other primates, there were approximately twice as many pinwheels as CO blobs. V2 contained bands of high and low orientation selectivity. The bands of high orientation selectivity were organized into pinwheels and linear zones, but iso-orientation domains were twice as large as those in V1. Quantitative comparisons between bands containing high or low orientation selectivity and CO dark and light bands suggested that at least four functional compartments exist in V2, CO dense bands with either high or low orientation selectivity, and CO light bands with either high or low selectivity. We also demonstrated that two functional compartments exist in V3, with zones of high orientation selectivity corresponding to CO dense areas and zones of low orientation selectivity corresponding to CO pale areas. Together with previous findings, these results suggest that the modular organization of V1 is similar across primates and indeed across most mammals. V2 organization in owl monkeys also appears similar to that of other simians but different from that of prosimians and other mammals. Finally, V3 of owl monkeys shows a compartmental organization for orientation selectivity that remains to be demonstrated in other primates.

Interactions of chromaticity and luminance in edge identification depend on chromaticity

The goal of this work was to study interactions of chromaticity and luminance in edge identification. Two horizontal spatial sawtooth patterns, one with positive and the other with negative harmonics, were compared in a two-alternative forced-choice (2-AFC) procedure. The observer identified which pattern had sharp upper or lower edges. The fundamental frequency was 2 cycles/deg (cpd), with 5 cycles presented in a 2.5-deg square field. The pattern was presented as a 1-s raised temporal cosine, replacing part of an 8-deg background. Stimuli were specified in a cone troland (l, s, Y) chromaticity space, with correction for individual equiluminance at a nominal 115 td, and individual tritan direction. A preliminary set of interleaved staircases established edge identification for the six directions of the (l, s, Y) space. Three compound stimuli combining two orthogonal directions were chosen and included with the end-points in five randomly interleaved staircases. For combinations of Y with l-chromaticity, or l- with s-chromaticity, probability summation was observed. Combinations of Y with s-chromaticity revealed opponency. Data for +s, +Y and -s, -Y were subadditive; data for +s, -Y and -s, +Y were additive. Control studies using detection rather than edge identification revealed probability summation for all combinations. Luminance edges did not enhance stimuli with l-chromaticities. There was an interaction of luminance edges with s-chromaticities. Dim "blues" and bright "yellows" showed linear summation. Bright "blues" and dim "yellows" showed opponency.

Projections from primary visual cortex to cytochrome oxidase thin stripes and interstripes of macaque visual area 2

It has been controversial whether the cytochrome oxidase (CO)-dense blobs in primate primary visual cortex (V1) and CO-dense thin stripes in visual area 2 (V2) are parts of a cortical color-processing stream that is segregated from other functional streams. One of the key pieces of evidence for the segregated color stream is the previous report of specific connections between blobs and thin stripes, which is parallel to the connections between interblobs and interstripes. To study the degree of the segregation between the proposed different streams, in the current study, anatomical tracers were injected into different V2 compartments with the functional guidance of optical imaging. The spatial relationship between each labeled cell and the CO blobs in V1 were analyzed quantitatively. After tracer injections in the color-preferring modules in CO thin stripes, equal amounts of labeled cells were found in the blobs and interblobs. However, the density of the labeled cells was more than twice as high in the blobs as that in the interblobs, and most of the clusters of labeled cells partially overlapped with the blobs. Tracer injections in the interstripes labeled cells predominantly in the interblobs. Our results suggest that both the blobs and interblobs project to the thin stripes and call into question the proposition that different CO compartments in V1 and V2 are connected in parallel to form highly segregated functional streams.

Color vision

Color vision starts with the absorption of light in the retinal cone photoreceptors, which transduce electromagnetic energy into electrical voltages. These voltages are transformed into action potentials by a complicated network of cells in the retina. The information is sent to the visual cortex via the lateral geniculate nucleus (LGN) in three separate color-opponent channels that have been characterized psychophysically, physiologically, and computationally. The properties of cells in the retina and LGN account for a surprisingly large body of psychophysical literature. This suggests that several fundamental computations involved in color perception occur at early levels of processing. In the cortex, information from the three retino-geniculate channels is combined to enable perception of a large variety of different hues. Furthermore, recent evidence suggests that color analysis and coding cannot be separated from the analysis and coding of other visual attributes such as form and motion. Though there are some brain areas that are more sensitive to color than others, color vision emerges through the combined activity of neurons in many different areas.

Distribution of non-phosphorylated neurofilament in squirrel monkey V1 is complementary to the pattern of cytochrome-oxidase blobs

The geniculo-recipient zones of the primate primary visual cortex (V1) stain more strongly for cytochrome oxidase (CO) than other regions. Labeling V1 with an antibody (SMI-32) against neurofilament protein produces a laminar pattern that is largely complementary to that of CO: the layers that receive the strongest geniculate input react weakly for SMI-32. We evaluated whether the complementary laminar relationship extends throughout the superficial layers where there are regularly spaced blobs of dark CO staining that are known to receive geniculate input. In all hemispheres, neurofilament labeling in the superficial layers was indeed complementary to the CO pattern. The density of SMI-32 labeled neurons was quantified and found to be greater within the CO interblobs than in the blobs. These results demonstrate that blobs and interblobs can be distinguished by examining the pattern of neurofilament expression in V1. That neurofilament expression is highest within interblobs raises the possibility that the distribution of cell types may be non-uniform across blobs and interblobs.

Color processing in macaque striate cortex: relationships to ocular dominance, cytochrome oxidase, and orientation

We located clusters of color-selective neurons in macaque striate cortex, as mapped with optical imaging and confirmed with electrophysiological recordings. By comparing responses to an equiluminant red/green stimulus versus a high-contrast luminance stimulus, we were able to reveal a patchy distribution of color selectivity. Other color imaging protocols, when compared with electrophysiological data, did not reliably indicate the location of functional structures. The imaged color patches were compared with other known functional subdivisions of striate cortex. There was a high degree of overlap of the color patches with the cytochrome-oxidase (CO) blobs. The patches were often larger than a single blob in size, however, and in some instances spanned two neighboring blobs. More than one-half (56%) of the color-selective patches seen in optical imaging were not confined to one ocular dominance (OD) column. Almost one-quarter of color patches (23%) extended across OD columns to encompass two blobs of different eye preference. We also compared optical images of orientation selectivity to maps of color selectivity. Results indicate that the layout of orientation and color selectivity are not directly related. Specifically, despite having similar scales and distributions, the maps of orientation and color selectivity were not in consistent alignment or registration. Further, we find that the maps of color selectivity and of orientation are each only loosely related to maps of OD. This description stands in contrast to a common depiction of color-selective regions as identical to CO blobs, appearing as pegs in the centers of OD columns in the classical "ice cube" model. These results concerning the pattern of color selectivity in V1 support the view (put forth in previous imaging studies of the organization of orientation and ocular dominance) that there is not a fundamental registration of functional hypercolumns in V1.