Color architecture in alert macaque cortex revealed by FMRI

Sleep-deprived residents and rapid picture naming performance using the Mobile Universal Lexicon Evaluation System (MULES) test

Objective

The Mobile Universal Lexicon Evaluation System (MULES) is a rapid picture naming task that captures extensive brain networks involving neurocognitive, afferent/efferent visual, and language pathways. Many of the factors captured by MULES may be abnormal in sleep-deprived residents. This study investigates the effect of sleep deprivation in post-call residents on MULES performance.

Methods

MULES, consisting of 54 color photographs, was administered to a cohort of neurology residents taking 24-hour in-hospital call (n = 18) and a group of similar-aged controls not taking call (n = 18). Differences in times between baseline and follow-up MULES scores were compared between the two groups.

Results

MULES time change in call residents was significantly worse (slower) from baseline (mean 1.2 s slower) compared to non-call controls (mean 11.2 s faster) (P < 0.001, Wilcoxon rank sum test). The change in MULES time from baseline was significantly correlated to the change in subjective level of sleepiness for call residents and to the amount of sleep obtained in the 24 h prior to follow-up testing for the entire cohort. For call residents, the duration of sleep obtained during call did not significantly correlate with change in MULES scores. There was no significant correlation between MULES change and sleep quality questionnaire score for the entire cohort.

Conclusion

The MULES is a novel test for effects of sleep deprivation on neurocognition and vision pathways. Sleep deprivation significantly worsens MULES performance. Subjective sleepiness may also affect MULES performance. MULES may serve as a useful performance assessment tool for sleep deprivation in residents.

•

MULES is a rapid picture naming test that captures extensive brain networks.

•

MULES performance is impaired in sleep deprived residents.

•

Subjective sleepiness may also affect MULES performance.

•

MULES may serve as an assessment tool for sleep deprivation in residents.

Color for object recognition: Hue and chroma sensitivity in the deep features of convolutional neural networks

In this work, we examined the color tuning of units in the hidden layers of AlexNet, VGG-16 and VGG-19 convolutional neural networks and their relevance for the successful recognition of an object. We first selected the patches for which the units are maximally responsive among the 1.2 M images of the ImageNet training dataset. We segmented these patches using a k-means clustering algorithm on their chromatic distribution. Then we independently varied the color of these segments, both in hue and chroma, to measure the unit's chromatic tuning. The models exhibited properties at times similar or opposed to the known chromatic processing of biological system. We found that, similarly to the most anterior occipital visual areas in primates, the last convolutional layer exhibited high color sensitivity. We also found the gradual emergence of single to double opponent kernels. Contrary to cells in the visual system, however, these kernels were selective for hues that gradually transit from being broadly distributed in early layers, to mainly falling along the blue-orange axis in late layers. In addition, we found that the classification performance of our models varies as we change the color of our stimuli following the models' kernels properties. Performance was highest for colors the kernels maximally responded to, and images responsible for the activation of color sensitive kernels were more likely to be mis-classified as we changed their color. These observations were shared by all three networks, thus suggesting that they are general properties of current convolutional neural networks trained for object recognition.

Scotopic Vision Is Selectively Processed in Thick-Type Columns in Human Extrastriate Cortex

In humans, visual stimuli can be perceived across an enormous range of light levels. Evidence suggests that different neural mechanisms process different subdivisions of this range. For instance, in the retina, stimuli presented at very low (scotopic) light levels activate rod photoreceptors, whereas cone photoreceptors are activated relatively more at higher (photopic) light levels. Similarly, different retinal ganglion cells are activated by scotopic versus photopic stimuli. However, in the brain, it remains unknown whether scotopic versus photopic information is: 1) processed in distinct channels, or 2) neurally merged. Using high-resolution functional magnetic resonance imaging at 7 T, we confirmed the first hypothesis. We first localized thick versus thin-type columns within areas V2, V3, and V4, based on photopic selectivity to motion versus color, respectively. Next, we found that scotopic stimuli selectively activated thick- (compared to thin-) type columns in V2 and V3 (in measurements of both overlap and amplitude) and V4 (based on overlap). Finally, we found stronger resting-state functional connections between scotopically dominated area MT with thick- (compared to thin-) type columns in areas V2, V3, and V4. We conclude that scotopic stimuli are processed in partially segregated parallel streams, emphasizing magnocellular influence, from retina through middle stages of visual cortex.

Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4

The perception of color is an internal label for the inferred spectral reflectance of visible surfaces. To study how spectral representation is transformed through modular subsystems of successive cortical areas, we undertook simultaneous optical imaging of intrinsic signals in macaque V1, V2, and V4, supplemented by higher-resolution electrophysiology and two-photon imaging in awake macaques. We find a progressive evolution in the scale and precision of chromotopic maps, expressed by a uniform blob-like architecture of hue responses within each area. Two-photon imaging reveals enhanced hue-specific cell clustering in V2 compared with V1. A phenomenon of endspectral (red and blue) responses that is clear in V1, recedes in V2, and is virtually absent in V4. The increase in mid- and extra-spectral hue representations through V2 and V4 reflects the nature of hierarchical processing as higher areas read out locations in chromatic space from progressive integration of signals relayed by V1.

The persistent problem of targetless thought

Targetless thought raises a persistent problem for higher-order theories of consciousness. In cases of targetless thought, a subject represents herself as being in a mental state that she in fact lacks. One popular response among proponents of the higher-order theory is to say that it can appear to a subject that she is in a conscious mental state, even though that mental state doesn't exist (Picciuto, 2017; Rosenthal 1997, 2011; Weisberg, 2010). Recently Brown and Lau (2019) and Lau and Rosenthal (2011) have shifted the debate to empirical ground, and offered evidence for real-world cases of targetless thought. In this paper, I give an alternate explanation of the evidence which avoids the need to posit targetless thoughts. As I argue, this challenges the empirical argument for the higher-order view because it shows that the evidence on offer does not discriminate between the first-order and higher-order theories of consciousness.

Rapid picture naming in Parkinson's disease using the Mobile Universal Lexicon Evaluation System (MULES)

OBJECTIVE

The Mobile Universal Lexicon Evaluation System (MULES) is a test of rapid picture naming that captures extensive brain networks, including cognitive, language and afferent/efferent visual pathways. MULES performance is slower in concussion and multiple sclerosis, conditions in which vision dysfunction is common. Visual aspects captured by the MULES may be impaired in Parkinson's disease (PD) including color discrimination, object recognition, visual processing speed, and convergence. The purpose of this study was to compare MULES time scores for a cohort of PD patients with those for a control group of participants of similar age. We also sought to examine learning effects for the MULES by comparing scores for two consecutive trials within the patient and control groups.

METHODS

MULES consists of 54 colored pictures (fruits, animals, random objects). The test was administered in a cohort of PD patients and in a group of similar aged controls. Wilcoxon rank-sum tests were used to determine statistical significance for differences in MULES time scores between PD patients and controls. Spearman rank-correlation coefficients were calculated to examine the relation between MULES time scores and PD motor symptom severity (UPDRS). Learning effects were assessed using Wilcoxon rank-sum tests.

RESULTS

Among 51 patients with PD (median age 70 years, range 52-82) and 20 disease-free control participants (median age 67 years, range 51-90), MULES scores were significantly slower (worse performance) in PD patients (median 63.2 s, range 37.3-296.3) vs. controls (median 53.9 s, range 37.5-128.6, P = .03, Wilcoxon rank-sum test). Slower MULES times were associated with increased motor symptom severity as measured by the Unified Parkinson's Disease Rating Scale, Section III (r_s = 0.37, P = .02). Learning effects were greater among patients with PD (median improvement of 14.8 s between two MULES trials) compared to controls (median 7.4 s, P = .004).

CONCLUSION

The MULES is a complex test of rapid picture naming that captures numerous brain pathways including an extensive visual network. MULES performance is slower in patients with PD and our study suggests an association with the degree of motor impairment. Future studies will determine the relation of MULES time scores to other modalities that test visual function and structure in PD.

Color statistics of objects, and color tuning of object cortex in macaque monkey

We hypothesized that the parts of scenes identified by human observers as “objects” show distinct color properties from backgrounds, and that the brain uses this information towards object recognition. To test this hypothesis, we examined the color statistics of naturally and artificially colored objects and backgrounds in a database of over 20,000 images annotated with object labels. Objects tended to be warmer colored (L-cone response > M-cone response) and more saturated compared to backgrounds. That the distinguishing chromatic property of objects was defined mostly by the L-M post-receptoral mechanism, rather than the S mechanism, is consistent with the idea that trichromatic color vision evolved in response to a selective pressure to identify objects. We also show that classifiers trained using only color information could distinguish animate versus inanimate objects, and at a performance level that was comparable to classification using shape features. Animate/inanimate is considered a fundamental superordinate category distinction, previously thought to be computed by the brain using only shape information. Our results show that color could contribute to animate/inanimate, and likely other, object-category assignments. Finally, color-tuning measured in two macaque monkeys with functional magnetic resonance imaging (fMRI), and confirmed by fMRI-guided microelectrode recording, supports the idea that responsiveness to color reflects the global functional organization of inferior temporal cortex, the brain region implicated in object vision. More strongly in IT than in V1, colors associated with objects elicited higher responses than colors less often associated with objects.

Neural Coding for Shape and Texture in Macaque Area V4

The distinct visual sensations of shape and texture have been studied separately in cortex; therefore, it remains unknown whether separate neuronal populations encode each of these properties or one population carries a joint encoding. We directly compared shape and texture selectivity of individual V4 neurons in awake macaques (1 male, 1 female) and found that V4 neurons lie along a continuum from strong tuning for boundary curvature of shapes to strong tuning for perceptual dimensions of texture. Among neurons tuned to both attributes, tuning for shape and texture were largely separable, with the latter delayed by ∼30 ms. We also found that shape stimuli typically evoked stronger, more selective responses than did texture patches, regardless of whether the latter were contained within or extended beyond the receptive field. These results suggest that there are separate specializations in mid-level cortical processing for visual attributes of shape and texture.SIGNIFICANCE STATEMENT Object recognition depends on our ability to see both the shape of the boundaries of objects and properties of their surfaces. However, neuroscientists have never before examined how shape and texture are linked together in mid-level visual cortex. In this study, we used systematically designed sets of simple shapes and texture patches to probe the responses of individual neurons in the primate visual cortex. Our results provide the first evidence that some cortical neurons specialize in processing shape whereas others specialize in processing textures. Most neurons lie between the ends of this continuum, and in these neurons we find that shape and texture encoding are largely independent.

Single-cell responses to three-dimensional structure in a functionally defined patch in macaque area TEO

Both dorsal and ventral visual pathways harbor several areas sensitive to gradients of binocular disparity (i.e., higher-order disparity). Although a wealth of information exists about disparity processing in early visual (V1, V2, and V3) and end-stage areas, TE in the ventral stream, and the anterior intraparietal area (AIP) in the dorsal stream, little is known about midlevel area TEO in the ventral pathway. We recorded single-unit responses to disparity-defined curved stimuli in a functional magnetic resonance imaging (fMRI) activation elicited by curved surfaces compared with flat surfaces in the macaque area TEO. This fMRI activation contained a small proportion of disparity-selective neurons, with very few of them second-order disparity selective. Overall, this population of TEO neurons did not preserve its three-dimensional structure selectivity across positions in depth, indicating a lack of higher-order disparity selectivity, but showed stronger responses to flat surfaces than to curved surfaces, as predicted by the fMRI experiment. The receptive fields of the responsive TEO cells were relatively small and generally foveal. A linear support vector machine classifier showed that this population of disparity-selective TEO neurons contains reliable information about the sign of curvature and the position in depth of the stimulus. NEW & NOTEWORTHY We recorded in a part of the macaque area TEO that is activated more by curved surfaces than by flat surfaces at different disparities using the same stimuli. In contrast to previous studies, this functional magnetic resonance imaging-defined patch did not contain a large number of higher-order disparity-selective neurons. However, a linear support vector machine could reliably classify both the sign of the disparity gradient and the position in depth of the stimuli.

Mobile Universal Lexicon Evaluation System (MULES) in MS: Evaluation of a new visual test of rapid picture naming

OBJECTIVE

The Mobile Universal Lexicon Evaluation System (MULES) is a test of rapid picture naming that is under investigation for concussion. MULES captures an extensive visual network, including pathways for eye movements, color perception, memory and object recognition. The purpose of this study was to introduce the MULES to visual assessment of patients with MS, and to examine associations with other tests of afferent and efferent visual function.

METHODS

We administered the MULES in addition to binocular measures of low-contrast letter acuity (LCLA), high-contrast visual acuity (VA) and the King-Devick (K-D) test of rapid number naming in an MS cohort and in a group of disease-free controls.

RESULTS

Among 24 patients with MS (median age 36 years, range 20-72, 64% female) and 22 disease-free controls (median age 34 years, range 19-59, 57% female), MULES test times were greater (worse) among the patients (60.0 vs. 40.0 s). Accounting for age, MS vs. control status was a predictor of MULES test times (P = .01, logistic regression). Faster testing times were noted among patients with MS who had greater (better) performance on binocular LCLA at 2.5% contrast (P < .001, linear regression, accounting for age), binocular high-contrast VA (P < .001), and K-D testing (P < .001). Both groups demonstrated approximately 10-s improvements in MULES test times between trials 1 and 2 (P < .0001, paired t-tests).

CONCLUSION

The MULES test, a complex task of rapid picture naming involves an extensive visual network that captures eye movements, color perception and the characterization of objects. Color recognition, a key component of this novel assessment, is early in object processing and requires area V4 and the inferior temporal projections. MULES scores reflect performance of LCLA, a widely-used measure of visual function in MS clinical trials. These results provide evidence that the MULES test can add efficient visual screening to the assessment of patients with MS.

Consciousness, Representation, Action: The Importance of Being Goal-Directed

Recent years have witnessed fierce debates on the dependence of consciousness on interactions between a subject and the environment. Reviewing neuroscientific, computational, and clinical evidence, I will address three questions. First, does conscious experience necessarily depend on acute interactions between a subject and the environment? Second, does it depend on specific perception-action loops in the longer run? Third, which types of action does consciousness cohere with, if not with all of them? I argue that conscious contents do not necessarily depend on acute or long-term brain-environment interactions. Instead, consciousness is proposed to be specifically associated with, and subserve, deliberate, goal-directed behavior (GDB). Brain systems implied in conscious representation are highly connected to, but distinct from, neural substrates mediating GDB and declarative memory.

Integration of color, orientation, and size functional domains in the ventral pathway

Functional specialization within the extrastriate areas of the ventral pathway associated with visual form analysis is poorly understood. Studies comparing the functional selectivities of neurons within the early visual areas have found that there are more similar than different between the areas. We simultaneously imaged visually evoked activation over regions of V2 and V4 and parametrically varied three visual attributes for which selectivity exists in both areas: color, orientation, and size. We found that color selective regions were observed in both areas and were of similar size and spatial distribution. However, two major areal distinctions were observed: V4 contained a greater number and diversity of color-specific regions than V2 and exhibited a higher degree of overlap between domains for different functional attributes. In V2, size and color regions were largely segregated from orientation domains, whereas in V4 both color and size regions overlapped considerably with orientation regions. Our results suggest that higher-order composite selectivities in the extrastriate cortex may arise organically from the interactions afforded by an overlap of functional domains for lower order selectivities.

The Constancy of Colored After-Images

We undertook psychophysical experiments to determine whether the color of the after-image produced by viewing a colored patch which is part of a complex multi-colored scene depends on the wavelength-energy composition of the light reflected from that patch. Our results show that it does not. The after-image, just like the color itself, depends on the ratio of light of different wavebands reflected from it and its surrounds. Hence, traditional accounts of after-images as being the result of retinal adaptation or the perceptual result of physiological opponency, are inadequate. We propose instead that the color of after-images is generated after colors themselves are generated in the visual brain.

Representation of Glossy Material Surface in Ventral Superior Temporal Sulcal Area of Common Marmosets

The common marmoset (Callithrix jacchus) is one of the smallest species of primates, with high visual recognition abilities that allow them to judge the identity and quality of food and objects in their environment. To address the cortical processing of visual information related to material surface features in marmosets, we presented a set of stimuli that have identical three-dimensional shapes (bone, torus or amorphous) but different material appearances (ceramic, glass, fur, leather, metal, stone, wood, or matte) to anesthetized marmoset, and recorded multiunit activities from an area ventral to the superior temporal sulcus (STS) using multi-shanked, and depth resolved multi-electrode array. Out of 143 visually responsive multiunits recorded from four animals, 29% had significant main effect only of the material, 3% only of the shape and 43% of both the material and the shape. Furthermore, we found neuronal cluster(s), in which most cells: (1) showed a significant main effect in material appearance; (2) the best stimulus was a glossy material (glass or metal); and (3) had reduced response to the pixel-shuffled version of the glossy material images. The location of the gloss-selective area was in agreement with previous macaque studies, showing activation in the ventral bank of STS. Our results suggest that perception of gloss is an important ability preserved across wide range of primate species.

Functional interactions between the macaque dorsal and ventral visual pathways during three-dimensional object vision

The division of labor between the dorsal and the ventral visual stream in the primate brain has inspired numerous studies on the visual system in humans and in nonhuman primates. However, how and under which circumstances the two visual streams interact is still poorly understood. Here we review evidence from anatomy, modelling, electrophysiology, electrical microstimulation (EM), reversible inactivation and functional imaging in the macaque monkey aimed at clarifying at which levels in the hierarchy of visual areas the two streams interact, and what type of information might be exchanged between the two streams during three-dimensional (3D) object viewing. Neurons in both streams encode 3D structure from binocular disparity, synchronized activity between parietal and inferotemporal areas is present during 3D structure categorization, and clusters of 3D structure-selective neurons in parietal cortex are anatomically connected to ventral stream areas. In addition, caudal intraparietal cortex exerts a causal influence on 3D-structure related activations in more anterior parietal cortex and in inferotemporal cortex. Thus, both anatomical and functional evidence indicates that the dorsal and the ventral visual stream interact during 3D object viewing.

Is Color Experience Cognitively Penetrable?

Is color experience cognitively penetrable? Some philosophers have recently argued that it is. In this paper, we take issue with the claim that color experience is cognitively penetrable. We argue that the notion of cognitive penetration that has recently dominated the literature is flawed since it fails to distinguish between the modulation of perceptual content by non-perceptual principles and genuine cognitive penetration. We use this distinction to show that studies suggesting that color experience can be modulated by factors of the cognitive system do not establish that color experience is cognitively penetrable. Additionally, we argue that even if color experience turns out to be modulated by color-related beliefs and knowledge beyond non-perceptual principles, it does not follow that color experience is cognitively penetrable since the experiences of determinate hues involve post-perceptual processes. We conclude with a brief discussion of the implications that these ideas may have on debates in philosophy.

Representation of Perceptual Color Space in Macaque Posterior Inferior Temporal Cortex (the V4 Complex)

The lateral geniculate nucleus is thought to represent color using two populations of cone-opponent neurons [L vs M; S vs (L + M)], which establish the cardinal directions in color space (reddish vs cyan; lavender vs lime). How is this representation transformed to bring about color perception? Prior work implicates populations of glob cells in posterior inferior temporal cortex (PIT; the V4 complex), but the correspondence between the neural representation of color in PIT/V4 complex and the organization of perceptual color space is unclear. We compared color-tuning data for populations of glob cells and interglob cells to predictions obtained using models that varied in the color-tuning narrowness of the cells, and the color preference distribution across the populations. Glob cells were best accounted for by simulated neurons that have nonlinear (narrow) tuning and, as a population, represent a color space designed to be perceptually uniform (CIELUV). Multidimensional scaling and representational similarity analyses showed that the color space representations in both glob and interglob populations were correlated with the organization of CIELUV space, but glob cells showed a stronger correlation. Hue could be classified invariant to luminance with high accuracy given glob responses and above-chance accuracy given interglob responses. Luminance could be read out invariant to changes in hue in both populations, but interglob cells tended to prefer stimuli having luminance contrast, regardless of hue, whereas glob cells typically retained hue tuning as luminance contrast was modulated. The combined luminance/hue sensitivity of glob cells is predicted for neurons that can distinguish two colors of the same hue at different luminance levels (orange/brown).

Color-Biased Regions of the Ventral Visual Pathway Lie between Face- and Place-Selective Regions in Humans, as in Macaques

The existence of color-processing regions in the human ventral visual pathway (VVP) has long been known from patient and imaging studies, but their location in the cortex relative to other regions, their selectivity for color compared with other properties (shape and object category), and their relationship to color-processing regions found in nonhuman primates remain unclear. We addressed these questions by scanning 13 subjects with fMRI while they viewed two versions of movie clips (colored, achromatic) of five different object classes (faces, scenes, bodies, objects, scrambled objects). We identified regions in each subject that were selective for color, faces, places, and object shape, and measured responses within these regions to the 10 conditions in independently acquired data. We report two key findings. First, the three previously reported color-biased regions (located within a band running posterior-anterior along the VVP, present in most of our subjects) were sandwiched between face-selective cortex and place-selective cortex, forming parallel bands of face, color, and place selectivity that tracked the fusiform gyrus/collateral sulcus. Second, the posterior color-biased regions showed little or no selectivity for object shape or for particular stimulus categories and showed no interaction of color preference with stimulus category, suggesting that they code color independently of shape or stimulus category; moreover, the shape-biased lateral occipital region showed no significant color bias. These observations mirror results in macaque inferior temporal cortex (Lafer-Sousa and Conway, 2013), and taken together, these results suggest a homology in which the entire tripartite face/color/place system of primates migrated onto the ventral surface in humans over the course of evolution.

SIGNIFICANCE STATEMENT

Here we report that color-biased cortex is sandwiched between face-selective and place-selective cortex on the bottom surface of the brain in humans. This face/color/place organization mirrors that seen on the lateral surface of the temporal lobe in macaques, suggesting that the entire tripartite system is homologous between species. This result validates the use of macaques as a model for human vision, making possible more powerful investigations into the connectivity, precise neural codes, and development of this part of the brain. In addition, we find substantial segregation of color from shape selectivity in posterior regions, as observed in macaques, indicating a considerable dissociation of the processing of shape and color in both species.

Population Code Dynamics in Categorical Perception

Categorical perception is a ubiquitous function in sensory information processing, and is reported to have important influences on the recognition of presented and/or memorized stimuli. However, such complex interactions among categorical perception and other aspects of sensory processing have not been explained well in a unified manner. Here, we propose a recurrent neural network model to process categorical information of stimuli, which approximately realizes a hierarchical Bayesian estimation on stimuli. The model accounts for a wide variety of neurophysiological and cognitive phenomena in a consistent framework. In particular, the reported complexity of categorical effects, including (i) task-dependent modulation of neural response, (ii) clustering of neural population representation, (iii) temporal evolution of perceptual color memory, and (iv) a non-uniform discrimination threshold, are explained as different aspects of a single model. Moreover, we directly examine key model behaviors in the monkey visual cortex by analyzing neural population dynamics during categorization and discrimination of color stimuli. We find that the categorical task causes temporally-evolving biases in the neuronal population representations toward the focal colors, which supports the proposed model. These results suggest that categorical perception can be achieved by recurrent neural dynamics that approximates optimal probabilistic inference in the changing environment.

Cortical response to categorical color perception in infants investigated by near-infrared spectroscopy

Perceptual color space is continuous; however, we tend to divide it into only a small number of categories. It is unclear whether categorical color perception is obtained solely through the development of the visual system or whether it is affected by language acquisition. To address this issue, we recruited prelinguistic infants (5- to 7-mo-olds) to measure changes in brain activity in relation to categorical color differences by using near-infrared spectroscopy (NIRS). We presented two sets of geometric figures to infants: One set altered in color between green and blue, and the other set altered between two different shades of green. We found a significant increase in hemodynamic responses during the between-category alternations, but not during the within-category alternations. These differences in hemodynamic response based on categorical relationship were observed only in the bilateral occipitotemporal regions, and not in the occipital region. We confirmed that categorical color differences yield behavioral differences in infants. We also observed comparable hemodynamic responses to categorical color differences in adults. The present study provided the first evidence, to our knowledge, that colors of different categories are represented differently in the visual cortex of prelinguistic infants, which implies that color categories may develop independently before language acquisition.

Representation of the material properties of objects in the visual cortex of nonhuman primates

Information about the material from which objects are made provide rich and useful clues that enable us to categorize and identify those objects, know their state (e.g., ripeness of fruits), and properly act on them. However, despite its importance, little is known about the neural processes that underlie material perception in nonhuman primates. Here we conducted an fMRI experiment in awake macaque monkeys to explore how information about various real-world materials is represented in the visual areas of monkeys, how these neural representations correlate with perceptual material properties, and how they correspond to those in human visual areas that have been studied previously. Using a machine-learning technique, the representation in each visual area was read out from multivoxel patterns of regional activity elicited in response to images of nine real-world material categories (metal, wood, fur, etc.). The congruence of the neural representations with either a measure of low-level image properties, such as spatial frequency content, or with the visuotactile properties of materials, such as roughness, hardness, and warmness, were tested. We show that monkey V1 shares a common representation with human early visual areas reflecting low-level image properties. By contrast, monkey V4 and the posterior inferior temporal cortex represent the visuotactile properties of material, as in human ventral higher visual areas, although there were some interspecies differences in the representational structures. We suggest that, in monkeys, V4 and the posterior inferior temporal cortex are important stages for constructing information about the material properties of objects from their low-level image features.

A tweaking principle for executive control: neuronal circuit mechanism for rule-based task switching and conflict resolution

A hallmark of executive control is the brain's agility to shift between different tasks depending on the behavioral rule currently in play. In this work, we propose a "tweaking hypothesis" for task switching: a weak rule signal provides a small bias that is dramatically amplified by reverberating attractor dynamics in neural circuits for stimulus categorization and action selection, leading to an all-or-none reconfiguration of sensory-motor mapping. Based on this principle, we developed a biologically realistic model with multiple modules for task switching. We found that the model quantitatively accounts for complex task switching behavior: switch cost, congruency effect, and task-response interaction; as well as monkey's single-neuron activity associated with task switching. The model yields several testable predictions, in particular, that category-selective neurons play a key role in resolving sensory-motor conflict. This work represents a neural circuit model for task switching and sheds insights in the brain mechanism of a fundamental cognitive capability.

Perceptual color map in macaque visual area V4

Colors distinguishable with trichromatic vision can be defined by a 3D color space, such as red-green-blue or hue-saturation-lightness (HSL) space, but it remains unclear how the cortex represents colors along these dimensions. Using intrinsic optical imaging and electrophysiology, and systematically choosing color stimuli from HSL coordinates, we examined how perceptual colors are mapped in visual area V4 in behaving macaques. We show that any color activates 1-4 separate cortical patches within "globs," millimeter-sized color-preferring modules. Most patches belong to different hue or lightness clusters, in which sequential representations follow the color order in HSL space. Some patches overlap greatly with those of related colors, forming stacks, possibly representing invariable features, whereas few seem positioned irregularly. However, for any color, saturation increases the activity of all its patches. These results reveal how the color map in V4 is organized along the framework of the perceptual HSL space, whereupon different multipatch activity patterns represent different colors. We propose that such distributed and combinatorial representations may expand the encodable color space of small cortical maps and facilitate binding color information to other image features.

Categorical clustering of the neural representation of color

Cortical activity was measured with functional magnetic resonance imaging (fMRI) while human subjects viewed 12 stimulus colors and performed either a color-naming or diverted attention task. A forward model was used to extract lower dimensional neural color spaces from the high-dimensional fMRI responses. The neural color spaces in two visual areas, human ventral V4 (V4v) and VO1, exhibited clustering (greater similarity between activity patterns evoked by stimulus colors within a perceptual category, compared to between-category colors) for the color-naming task, but not for the diverted attention task. Response amplitudes and signal-to-noise ratios were higher in most visual cortical areas for color naming compared to diverted attention. But only in V4v and VO1 did the cortical representation of color change to a categorical color space. A model is presented that induces such a categorical representation by changing the response gains of subpopulations of color-selective neurons.

Reflections on agranular architecture: predictive coding in the motor cortex

•

Predictive coding explains the recursive hierarchical structure of cortical processes.

•

Granular layer 4, which relays ascending cortical pathways, is absent from motor cortex.

•

Perceptual inference results if ascending sensory data modify sensory predictions action, if spinal reflexes enact descending motor and/or proprioceptive predictions.

•

Motor layer 4 regresses as motor predictions inherently require less modification.

The agranular architecture of motor cortex lacks a functional interpretation. Here, we consider a ‘predictive coding’ account of this unique feature based on asymmetries in hierarchical cortical connections. In sensory cortex, layer 4 (the granular layer) is the target of ascending pathways. We theorise that the operation of predictive coding in the motor system (a process termed ‘active inference’) provides a principled rationale for the apparent recession of the ascending pathway in motor cortex. The extension of this theory to interlaminar circuitry also accounts for a sub-class of ‘mirror neuron’ in motor cortex – whose activity is suppressed when observing an action –explaining how predictive coding can gate hierarchical processing to switch between perception and action.

Parallel, multi-stage processing of colors, faces and shapes in macaque inferior temporal cortex

Visual-object processing culminates in inferior temporal cortex (IT). To assess the organization of IT, we measured functional magnetic resonance imaging responses in alert monkeys to achromatic images (faces, fruit, bodies and places) and colored gratings. IT contained multiple color-biased regions, which were typically ventral to face patches and yoked to them, spaced regularly at four locations predicted by known anatomy. Color and face selectivity increased for more anterior regions, indicative of a broad hierarchical arrangement. Responses to non-face shapes were found across IT, but were stronger outside color-biased regions and face patches, consistent with multiple parallel streams. IT also contained multiple coarse eccentricity maps: face patches overlapped central representations, color-biased regions spanned mid-peripheral representations and place-biased regions overlapped peripheral representations. These results show that IT comprises parallel, multi-stage processing networks subject to one organizing principle.

Binocular stereoscopy in visual areas V-2, V-3, and V-3A of the macaque monkey

Over 40 years ago, Hubel and Wiesel gave a preliminary report of the first account of cells in monkey cerebral cortex selective for binocular disparity. The cells were located outside of V-1 within a region referred to then as "area 18." A full-length manuscript never followed, because the demarcation of the visual areas within this region had not been fully worked out. Here, we provide a full description of the physiological experiments and identify the locations of the recorded neurons using a contemporary atlas generated by functional magnetic resonance imaging; we also perform an independent analysis of the location of the neurons relative to an anatomical landmark (the base of the lunate sulcus) that is often coincident with the border between V-2 and V-3. Disparity-tuned cells resided not only in V-2, the area now synonymous with area 18, but also in V-3 and probably within V-3A. The recordings showed that the disparity-tuned cells were biased for near disparities, tended to prefer vertical orientations, clustered by disparity preference, and often required stimulation of both eyes to elicit responses, features strongly suggesting a role in stereoscopic depth perception.

Color signals through dorsal and ventral visual pathways

Explanations for color phenomena are often sought in the retina, lateral geniculate nucleus, and V1, yet it is becoming increasingly clear that a complete account will take us further along the visual-processing pathway. Working out which areas are involved is not trivial. Responses to S-cone activation are often assumed to indicate that an area or neuron is involved in color perception. However, work tracing S-cone signals into extrastriate cortex has challenged this assumption: S-cone responses have been found in brain regions, such as the middle temporal (MT) motion area, not thought to play a major role in color perception. Here, we review the processing of S-cone signals across cortex and present original data on S-cone responses measured with fMRI in alert macaque, focusing on one area in which S-cone signals seem likely to contribute to color (V4/posterior inferior temporal cortex) and on one area in which S signals are unlikely to play a role in color (MT). We advance a hypothesis that the S-cone signals in color-computing areas are required to achieve a balanced neural representation of perceptual color space, whereas those in noncolor-areas provide a cue to illumination (not luminance) and confer sensitivity to the chromatic contrast generated by natural daylight (shadows, illuminated by ambient sky, surrounded by direct sunlight). This sensitivity would facilitate the extraction of shape-from-shadow signals to benefit global scene analysis and motion perception.

Sensory perception: lessons from synesthesia: using synesthesia to inform the understanding of sensory perception

Synesthesia, the conscious, idiosyncratic, repeatable, and involuntary sensation of one sensory modality in response to another, is a condition that has puzzled both researchers and philosophers for centuries. Much time has been spent proving the condition's existence as well as investigating its etiology, but what can be learned from synesthesia remains a poorly discussed topic. Here, synaesthesia is presented as a possible answer rather than a question to the current gaps in our understanding of sensory perception. By first appreciating the similarities between normal sensory perception and synesthesia, one can use what is known about synaesthesia, from behavioral and imaging studies, to inform our understanding of "normal" sensory perception. In particular, in considering synesthesia, one can better understand how and where the different sensory modalities interact in the brain, how different sensory modalities can interact without confusion - the binding problem - as well as how sensory perception develops.

Neural selectivity and representation of gloss in the monkey inferior temporal cortex

When we view an object, its appearance depends in large part on specific surface reflectance properties; among these is surface gloss, which provides important information about the material composition of the object and the fine structure of its surface. To study how gloss is represented in the visual cortical areas related to object recognition, we examined the responses of neurons in the inferior temporal (IT) cortex of the macaque monkey to a set of object images exhibiting various combinations of specular reflection, diffuse reflection, and roughness, which are important physical parameters of surface gloss. We found that there are neurons in the lower bank of the superior temporal sulcus that selectively respond to specific gloss. This neuronal selectivity was largely maintained when the shape or illumination of the object was modified and perceived glossiness was unchanged. By contrast, neural responses were significantly altered when the pixels of the images were randomly rearranged, and perceived glossiness was dramatically changed. The stimulus preference of these neurons differed from cell to cell, and, as a population, they systematically represented a variety of surface glosses. We conclude that, within the visual cortex, there are mechanisms operating to integrate local image features and extract information about surface gloss and that this information is systematically represented in the IT cortex, an area playing an important role in object recognition.

Color tuning in alert macaque V1 assessed with fMRI and single-unit recording shows a bias toward daylight colors

Colors defined by the two intermediate directions in color space, "orange-cyan" and "lime-magenta," elicit the same spatiotemporal average response from the two cardinal chromatic channels in the lateral geniculate nucleus (LGN). While we found LGN functional magnetic resonance imaging (fMRI) responses to these pairs of colors were statistically indistinguishable, primary visual cortex (V1) fMRI responses were stronger to orange-cyan. Moreover, linear combinations of single-cell responses to cone-isolating stimuli of V1 cone-opponent cells also yielded stronger predicted responses to orange-cyan over lime-magenta, suggesting these neurons underlie the fMRI result. These observations are consistent with the hypothesis that V1 recombines LGN signals into "higher-order" mechanisms tuned to noncardinal color directions. In light of work showing that natural images and daylight samples are biased toward orange-cyan, our findings further suggest that V1 is adapted to daylight. V1, especially double-opponent cells, may function to extract spatial information from color boundaries correlated with scene-structure cues, such as shadows lit by ambient blue sky juxtaposed with surfaces reflecting sunshine.

Toward a unified theory of visual area V4

Visual area V4 is a midtier cortical area in the ventral visual pathway. It is crucial for visual object recognition and has been a focus of many studies on visual attention. However, there is no unifying view of V4's role in visual processing. Neither is there an understanding of how its role in feature processing interfaces with its role in visual attention. This review captures our current knowledge of V4, largely derived from electrophysiological and imaging studies in the macaque monkey. Based on recent discovery of functionally specific domains in V4, we propose that the unifying function of V4 circuitry is to enable selective extraction of specific functional domain-based networks, whether it be by bottom-up specification of object features or by top-down attentionally driven selection.

Color consilience: color through the lens of art practice, history, philosophy, and neuroscience

Paintings can be interpreted as the product of the complex neural machinery that translates physical light signals into behavior, experience, and emotion. The brain mechanisms responsible for vision and perception have been sculpted during evolution and further modified by cultural exposure and development. By closely examining artists' paintings and practices, we can discover hints to how the brain works, and achieve insight into the discoveries and inventions of artists and their impact on culture. Here, I focus on an integral aspect of color, color contrast, which poses a challenge for artists: a mark situated on an otherwise blank canvas will appear a different color in the context of the finished painting. How do artists account for this change in color during the production of a painting? In the broader context of neural and philosophical considerations of color, I discuss the practices of three modern masters, Henri Matisse, Paul Cézanne, and Claude Monet, and suggest that the strategies they developed not only capitalized on the neural mechanisms of color, but also influenced the trajectory of western art history.

Synaesthesia and colour constancy

Grapheme-colour synaesthesia is an atypical condition characterized by the perception of colours when reading achromatic text. We investigated the level of colour processing responsible for these experiences. To do so, we tapped a central characteristic of colour perception. In different lighting conditions the same wavelength of light can prompt the perception of different colours. This helps humans recognize distinctive coloured objects despite changes in illumination. We wanted to see if synaesthetic colours were generated at a neural locus that was susceptible to colour constancy analyses. We used colour matching and naming tasks to examine interactions between simulated coloured illuminants and synaesthetic colours. Neither synaesthetic colour matching or naming was impacted. This contrasted with non-synaesthetic control participants, who performed the colour-matching task with graphemes physically coloured to mimic synaesthesia. Our data suggest that synaesthetic colour signals are not generated at lower-levels of colour processing, but are introduced at higher levels of analysis and are therefore not impacted by the processes responsible for perceptual constancy.

Intrinsic curvature: a marker of millimeter-scale tangential cortico-cortical connectivity?

In this paper, we draw a link between cortical intrinsic curvature and the distributions of tangential connection lengths. We suggest that differential rates of surface expansion not only lead to intrinsic curvature of the cortical sheet, but also to differential inter-neuronal spacing. We propose that there follows a consequential change in the profile of neuronal connections: specifically an enhancement of the tendency towards proportionately more short connections. Thus, the degree of cortical intrinsic curvature may have implications for short-range connectivity.

Dissociable effects of natural image structure and color on LFP and spiking activity in the lateral prefrontal cortex and extrastriate visual area V4

Visual perception is mediated by unique contributions of the numerous brain regions that constitute the visual system. We performed simultaneous recordings of local field potentials (LFPs) and single unit activity (SUA) in areas V4 and lateral prefrontal cortex to characterize their contribution to visual processing. Here, we trained monkeys to identify natural images at different degradation levels in a visual recognition task. We parametrically varied color and structural information of natural images while the animals were performing the task. We show that the visual-evoked potential (VEP) of the LFP in V4 is highly sensitive to color, whereas the VEP in prefrontal cortex predominantly depends on image structure. When examining the relationship between VEP and SUA, we found that stimulus sensitivity for SUA was well predicted by the VEP in PF cortex but not in V4. Our results first reveal a functional specialization in both areas at the level of the LFP and further suggest that the degree to which mesoscopic signals, such as the VEP, are representative of the underlying SUA neural processing may be brain region specific within the context of visual recognition.

Color in the cortex: single- and double-opponent cells

This is a review of the research during the past 25years on cortical processing of color signals. At the beginning of the period the modular view of cortical processing predominated. However, at present an alternative view, that color and form are linked inextricably in visual cortical processing, is more persuasive than it seemed in 1985. Also, the role of the primary visual cortex, V1, in color processing now seems much larger than it did in 1985. The re-evaluation of the important role of V1 in color vision was caused in part by investigations of human V1 responses to color, measured with functional magnetic resonance imaging, fMRI, and in part by the results of numerous studies of single-unit neurophysiology in non-human primates. The neurophysiological results have highlighted the importance of double-opponent cells in V1. Another new concept is population coding of hue, saturation, and brightness in cortical neuronal population activity.

Advances in color science: from retina to behavior

Color has become a premier model system for understanding how information is processed by neural circuits, and for investigating the relationships among genes, neural circuits, and perception. Both the physical stimulus for color and the perceptual output experienced as color are quite well characterized, but the neural mechanisms that underlie the transformation from stimulus to perception are incompletely understood. The past several years have seen important scientific and technical advances that are changing our understanding of these mechanisms. Here, and in the accompanying minisymposium, we review the latest findings and hypotheses regarding color computations in the retina, primary visual cortex, and higher-order visual areas, focusing on non-human primates, a model of human color vision.

Reciprocal connectivity of identified color-processing modules in the monkey inferior temporal cortex

The inferior temporal (IT) cortex is the last unimodal visual area in the ventral visual pathway and is essential for color discrimination. Recent imaging and electrophysiological studies have revealed the presence of several distinct patches of color-selective cells in the anterior IT cortex (AIT) and posterior IT cortex (PIT). To understand the neural machinery for color processing in the IT cortex, in the present study, we combined anatomical tracing methods with electrophysiological unit recordings to investigate the anatomical connections of identified clusters of color-selective cells in monkey IT cortex. We found that a color cluster in AIT received projections from a color cluster in PIT as well as from discrete clusters of cells in other occipitotemporal areas, in the superior temporal sulcus, and in prefrontal and parietal cortices. The distribution of the labeled cells in PIT closely corresponded with that of the physiologically identified color-selective cells in this region. Furthermore, retrograde tracer injections in the posterior color cluster resulted in labeled cells in the anterior cluster. Thus, temporal lobe color-processing modules form a reciprocally interconnected loop within a distributed network.

Cortical brain regions associated with color processing: an FMRI study

To clarify whether the neural pathways concerning color processing are the same for natural objects, for artifacts objects and for non-objects we examined brain responses measured with functional magnetic resonance imaging (FMRI) during a covert naming task including the factors color (color vs. black&white (B&W)) and stimulus type (natural vs. artifacts vs. non-objects). Our results indicate that the superior parietal lobule and precuneus (BA 7) bilaterally, the right hippocampus and the right fusifom gyrus (V4) make part of a network responsible for color processing both for natural objects and artifacts, but not for non-objects. When color objects (both natural and artifacts) were contrasted with color non-objects we observed activations in the right parahippocampal gyrus (BA 35/36), the superior parietal lobule (BA 7) bilaterally, the left inferior middle temporal region (BA 20/21) and the inferior and superior frontal regions (BA 10/11/47). These additional activations suggest that colored objects recruit brain regions that are related to visual semantic information/retrieval and brain regions related to visuo-spatial processing. Overall, the results suggest that color information is an attribute that can improve object recognition (behavioral results) and activate a specific neural network related to visual semantic information that is more extensive than for B&W objects during object recognition.

Cortical activation during color discrimination task in macaques as revealed by positron emission tomography

Physiological and lesion studies have shown that the anterior inferior temporal (IT) cortex (aITC) is involved in the color vision of macaque monkeys. However, some functional imaging studies using awake monkeys contradicted the involvement of aITC in color vision. Thus, in most of the imaging studies, cortical activation has been observed during a fixation task. However, because the neuronal activity of aITC is highly affected by the behavioral task, it is desirable to investigate cortical activity during a color discrimination task to determine the functional role of aITC in the color vision of macaque monkeys. In this study, we investigated the cortical activity of aITC of macaque monkeys during color discrimination by positron emission tomography. Two monkeys were trained in a color discrimination task. Cortical areas involved in color processing were investigated by comparing activities during the color discrimination and lever release tasks. In addition to area V4 and the posterior IT cortex (pITC), we found color-related activities in the anterior IT gyrus. Consistent activation was observed in the region posterior to the anterior medial temporal sulcus (AMTS), although the exact location and the size of activations differed between monkeys and hemispheres. We also found color-related activities in the anterior portion of the superior temporal sulcus (STS), suggesting its involvement in the color vision. The present results revealed that aITC is involved in the color vision of macaque monkeys by a functional imaging technique.

A color hierarchy for automatic target selection

Visual processing of color starts at the cones in the retina and continues through ventral stream visual areas, called the parvocellular pathway. Motion processing also starts in the retina but continues through dorsal stream visual areas, called the magnocellular system. Color and motion processing are functionally and anatomically discrete. Previously, motion processing areas MT and MST have been shown to have no color selectivity to a moving stimulus; the neurons were colorblind whenever color was presented along with motion. This occurs when the stimuli are luminance-defined versus the background and is considered achromatic motion processing. Is motion processing independent of color processing? We find that motion processing is intrinsically modulated by color. Color modulated smooth pursuit eye movements produced upon saccading to an aperture containing a surface of coherently moving dots upon a black background. Furthermore, when two surfaces that differed in color were present, one surface was automatically selected based upon a color hierarchy. The strength of that selection depended upon the distance between the two colors in color space. A quantifiable color hierarchy for automatic target selection has wide-ranging implications from sports to advertising to human-computer interfaces.

Distribution of colour-selective activity in the monkey inferior temporal cortex revealed by functional magnetic resonance imaging

Previous electrophysiological, neuroimaging and lesion studies have suggested that the anterior part of the monkey inferior temporal (IT) cortex, or area TE, plays an important role in colour processing. However, little is known about how colour information is distributed in these cortical regions. Here, we explored the distribution of colour-selective activity in alert macaque monkeys using functional magnetic resonance imaging (fMRI) with two types of stimuli: a multicoloured ('Mondrian') pattern and an isoluminant colour grating. These two types of stimuli are both commonly used in human fMRI studies, but Mondrian stimuli, which contain a richer variety of hues and hence might be more suitable for activating higher-order areas than grating stimuli, have not been used to examine colour-selectivity in higher-order areas in earlier monkey studies. With the Mondrian stimuli, we observed that areas along the ventral pathway, V1, V2/V3, V4 and the IT cortex, responded more strongly to colour stimuli than to luminance stimuli. In the IT cortex, we found that colour-selective activities are not distributed uniformly, but are localized in discrete regions, each extending several millimetres in the anterior or posterior part of the IT cortex. The colour-selective activation in the anterior IT was observed only with the Mondrian stimuli, whereas the colour-selective activation in the posterior IT was observed with both the Mondrian and grating stimuli, with little overlap. These findings suggest that there are multiple subregions with differing stimulus selectivities distributed in the IT cortex, and that colour information is processed in these discrete subregions.

Color selectivity of neurons in the posterior inferior temporal cortex of the macaque monkey

We recorded the activities of neurons in the lateral surface of the posterior inferior temporal cortex (PIT) of 3 hemispheres of 3 monkeys performing a visual fixation task. We characterized the color and shape selectivities of each neuron, mapped its receptive field (RF), and studied the distributions of these response properties. Using a set of color stimuli that were systematically distributed in Commission Internationale de l'Eclairage-xy chromaticity diagram, we found numerous color-selective neurons distributed throughout the area examined. Neurons in the ventral region tended to have sharper color tuning than those in the dorsal region. We also found a crude retinotopic organization in the ventral region. Within the ventral region of PIT, neurons in the dorsal part had RFs that overlapped the foveal center; the eccentricity of RFs increased in the more ventral part, and neurons in the anterior and posterior parts had RFs that represented the lower and upper visual fields, respectively. In all 3 hemispheres, the region where sharply tuned color-selective neurons were concentrated was confined within this retinotopic map. These findings suggest that PIT is a heterogeneous area and that there is a circumscribed region within it that has crude retinotopic organization and is involved in the processing of color.

Color-tuned neurons are spatially clustered according to color preference within alert macaque posterior inferior temporal cortex

Large islands of extrastriate cortex that are enriched for color-tuned neurons have recently been described in alert macaque using a combination of functional magnetic resonance imaging (fMRI) and single-unit recording. These millimeter-sized islands, dubbed "globs," are scattered throughout the posterior inferior temporal cortex (PIT), a swath of brain anterior to area V3, including areas V4, PITd, and posterior TEO. We investigated the micro-organization of neurons within the globs. We used fMRI to identify the globs and then used MRI-guided microelectrodes to test the color properties of single glob cells. We used color stimuli that sample the CIELUV perceptual color space at regular intervals to test the color tuning of single units, and make two observations. First, color-tuned neurons of various color preferences were found within single globs. Second, adjacent glob cells tended to have the same color tuning, demonstrating that glob cells are clustered by color preference and suggesting that they are arranged in color columns. Neurons separated by 50 microm, measured parallel to the cortical sheet, had more similar color tuning than neurons separated by 100 microm, suggesting that the scale of the color columns is <100 microm. These results show that color-tuned neurons in PIT are organized by color preference on a finer scale than the scale of single globs. Moreover, the color preferences of neurons recorded sequentially along a given electrode penetration shifted gradually in many penetrations, suggesting that the color columns are arranged according to a chromotopic map reflecting perceptual color space.

An empirical explanation of the speed-distance effect

Understanding motion perception continues to be the subject of much debate, a central challenge being to account for why the speeds and directions seen accord with neither the physical movements of objects nor their projected movements on the retina. Here we investigate the varied perceptions of speed that occur when stimuli moving across the retina traverse different projected distances (the speed-distance effect). By analyzing a database of moving objects projected onto an image plane we show that this phenomenology can be quantitatively accounted for by the frequency of occurrence of image speeds generated by perspective transformation. These results indicate that speed-distance effects are determined empirically from accumulated past experience with the relationship between image speeds and moving objects.

Color vision, cones, and color-coding in the cortex

Color processing begins with the absorption of light by cone photoreceptors, and progresses through a series of hierarchical stages: Retinal signals carrying color information are transmitted through the lateral geniculate nucleus of the thalamus (LGN) up to the primary visual cortex (V1). From V1, the signals are processed by the second visual area (V2); then by cells located in subcompartments ("globs") within the posterior inferior temporal (PIT) cortex, a brain region that encompasses area V4 and brain regions immediately anterior to V4. Color signals are then processed by regions deep within the inferior temporal (IT) cortex including area TE. As a heuristic, one can consider each of these stages to be involved in constructing a distinct aspect of the color percept. The three cone types are the basis for trichromacy; retinal ganglion cells that respond in an opponent fashion to activation of different cone classes are the basis for color opponency (these "cone-opponent" cells increase their firing rate above baseline to activation of one cone class and decrease their firing rate below baseline to activation of a different cone class); double-opponent neurons in the V1 generate local color contrast and are the building blocks for color constancy; glob cells elaborate the perception of hue; and IT integrates color perception in the context of behavior. Finally, though nothing is known, these signals presumably interface with motor programs and emotional centers of the brain to mediate the widely acknowledged emotional salience of color.