Color Vision: Decoding Color Space

A new study has used magnetoencephalography to track cortical responses to color as they emerge in time. Similarities and differences within these neural responses parallel characteristics of the perceptual experience of color.

Color Compensation in Anomalous Trichromats Assessed with fMRI

Anomalous trichromacy is a common form of congenital color deficiency resulting from a genetic alteration in the photopigments of the eye's light receptors. The changes reduce sensitivity to reddish and greenish hues, yet previous work suggests that these observers may experience the world to be more colorful than their altered receptor sensitivities would predict, potentially indicating an amplification of post-receptoral signals. However, past evidence suggesting such a gain adjustment rests on subjective measures of color appearance or salience. We directly tested for neural amplification by using fMRI to measure cortical responses in color-anomalous and normal control observers. Color contrast response functions were measured in two experiments with different tasks to control for attentional factors. Both experiments showed a predictable reduction in chromatic responses for anomalous trichromats in primary visual cortex. However, in later areas V2v and V3v, chromatic responses in the two groups were indistinguishable. Our results provide direct evidence for neural plasticity that compensates for the deficiency in the initial receptor color signals and suggest that the site of this compensation is in early visual cortex.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

Color Vision: Glasses Half Full

A new study finds that individuals with color deficiencies report long-term changes in their color vision after only a few days of wearing glasses that boost color contrasts, potentially because they learn to see or interpret color in new ways.

Neural correlates of perceptual color inferences as revealed by #thedress

Color constancy involves disambiguating the spectral characteristics of lights and surfaces, for example to distinguish red in white light from white in red light. Solving this problem appears especially challenging for bluish tints, which may be attributed more often to shading, and this bias may underlie the individual differences in whether people described the widely publicized image of #thedress as blue-black or white-gold. To probe these higher-level color inferences, we examined neural correlates of the blue-bias, using frequency-tagging and high-density electroencephalography to monitor responses to 3-Hz alternations between different color versions of #thedress. Specifically, we compared relative neural responses to the original “blue” dress image alternated with the complementary “yellow” image (formed by inverting the chromatic contrast of each pixel). This image pair produced a large modulation of the electroencephalography amplitude at the alternation frequency, consistent with a perceived contrast difference between the blue and yellow images. Furthermore, decoding topographical differences in the blue-yellow asymmetries over occipitoparietal channels predicted blue-black and white-gold observers with over 80% accuracy. The blue-yellow asymmetry was stronger than for a “red” versus “green” pair matched for the same component differences in L versus M or S versus LM chromatic contrast as the blue-yellow pair and thus cannot be accounted for by asymmetries within either precortical cardinal mechanism. Instead, the results may point to neural correlates of a higher-level perceptual representation of surface colors.

All-or-none face categorization in the human brain

Visual categorization is integral for our interaction with the natural environment. In this process, similar selective responses are produced to a class of variable visual inputs. Whether categorization is supported by partial (graded) or absolute (all-or-none) neural responses in high-level human brain regions is largely unknown. We address this issue with a novel frequency-sweep paradigm probing the evolution of face categorization responses between the minimal and optimal stimulus presentation times. In a first experiment, natural images of variable non-face objects were progressively swept from 120 to 3 ​Hz (8.33-333 ​ms duration) in rapid serial visual presentation sequences. Widely variable face exemplars appeared every 1 ​s, enabling an implicit frequency-tagged face-categorization electroencephalographic (EEG) response at 1 ​Hz. Face-categorization activity emerged with stimulus durations as brief as 17 ​ms (17-83 ​ms across individual participants) but was significant with 33 ​ms durations at the group level. The face categorization response amplitude increased until 83 ​ms stimulus duration (12 ​Hz), implying graded categorization responses. In a second EEG experiment, faces appeared non-periodically throughout such sequences at fixed presentation rates, while participants explicitly categorized faces. A strong correlation between response amplitude and behavioral accuracy across frequency rates suggested that dilution from missed categorizations, rather than a decreased response to each face stimulus, accounted for the graded categorization responses as found in Experiment 1. This was supported by (1) the absence of neural responses to faces that participants failed to categorize explicitly in Experiment 2 and (2) equivalent amplitudes and spatio-temporal signatures of neural responses to behaviorally categorized faces across presentation rates. Overall, these observations provide original evidence that high-level visual categorization of faces, starting at about 100 ​ms following stimulus onset in the human brain, is variable across observers tested under tight temporal constraints, but occurs in an all-or-none fashion.

Visual discomfort from flicker: Effects of mean light level and contrast

Uncomfortable images generally have a particular spatial structure, which deviates from a reciprocal relationship between amplitude and spatial frequency (f) in the Fourier domain (1/f). Although flickering patterns with similar temporal structure also appear uncomfortable, the discomfort is affected by not only the amplitude spectrum but also the phase spectrum. Here we examined how discomfort from flicker with differing temporal profiles also varies as a function of the mean light level and luminance contrast of the stimulus. Participants were asked to rate discomfort for a 17° flickering uniform field at different light levels from scotopic to photopic. The flicker waveform was varied with a square wave or random phase spectrum and filtered by modulating the slope of the amplitude spectrum relative to 1/f. At photopic levels, the 1/f square wave flicker appeared most comfortable, whereas the discomfort from the random flicker increased monotonically as the slope of the amplitude spectrum decreased. This special status for the 1/f square wave condition was limited to photopic light levels. At the lower mesopic or scotopic levels, the effect of phase spectrum on the discomfort was diminished, with both phase spectra showing a monotonic change with the slope of the amplitude spectrum. We show that these changes cannot be accounted for by changes in the effective luminance contrast of the stimuli or by the responses from a linear model based on the temporal impulse responses under different light levels. However, discomfort from flicker is robustly correlated with judgments of the perceived naturalness of flicker across different contrasts and mean luminance levels.

Comparison of two methods of hue scaling

Hue-scaling functions are designed to characterize color appearance by assessing the relative strength of the red versus green and blue versus yellow opponent sensations comprising different hues. However, these judgments can be non-intuitive and may pose difficulties for measurement and analysis. We explored an alternative scaling method based on positioning a dial to represent the relative similarity or distance of each hue from the labeled positions for the opponent categories. The hue-scaling and hue-similarity rating methods were compared for 28 observers. Settings on both tasks were comparable though the similarity ratings showed less inter-observer variability and weaker categorical bias, suggesting that these categorical biases may reflect properties of the task rather than the percepts. Alternatively, properties that are concordant for the two paradigms provide evidence for characteristics that do reflect color appearance. Individual differences on both tasks suggest that color appearance depends on multiple, narrowly tuned color processes, which are inconsistent with conventional color-opponent theory.

Color variance and achromatic settings

The average color in a scene is a potentially important cue to the illuminant and thus for color constancy, but it remains unknown how well and in what ways observers can estimate the mean chromaticity. We examined this by measuring the variability in "achromatic" settings for stimuli composed of different distributions of colors with varying contrast ranges along the luminance, SvsLM, and LvsM cardinal axes. Observers adjusted the mean chromaticity of the palette to set the average to gray. Variability in the settings increased as chromatic contrast or (to a lesser extent) luminance contrast increased. Signals along the cardinal axes are relatively independent in many detection and discrimination tasks, but showed strong interference in the white estimates. This "cross-masking" and the effects of chromatic variance in general may occur because observers cannot explicitly perceive or represent the mean of a set of qualitatively different hues (e.g., that red and green hues average to gray), and thus may infer the mean only indirectly (e.g., from the relative saturation of different hues).

Predicting color matches from luminance matches

Color vision and spectral sensitivity vary among individuals with normal color vision; thus, for many applications, it is important to measure and correct for an observer's sensitivity. Full correction would require measuring color and luminance matches and is rarely implemented. However, luminance matches (equiluminance settings) are routinely measured and simple to conduct. We modeled how well an observer's color matches could be approximated by measuring only luminance sensitivity, since both depend on a common set of factors. We show that lens and macular pigment density and $L/M$L/M cone ratios alter equiluminance settings in different ways and can therefore be estimated from the settings. In turn, the density variations can account for a large proportion of the normal variation in color matching. Thus, luminance matches may provide a simple method to at least partially predict an observer's color matches without requiring more complex tasks or equipment.

The Verriest Lecture: Adventures in blue and yellow

Conventional models of color vision assume that blue and yellow (along with red and green) are the fundamental building blocks of color appearance, yet how these hues are represented in the brain and whether and why they might be special are questions that remain shrouded in mystery. Many studies have explored the visual encoding of color categories, from the statistics of the environment to neural processing to perceptual experience. Blue and yellow are tied to salient features of the natural color world, and these features have likely shaped several important aspects of color vision. However, it remains less certain that these dimensions are encoded as primary or "unique" in the visual representation of color. There are also striking differences between blue and yellow percepts that may reflect high-level inferences about the world, specifically about the colors of light and surfaces. Moreover, while the stimuli labeled as blue or yellow or other basic categories show a remarkable degree of constancy within the observer, they all vary independently of one another across observers. This pattern of variation again suggests that blue and yellow and red and green are not a primary or unitary dimension of color appearance, and instead suggests a representation in which different hues reflect qualitatively different categories rather than quantitative differences within an underlying low-dimensional "color space."

Individual differences and their implications for color perception

Individual differences are a conspicuous feature of color vision and arise from many sources, in both the observer and the world. These differences have important practical implications for comparing and correcting perception and performance, and important theoretical implications for understanding the design principles underlying color coding. Color percepts within and between individuals often vary less than the variations in spectral sensitivity might predict. This stability is achieved by a variety of processes that compensate perception for the sensitivity limits of the eye and brain. Yet judgments of color between individuals can also vary widely, and in ways that are not readily explained by differences in sensitivity or the environment. These differences are uncorrelated across different color categories, and could reflect how these categories are learned or represented.

Directional Visual Motion Is Represented in the Auditory and Association Cortices of Early Deaf Individuals

Individuals who are deaf since early life may show enhanced performance at some visual tasks, including discrimination of directional motion. The neural substrates of such behavioral enhancements remain difficult to identify in humans, although neural plasticity has been shown for early deaf people in the auditory and association cortices, including the primary auditory cortex (PAC) and STS region, respectively. Here, we investigated whether neural responses in auditory and association cortices of early deaf individuals are reorganized to be sensitive to directional visual motion. To capture direction-selective responses, we recorded fMRI responses frequency-tagged to the 0.1-Hz presentation of central directional (100% coherent random dot) motion persisting for 2 sec contrasted with nondirectional (0% coherent) motion for 8 sec. We found direction-selective responses in the STS region in both deaf and hearing participants, but the extent of activation in the right STS region was 5.5 times larger for deaf participants. Minimal but significant direction-selective responses were also found in the PAC of deaf participants, both at the group level and in five of six individuals. In response to stimuli presented separately in the right and left visual fields, the relative activation across the right and left hemispheres was similar in both the PAC and STS region of deaf participants. Notably, the enhanced right-hemisphere activation could support the right visual field advantage reported previously in behavioral studies. Taken together, these results show that the reorganized auditory cortices of early deaf individuals are sensitive to directional motion. Speculatively, these results suggest that auditory and association regions can be remapped to support enhanced visual performance.

Dynamics of contrast adaptation in central and peripheral vision

Adaptation aftereffects are generally stronger for peripheral than for foveal viewing. We examined whether there are also differences in the dynamics of visual adaptation in central and peripheral vision. We tracked the time course of contrast adaptation to binocularly presented Gabor patterns in both the central visual field (within 5°) and in the periphery (beyond 10° eccentricity) using a yes/no detection task to monitor contrast thresholds. Consistent with previous studies, sensitivity losses were stronger in the periphery than in the center when adapting to equivalent high contrast (90% contrast) patterns. The time course of the threshold changes was fitted with separate exponential functions to estimate the time constants during the adapt and post-adapt phases. When adapting to equivalent high contrast, adaptation effects built up and decayed more slowly in the periphery compared with central adaptation. Surprisingly, the aftereffect in the periphery did not decay completely to the baseline within the monitored post-adapt period (400 s), and instead asymptoted to a higher level than for central adaptation. Even when contrast was reduced to one-third (30% contrast) of the central contrast, peripheral adaptation remained stronger and decayed more slowly. This slower dynamic was also confirmed at suprathreshold test contrasts by tracking tilt-aftereffects with a 2AFC orientation discrimination task. Our results indicate that the dynamics of contrast adaptation differ between central and peripheral vision, with the periphery adapting not only more strongly but also more slowly, and provide another example of potential qualitative processing differences between central and peripheral vision.

Adaptation and visual discomfort from flicker

Spatial images with unnatural amplitude spectra tend to appear uncomfortable. Analogous effects are found in the temporal domain, yet discomfort in flickering patterns is also strongly dependent on the phase spectrum. Here we examined how discomfort in temporal flicker is affected by adaptation to different amplitude and phase spectra. Adapting and test flicker were square wave or random phase transitions in a uniform field filtered by increasing (blurred) or decreasing (sharpened) the slope of the amplitude spectrum. Participants rated the level of discomfort or sharpness/blur for the test flicker. Before adaptation, square wave transitions were rated as most comfortable when they had "focused" edges, which were defined as characterized by 1/f amplitude spectra, while random phase transitions instead appeared more comfortable the more blurred they were. After adapting to blurred or sharpened transitions, both square wave and random phase flicker appeared more sharpened or blurred, respectively, and these effects were consistent with renormalization of perceived temporal focus. In comparison, adaptation affected discomfort in the two waveforms in qualitatively different ways, and exposure to the adapting stimulus tended to increase rather than decreased its perceived discomfort. These results point to a dissociation between the perceived amplitude spectrum and perceived discomfort, suggesting they in part depend on distinct processes. The results further illustrate the importance of the phase spectrum in determining visual discomfort from flickering patterns.