Individual differences and their implications for color perception

A survey of skin tone assessment in prospective research

Increasing evidence supports reduced accuracy of noninvasive assessment tools, such as pulse oximetry, temperature probes, and AI skin diagnosis benchmarks, in patients with darker skin tones. The FDA is exploring potential strategies for device regulation to improve performance across diverse skin tones by including skin tone criteria. However, there is no consensus about how prospective studies should perform skin tone assessment in order to take this bias into account. There are several tools available to conduct skin tone assessments including administered visual scales (e.g., Fitzpatrick Skin Type, Pantone, Monk Skin Tone) and color measurement tools (e.g., reflectance colorimeters, reflectance spectrophotometers, cameras), although none are consistently used or validated across multiple medical domains. Accurate and consistent skin tone measurement depends on many factors including standardized environments, lighting, body parts assessed, patient conditions, and choice of skin tone assessment tool(s). As race and ethnicity are inadequate proxies for skin tone, these considerations can be helpful in standardizing the effect of skin tone on studies such as AI dermatology diagnoses, pulse oximetry, and temporal thermometers. Skin tone bias in medical devices is likely due to systemic factors that lead to inadequate validation across diverse skin tones. There is an opportunity for researchers to use skin tone assessment methods with standardized considerations in prospective studies of noninvasive tools that may be affected by skin tone. We propose considerations that researchers must take in order to improve device robustness to skin tone bias.

A reduction in self-reported confidence accompanies the recall of memories distorted by prototypes

When we recall a past event, we reconstruct the event based on a combination of episodic details and semantic knowledge (e.g., prototypes). Though prototypes can impair the veracity of recall, it remains unclear whether we are metacognitively aware of the distortions they introduce. To address this, we conducted six experiments in which participants learned object-colour/object-location pairs and subsequently recalled the colour/location when cued with the object. Leveraging unsupervised machine learning algorithms, we extracted participant-specific prototypes and embedded responses in two-dimensional space to quantify prototype-based distortions in individual memory traces. Our findings reveal robust and conceptually replicable evidence to suggest that prototype-based distortion is accompanied by a reduction in self-reported confidence - an implicit measure of metacognitive awareness. Critically, we find evidence to suggest that it is prototype-based distortion of a memory trace that undermines confidence, rather than a lack of confidence biasing reconstruction towards the use of prototypes. Collectively, these findings suggest that we possess metacognitive awareness of distortions embedded in our memories.

Unique yellow shifts for small and brief stimuli in the central retina

The spectral locus of unique yellow was determined for flashes of different sizes (<11 arcmin) and durations (<500 ms) presented in and near the fovea. An adaptive optics scanning laser ophthalmoscope was used to minimize the effects of higher-order aberrations during simultaneous stimulus delivery and retinal imaging. In certain subjects, parafoveal cones were classified as L, M, or S, which permitted the comparison of unique yellow measurements with variations in local L/M ratios within and between observers. Unique yellow shifted to longer wavelengths as stimulus size or duration was reduced. This effect is most pronounced for changes in size and more apparent in the fovea than in the parafovea. The observed variations in unique yellow are not entirely predicted from variations in L/M ratio and therefore implicate neural processes beyond photoreception.

Navigating color integrity in data visualization

Color is crucial in scientific visualization, yet it is often misused. Addressing this, we think accessible and accurate techniques, such as color-blind friendly palettes and perceptually even gradients, are vital. Accountability and basic knowledge in data visualization are key in fostering a culture of color integrity, ensuring accurate and inclusive data representation.

Maintenance of color memoranda in activity-quiescent working memory states: Evidence from impulse perturbation

In the present study, we used an impulse perturbation method to probe working memory maintenance of colors in neurally active and activity-quiescent states, focusing on a set of pre-registered analyses. We analyzed the electroencephalograph (EEG) data of 30 participants who completed a delayed match-to-sample working memory task, in which one of the two items that were presented was retro-cued as task relevant. The analyses revealed that both cued and uncued colors were decodable from impulse-evoked activity, the latter in contrast to previous reports of working memory for orientation gratings. Decoding of colors from oscillations in the alpha band showed that cued items could be decoded therein whereas uncued items could not. Overall, the outcomes suggest that subtle differences exist between the representation of colors, and that of stimuli with spatial properties, but the present results also demonstrate that regardless of their specific neural state, both are accessible through visual impulse perturbation.

Learning attentional templates for value-based decision-making

Attention filters sensory inputs to enhance task-relevant information. It is guided by an "attentional template" that represents the stimulus features that are currently relevant. To understand how the brain learns and uses templates, we trained monkeys to perform a visual search task that required them to repeatedly learn new attentional templates. Neural recordings found that templates were represented across the prefrontal and parietal cortex in a structured manner, such that perceptually neighboring templates had similar neural representations. When the task changed, a new attentional template was learned by incrementally shifting the template toward rewarded features. Finally, we found that attentional templates transformed stimulus features into a common value representation that allowed the same decision-making mechanisms to deploy attention, regardless of the identity of the template. Altogether, our results provide insight into the neural mechanisms by which the brain learns to control attention and how attention can be flexibly deployed across tasks.

Influence of colour vision on attention to, and impression of, complex aesthetic images

Humans exhibit colour vision variations due to genetic polymorphisms, with trichromacy being the most common, while some people are classified as dichromats. Whether genetic differences in colour vision affect the way of viewing complex images remains unknown. Here, we investigated how people with different colour vision focused their gaze on aesthetic paintings by eye-tracking while freely viewing digital rendering of paintings and assessed individual impressions through a decomposition analysis of adjective ratings for the images. Gaze-concentrated areas among trichromats were more highly correlated than those among dichromats. However, compared with the brief dichromatic experience with the simulated images, there was little effect of innate colour vision differences on impressions. These results indicate that chromatic information is instructive as a cue for guiding attention, whereas the impression of each person is generated according to their own sensory experience and normalized through one's own colour space.

Color appearance and the end of Hering's Opponent-Colors Theory

Hering's Opponent-Colors Theory has been central to understanding color appearance for 150 years. It aims to explain the phenomenology of colors with two linked propositions. First, a psychological hypothesis stipulates that any color is described necessarily and sufficiently by the extent to which it appears reddish-versus-greenish, bluish-versus-yellowish, and blackish-versus-whitish. Second, a physiological hypothesis stipulates that these perceptual mechanisms are encoded by three innate brain mechanisms. We review the evidence and conclude that neither side of the linking proposition is accurate: the theory is wrong. We sketch out an alternative, Utility-Based Coding, by which the known retinal cone-opponent mechanisms represent optimal encoding of spectral information given competing selective pressure to extract high-acuity spatial information; and phenomenological color categories represent an adaptive, efficient, output of the brain governed by behavioral demands.

Systematic differences in visual working memory performance are not caused by differences in working memory storage

People vary in their performance on visual working memory tasks, and these individual differences covary with a wide range of higher-level cognitive processes including fluid intelligence. Performance also varies across study displays, purportedly driven by both low- and higher-level processes. Understanding what causes these sources of systematic variability has been crucial for developing theories of working memory. However, here we find that all such variability in performance on a test of visual working memory can be accounted for by concurrent variability in visual iconic memory: A person with relatively high working memory capacity will have high iconic memory capacity, and a particularly easy working memory display will also be easy under iconic memory conditions. These results are supported by a nonparametric factor analysis and hierarchical Bayesian model comparison. In a second experiment the relationship between iconic and working memory holds even when they are measured with substantially different experimental paradigms, and a third experiment suggests that the relationship between tests of iconic and working memory is driven by mechanisms other than iconic or working memory storage, such as variation in perceptual or attentional processes. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Color constancy for daylight illumination changes in anomalous trichromats and dichromats

Color constancy is the perceptual stability of surface colors under temporal changes in the illumination spectrum. The illumination discrimination task (IDT) reveals worse discrimination for "bluer" illumination changes in normal-trichromatic observers (changes towards cooler color temperatures on the daylight chromaticity locus), indicating greater stability of scene colors or better color constancy, compared with illumination changes in other chromatic directions. Here, we compare the performance of individuals with X-linked color-vision deficiencies (CVDs) to normal trichromats on the IDT performed in an immersive setting with a real scene illuminated by spectrally tunable LED lamps. We determine discrimination thresholds for illumination changes relative to a reference illumination (D65) in four chromatic directions, roughly parallel and orthogonal to the daylight locus. We find, using both a standard CIELUV metric and a cone-contrast metric tailored to distinct CVD types, that discrimination thresholds for daylight changes do not differ between normal trichromats and CVD types, including dichromats and anomalous trichromats, but thresholds for atypical illuminations do differ. This result extends a previous report of illumination discrimination ability in dichromats for simulated daylight changes in images. In addition, using the cone-contrast metric to compare thresholds for bluer and yellower daylight changes with those for unnatural redder and greener changes, we suggest that reduced sensitivity to daylight changes is weakly preserved in X-linked CVDs.

From cones to color vision: a neurobiological model that explains the unique hues

The irreducible unique hues-red, green, blue, and yellow-remain one of the great mysteries of vision science. Attempts to create a physiologically parsimonious model that can predict the spectral locations of the unique hues all rely on at least one post hoc adjustment to produce appropriate loci for unique green and unique red, and struggle to explain the non-linearity of the Blue/Yellow system. We propose a neurobiological color vision model that overcomes these challenges by using physiological cone ratios, cone-opponent normalization to equal-energy white, and a simple adaptation mechanism to produce color-opponent mechanisms that accurately predict the spectral locations and variability of the unique hues.

Using global feedback to induce learning of gist of abnormality in mammograms

Extraction of global structural regularities provides general 'gist' of our everyday visual environment as it does the gist of abnormality for medical experts reviewing medical images. We investigated whether naïve observers could learn this gist of medical abnormality. Fifteen participants completed nine adaptive training sessions viewing four categories of unilateral mammograms: normal, obvious-abnormal, subtle-abnormal, and global signals of abnormality (mammograms with no visible lesions but from breasts contralateral to or years prior to the development of cancer) and receiving only categorical feedback. Performance was tested pre-training, post-training, and after a week's retention on 200 mammograms viewed for 500 ms without feedback. Performance measured as d' was modulated by mammogram category, with the highest performance for mammograms with visible lesions. Post-training, twelve observed showed increased d' for all mammogram categories but a subset of nine, labelled learners also showed a positive correlation of d' across training. Critically, learners learned to detect abnormality in mammograms with only the global signals, but improvements were poorly retained. A state-of-the-art breast cancer classifier detected mammograms with lesions but struggled to detect cancer in mammograms with the global signal of abnormality. The gist of abnormality can be learned through perceptual/incidental learning in mammograms both with and without visible lesions, subject to individual differences. Poor retention suggests perceptual tuning to gist needs maintenance, converging with findings that radiologists' gist performance correlates with the number of cases reviewed per year, not years of experience. The human visual system can tune itself to complex global signals not easily captured by current deep neural networks.

Daltonization or colour enhancement: potential uses and limitations [Invited]

The main perceptual-cognitive limitations of CDOs (Colour Deficient Observers) are analysed, along with the uses and limitations of tools that either transform images so that CNOs (Colour Normal Observers) see them as CDOs (simulation) or transform images so that CDOs can use them as CNOs (daltonization). The four main uses of colour (comparative, denotative, connotative, and aesthetic) are analysed, along with their relation to, alternatively, the ability to discriminate colour stimuli or to categorize colours. These uses of colour are applied to analyse the possible effects of daltonization tools.

Do You See What I See? Diversity in Human Color Perception

In our tendency to discuss the objective properties of the external world, we may fail to notice that our subjective perceptions of those properties differ between individuals. Variability at all levels of the color vision system creates diversity in color perception, from discrimination to color matching, appearance, and subjective experience, such that each of us lives in a unique perceptual world. In this review, I discuss what is known about individual differences in color perception and its determinants, particularly considering genetically mediated variability in cone photopigments and the paradoxical effects of visual environments in both contributing to and counteracting individual differences. I make the case that, as well as being of interest in their own right and crucial for a complete account of color vision, individual differences can be used as a methodological tool in color science for the insights that they offer about the underlying mechanisms of perception. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Crystal or jelly? Effect of color on the perception of translucent materials with photographs of real-world objects

Translucent materials are ubiquitous in nature (e.g. teeth, food, and wax), but our understanding of translucency perception is limited. Previous work in translucency perception has mainly used monochromatic rendered images as stimuli, which are restricted by their diversity and realism. Here, we measure translucency perception with photographs of real-world objects. Specifically, we use three behavior tasks: binary classification of "translucent" versus "opaque," semantic attribute rating of perceptual qualities (see-throughness, glossiness, softness, glow, and density), and material categorization. Two different groups of observers finish the three tasks with color or grayscale images. We find that observers' agreements depend on the physical material properties of the objects such that translucent materials generate more interobserver disagreements. Further, there are more disagreements among observers in the grayscale condition in comparison to that in the color condition. We also discover that converting images to grayscale substantially affects the distributions of attribute ratings for some images. Furthermore, ratings of see-throughness, glossiness, and glow could predict individual observers' binary classification of images in both grayscale and color conditions. Last, converting images to grayscale alters the perceived material categories for some images such that observers tend to misjudge images of food as non-food and vice versa. Our result demonstrates that color is informative about material property estimation and recognition. Meanwhile, our analysis shows that mid-level semantic estimation of material attributes might be closely related to high-level material recognition. We also discuss individual differences in our results and highlight the importance of such consideration in material perception.

Colors

Bevil Conway introduces colors.

Translucency perception: A review

Translucency is an optical and a perceptual phenomenon that characterizes subsurface light transport through objects and materials. Translucency as an optical property of a material relates to the radiative transfer inside and through this medium, and translucency as a perceptual phenomenon describes the visual sensation experienced by humans when observing a given material under given conditions. The knowledge about the visual mechanisms of the translucency perception remains limited. Accurate prediction of the appearance of the translucent objects can have a significant commercial impact in the fields such as three-dimensional printing. However, little is known how the optical properties of a material relate to a perception evoked in humans. This article overviews the knowledge status about the visual perception of translucency and highlights the applications of the translucency perception research. Furthermore, this review summarizes current knowledge gaps, fundamental challenges and existing ambiguities with a goal to facilitate translucency perception research in the future.

Color appearance model incorporating contrast adaptation - implications for individual differences in color vision

Color appearance models use standard color matching functions to derive colorimetric information from spectral radiometric measurements of a visual environment, and they process that information to predict color perceptual attributes such as hue, chroma and lightness. That processing is usually done by equations with fixed numerical coefficients that were predetermined to yield optimal agreement for a given standard observer. Here we address the well-known fact that, among color-normal observers, there are significant differences of color matching functions. These cause disagreements between individuals as to whether certain colors match, an important effect that is often called observer metamerism. Yet how these individual sensitivity differences translate into differences in perceptual metrics is not fully addressed by many appearance models. It might seem that appearance could be predicted by substituting an individual's color matching functions into an otherwise-unchanged color appearance model, but this is problematic because the model's coefficients were not optimized for the new observer. Here we explore a solution guided by the idea that processes of adaptation in the visual system tend to compensate color perception for differences in cone responses and consequent color matching functions. For this purpose, we developed a simple color appearance model that uses only a few numerical coefficients, yet accurately predicts the perceptual attributes of Munsell samples under a selected standard lighting condition. We then added a feedback loop to automatically adjust the model coefficients, in response to switching between cone fundamentals simulating different observers and color matching functions. This adjustment is intended to model long term contrast adaptation in the vision system by maintaining average overall color contrast levels. Incorporating this adaptation principle into color appearance models could allow better assessments of displays and illumination systems, to help improve color appearances for most observers.

Statistical Properties of Color Matching Functions

In trichromats, color vision entails the projection of an infinite-dimensional space (the one containing all possible electromagnetic power spectra) onto the three-dimensional space that modulates the activity of the three types of cones. This drastic reduction in dimensionality gives rise to metamerism, that is, the perceptual chromatic equivalence between two different light spectra. The classes of equivalence of metamerism are revealed by color-matching experiments in which observers adjust the intensity of three monochromatic light beams of three preset wavelengths (the primaries) to produce a mixture that is perceptually equal to a given monochromatic target stimulus. Here we use the linear relation between the color matching functions and the absorption probabilities of each type of cone to find particularly useful triplets of primaries. As a second goal, we also derive an analytical description of the trial-to-trial variability and the correlations of color matching functions stemming from Poissonian noise in photon capture. We analyze how the statistical properties of the responses to color-matching experiments vary with the retinal composition and the wavelengths of peak absorption probability, and compare them with experimental data on subject-to-subject variability obtained previously.

Color perception and compensation in color deficiencies assessed with hue scaling

Anomalous trichromats have three classes of cone receptors but with smaller separation in the spectral sensitivities of their longer-wave (L or M) cones compared to normal trichromats. As a result, the differences in the responses of the longer-wave cones are smaller, resulting in a weaker input to opponent mechanisms that compare the LvsM responses. Despite this, previous studies have found that their color percepts are more similar to normal trichromats than the smaller LvsM differences predict, suggesting that post-receptoral processes might amplify their responses to compensate for the weaker opponent inputs. We evaluated the degree and form of compensation using a hue-scaling task, in which the appearance of different hues is described by the perceived proportions of red-green or blue-yellow primary colors. The scaling functions were modeled to estimate the relative salience of the red-green to blue-yellow components. The red-green amplitudes of the 10 anomalous observers were 1.5 times weaker than for a group of 26 normal controls. However, their relative sensitivity at threshold for detecting LvsM chromatic contrast was on average 6 times higher, consistent with a 4-fold gain in the suprathreshold hue-scaling responses. Within-observer variability in the settings was similar for the two groups, suggesting that the suprathreshold gain did not similarly amplify the noise, at least for the dimension of hue. While the compensation was pronounced it was nevertheless partial, and anomalous observers differed systematically from the controls in the shapes of the hue-scaling functions and the corresponding loci of their color categories. Factor analyses further revealed different patterns of individual differences between the groups. We discuss the implications of these results for understanding both the processes of compensation for a color deficiency and the limits of these processes.

Color Vision: Decoding Color Space

A new study has used magnetoencephalography to track cortical responses to color as they emerge in time. Similarities and differences within these neural responses parallel characteristics of the perceptual experience of color.

The Sensory and Perceptual Scaffolding of Absorption, Inner Speech, and Self in Psychosis

This study examines the interconnectedness between absorption, inner speech, self, and psychopathology. Absorption involves an intense focus and immersion in mental imagery, sensory/perceptual stimuli, or vivid imagination that involves decreased self-awareness and alterations in consciousness. In psychosis, the dissolution and permeability in the demarcation between self and one's sensory experiences and perceptions, and also between self-other and/or inter-object boundaries alter one's sense of self. Thus, as the individual integrates these changes new "meaning making" or understanding evolves as part of an ongoing inner dialogue and dialogue with others. This study consisted of 117 participants: 81 participants with psychosis and 36 controls. We first conducted a bivariate correlation to elucidate the relationship between absorption and inner speech. We next conducted hierarchical multiple regressions to examine the effect of absorption and inner speech to predict psychopathology. Lastly, we conducted a network analysis and applied extended Bayesian Information Criterion to select the best model. We showed that in both the control and psychosis group dialogic and emotional/motivational types of inner speech were strongly associated with absorption subscales, apart from the aesthetic subscale in the control group which was not significant, while in psychosis, condensed inner speech was uniquely associated with increased imaginative involvement. In psychosis, we also demonstrated that altered consciousness, dialogic, and emotional/motivational inner speech all predicted positive symptoms. In terms of network associations, imaginative involvement was the most central, influential, and most highly predictive node in the model from which all other nodes related to inner speech and psychopathology are connected. This study shows a strong interrelatedness between absorption, inner speech and psychosis thus identifying potentially fertile ground for future research and directions, particularly in the exploration into the underlying construct of imaginative involvement in psychotic symptoms.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

The misuse of colour in science communication

The accurate representation of data is essential in science communication. However, colour maps that visually distort data through uneven colour gradients or are unreadable to those with colour-vision deficiency remain prevalent in science. These include, but are not limited to, rainbow-like and red-green colour maps. Here, we present a simple guide for the scientific use of colour. We show how scientifically derived colour maps report true data variations, reduce complexity, and are accessible for people with colour-vision deficiencies. We highlight ways for the scientific community to identify and prevent the misuse of colour in science, and call for a proactive step away from colour misuse among the community, publishers, and the press.

Predicting color matches from luminance matches

Color vision and spectral sensitivity vary among individuals with normal color vision; thus, for many applications, it is important to measure and correct for an observer's sensitivity. Full correction would require measuring color and luminance matches and is rarely implemented. However, luminance matches (equiluminance settings) are routinely measured and simple to conduct. We modeled how well an observer's color matches could be approximated by measuring only luminance sensitivity, since both depend on a common set of factors. We show that lens and macular pigment density and $L/M$L/M cone ratios alter equiluminance settings in different ways and can therefore be estimated from the settings. In turn, the density variations can account for a large proportion of the normal variation in color matching. Thus, luminance matches may provide a simple method to at least partially predict an observer's color matches without requiring more complex tasks or equipment.

The Verriest Lecture: Adventures in blue and yellow

Conventional models of color vision assume that blue and yellow (along with red and green) are the fundamental building blocks of color appearance, yet how these hues are represented in the brain and whether and why they might be special are questions that remain shrouded in mystery. Many studies have explored the visual encoding of color categories, from the statistics of the environment to neural processing to perceptual experience. Blue and yellow are tied to salient features of the natural color world, and these features have likely shaped several important aspects of color vision. However, it remains less certain that these dimensions are encoded as primary or "unique" in the visual representation of color. There are also striking differences between blue and yellow percepts that may reflect high-level inferences about the world, specifically about the colors of light and surfaces. Moreover, while the stimuli labeled as blue or yellow or other basic categories show a remarkable degree of constancy within the observer, they all vary independently of one another across observers. This pattern of variation again suggests that blue and yellow and red and green are not a primary or unitary dimension of color appearance, and instead suggests a representation in which different hues reflect qualitatively different categories rather than quantitative differences within an underlying low-dimensional "color space."