The biological bases of colour categorisation: From goldfish to the human brain

Should absolute pitch be considered as a unique kind of absolute sensory judgment in humans? A systematic and theoretical review of the literature

Absolute pitch is the name given to the rare ability to identify a musical note in an automatic and effortless manner without the need for a reference tone. Those individuals with absolute pitch can, for example, name the note they hear, identify all of the tones of a given chord, and/or name the pitches of everyday sounds, such as car horns or sirens. Hence, absolute pitch can be seen as providing a rare example of absolute sensory judgment in audition. Surprisingly, however, the intriguing question of whether such an ability presents unique features in the domain of sensory perception, or whether instead similar perceptual skills also exist in other sensory domains, has not been explicitly addressed previously. In this paper, this question is addressed by systematically reviewing research on absolute pitch using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) method. Thereafter, we compare absolute pitch with two rare types of sensory experience, namely synaesthesia and eidetic memory, to understand if and how these phenomena exhibit similar features to absolute pitch. Furthermore, a common absolute perceptual ability that has been often compared to absolute pitch, namely colour perception, is also discussed. Arguments are provided supporting the notion that none of the examined abilities can be considered like absolute pitch. Therefore, we conclude by suggesting that absolute pitch does indeed appear to constitute a unique kind of absolute sensory judgment in humans, and we discuss some open issues and novel directions for future research in absolute pitch.

Rapid color categorization revealed by frequency-tagging-based EEG

There has been much debate on whether color categories affect how we perceive color. Recent theories have put emphasis on the role of top-down influence on color perception that the original continuous color space in the visual cortex may be transformed into categorical encoding due to top-down modulation. To test the influence of color categories on color perception, we adopted an RSVP paradigm, where color stimuli were presented at a fast speed of 100 ms per stimulus and were forward and backward masked by the preceding and following stimuli. Moreover, no explicit color naming or categorization was required. In theory, backward masking with such a short interval in a passive viewing task should constrain top-down influence from higher-level brain areas. To measure any potentially subtle differences in brain response elicited by different color categories, we embedded a sensitive frequency-tagging-based EEG paradigm within the RSVP stimuli stream where the oddball color stimuli were encoded with a different frequency from the base color stimuli. We showed that EEG responses to cross-category oddball colors at the frequency where the oddball stimuli were presented was significantly larger than the responses to within-category oddball colors. Our study suggested that the visual cortex can automatically and implicitly encode color categories when color stimuli are presented rapidly.

Visual mental imagery: Evidence for a heterarchical neural architecture

Theories of Visual Mental Imagery (VMI) emphasize the processes of retrieval, modification, and recombination of sensory information from long-term memory. Yet, only few studies have focused on the behavioral mechanisms and neural correlates supporting VMI of stimuli from different semantic domains. Therefore, we currently have a limited understanding of how the brain generates and maintains mental representations of colors, faces, shapes - to name a few. Such an undetermined scenario renders unclear the organizational structure of neural circuits supporting VMI, including the role of the early visual cortex. We aimed to fill this gap by reviewing the scientific literature of five semantic domains: visuospatial, face, colors, shapes, and letters imagery. Linking theory to evidence from over 60 different experimental designs, this review highlights three main points. First, there is no consistent activity in the early visual cortex across all VMI domains, contrary to the prediction of the dominant model. Second, there is consistent activity of the frontoparietal networks and the left hemisphere's fusiform gyrus during voluntary VMI irrespective of the semantic domain investigated. We propose that these structures are part of a domain-general VMI sub-network. Third, domain-specific information engages specific regions of the ventral and dorsal cortical visual pathways. These regions partly overlap with those found in visual perception studies (e.g., fusiform face area for faces imagery; lingual gyrus for color imagery). Altogether, the reviewed evidence suggests the existence of domain-general and domain-specific mechanisms of VMI selectively engaged by stimulus-specific properties (e.g., colors or faces). These mechanisms would be supported by an organizational structure mixing vertical and horizontal connections (heterarchy) between sub-networks for specific stimulus domains. Such a heterarchical organization of VMI makes different predictions from current models of VMI as reversed perception. Our conclusions set the stage for future research, which should aim to characterize the spatiotemporal dynamics and interactions among key regions of this architecture giving rise to visual mental images.

Acquisition of colour categories through learning: Differences between hue and lightness

Colour categories are acquired through learning, but the nature of this process is not fully understood. Some category distinctions are defined by hue (e.g. red/purple) but other by lightness (red/pink). The aim of this study was to investigate if the acquisition of key information for making accurate cross-boundary discriminations poses different challenges for hue-defined as opposed to lightness-defined boundaries. To answer this question, hue- and lightness-learners were trained on a novel category boundary within the GREEN region of colour space. After training, hue- and lightness-learners as well as untrained controls performed delayed same-different discrimination for lightness and hue pairs. In addition to discrimination data, errors during learning and category-labelling strategies were examined. Errors during learning distributed non-uniformly and in accordance with the Bezold-Brücke effect, which accounts for darker colours at the green-blue boundary appearing greener and lighter colours appearing bluer. Only hue-learners showed discrimination improvements due to category boundary acquisition. Thus, acquisition is more efficient for hue-category compared to lightness-category boundaries. Almost all learners reported using category-labelling strategies, with hue-learners almost exclusively using 'green'/'blue' and lightness learners using a wider range of labels, most often 'light'/'dark'. Thus, labels play an important role in colour category learning and such labelling does not conform to everyday naming: here, the label 'blue' is used for exemplars that would normally be named 'green'. In conclusion, labelling serves the purpose of highlighting key information that differentiates exemplars across the category boundary, and basic colour terms may be particularly effective in facilitating such attentional guidance.

Corvids optimize working memory by categorizing continuous stimuli

Working memory (WM) is a crucial element of the higher cognition of primates and corvid songbirds. Despite its importance, WM has a severely limited capacity and is vulnerable to noise. In primates, attractor dynamics mitigate the effect of noise by discretizing continuous information. Yet, it remains unclear whether similar dynamics are seen in avian brains. Here, we show jackdaws (Corvus monedula) have similar behavioral biases as humans; memories are less precise and more biased as memory demands increase. Model-based analysis reveal discrete attractors are evenly spread across the stimulus space. Altogether, our comparative approach suggests attractor dynamics in primates and corvids mitigate the effect of noise by systematically drifting towards specific attractors. By demonstrating this effect in an evolutionary distant species, our results strengthen attractor dynamics as general, adaptive biological principle to efficiently use WM.

Brain activity characteristics of RGB stimulus: an EEG study

The perception of color is a fundamental cognitive feature of our psychological experience, with an essential role in many aspects of human behavior. Several studies used magnetoencephalography, functional magnetic resonance imaging, and electroencephalography (EEG) approaches to investigate color perception. Their methods includes the event-related potential and spectral power activity of different color spaces, such as Derrington-Krauskopf-Lennie and red-green-blue (RGB), in addition to exploring the psychological and emotional effects of colors. However, we found insufficient studies in RGB space that considered combining all aspects of EEG signals. Thus, in the present study, focusing on RGB stimuli and using a data-driven approach, we investigated significant differences in the perception of colors. Our findings show that beta oscillation of green compared to red and blue colors occurs in early sensory periods with a latency shifting in the occipital region. Furthermore, in the occipital region, the theta power of the blue color decreases noticeably compared to the other colors. Concurrently, in the prefrontal area, we observed an increase in phase consistency in response to the green color, while the blue color showed a decrease. Therefore, our results can be used to interpret the brain activity mechanism of color perception in RGB color space and to choose suitable colors for more efficient performance in cognitive activities.

Colour perception changes with basic colour word comprehension

Recent work has investigated the origin of infant colour categories, showing pre-linguistic infants categorise colour even in the absence of colour words. These infant categories are similar but not identical to adult categories, giving rise to an important question about how infant colour perception changes with the learning of colour words. Here we present two novel paradigms in which 12- and 19-month-old participants learning English as their first language were assessed on their perception of colour, while data on their colour word comprehension were also collected. Results indicate that participants' perception of colours close to the colour category boundaries dramatically change after colour word learning. The results highlight the shift made from infant colour categories to adult-like linguistically mediated colour categories that accompanies colour word learning. RESEARCH HIGHLIGHTS: We aimed to test whether colour perception is linguistically mediated in infants. We used novel eye-tracking and pupillometry paradigms to test infant colour perception either side of learning colour words. Infants' discrimination of colour changes after learning colour words, suggesting a shift due to colour word learning. A shift from pre-linguistic colour representation to linguistically mediated colour representation is discussed.

Categorical encoding of moving colors during location tracking

Categorical perception (CP) describes our tendency to perceive the visual world in a categorical manner, suggesting that high-level cognition may affect perception. While most studies are conducted in static visual scenes, Sun and colleagues found CP effects of color in multiple object tracking (MOT). This study used functional magnetic resonance imaging to investigate the neural mechanism behind the categorical effects of color in MOT. Categorical effects were associated with activities in a broad range of brain regions, including both the ventral (V4, middle temporal gyrus) and dorsal pathways (MT + /V5, inferior parietal lobule) of feature processing, as well as frontal regions (middle frontal gyrus, medial superior frontal gyrus). We proposed that these regions are hierarchically organized and responsible for distinct functions. The color-selective V4 encodes color categories, making cross-category colors more discriminable than within-category colors. Meanwhile, the language and/or semantic regions encode the verbal information of the colors. Both visual and nonvisual codes of color categories then modulate the activities of motion-sensitive MT + areas and frontal areas responsible for attentional processes.

The Development of Color Perception and Cognition

Color is a pervasive feature of our psychological experience, having a role in many aspects of human mind and behavior such as basic vision, scene perception, object recognition, aesthetics, and communication. Understanding how humans encode, perceive, talk about, and use color has been a major interdisciplinary effort. Here, we present the current state of knowledge on how color perception and cognition develop. We cover the development of various aspects of the psychological experience of color, ranging from low-level color vision to perceptual mechanisms such as color constancy to phenomena such as color naming and color preference. We also identify neurodiversity in the development of color perception and cognition and implications for clinical and educational contexts. We discuss the theoretical implications of the research for understanding mature color perception and cognition, for identifying the principles of perceptual and cognitive development, and for fostering a broader debate in the psychological sciences.

Infant color perception: Insight into perceptual development

A remarkable amount of perceptual development occurs in the first year after birth. In this article, we spotlight the case of color perception. We outline how within just 6 months, infants go from very limited detection of color as newborns to a more sophisticated perception of color that enables them to make sense of objects and the world around them. We summarize the evidence that by 6 months, infants can perceive the dimensions of color and categorize it, and have at least rudimentary mechanisms to keep color perceptually constant despite variation in illumination. In addition, infants’ sensitivity to color relates to statistical regularities of color in natural scenes. We illustrate the contribution of these findings to understanding the development of perceptual skills such as discrimination, categorization, and constancy. We also discuss the relevance of the findings for broader questions about perceptual development and identify directions for research.

Language Modulates Categorical Effects of Moving Color Objects

Categorical perception (CP) of color claims that colors from different linguistic categories are discriminated more easily than those from the same category, suggesting that language may interact with visual perception. However, controversy remains regarding whether CP effects derive from language. Recently, CP effects were found in a dynamic paradigm named multiple object tracking (MOT). Here, we investigated whether this kind of CP is dependent on online use of language. We found that the CP effects are reduced by verbal interference when the participants were required to memorize color words during tracking (Experiment 2) but not when the interference stimuli were digits (Experiment 1). Our study suggested that the CP effects in tracking depend partly on online use of language and that the difficulty of verbal interference tasks influences the capability of disrupting CP.

Visual objects and their colors

The ventral temporal cortex hosts key regions for the high-level visual processing of object shape and color. These areas represent nodes of large-scale neural circuits dedicated to object recognition. In the language-dominant hemisphere, some of these regions communicate with the language systems; by assigning verbal labels to percepts, these circuits speedup stimulus categorization, and permit fast and accurate interindividual communication. By impairing the functioning of these circuits, neurological damage may provoke disabling disorders of the processing of visual objects and of their colors. Brain damage of vascular, degenerative, toxic, or traumatic origin can induce deficits at different levels of visual processing, from the building of shape- or wavelength-invariant percepts, to their connections with semantic knowledge and with the appropriate lexical entry. After an overview of the neuroimaging of domain-preferring regions for object shape and color in the ventral temporal cortex, this chapter reviews evidence from historical and recent cases of acquired visual agnosia and color processing deficits. A recurrent motif emerging from patients' patterns of performance and lesion locations is the existence of caudo-rostral gradients in the ventral occipito-temporal cortex, spanning from more perceptual to more cognitive stages of processing.

Color Vision Deficits

PURPOSE OF REVIEW

Color provides important information about the identity of the objects we encounter. After early processing stages in the retinal cones, thalamus, and occipital cortex, retinal signals reach the ventral temporal cortex for high-level color and object processing, which links color perception with top-down expectations and knowledge. In the language-dominant hemisphere, some of these regions communicate with the language systems; by assigning verbal labels to percepts, these circuits speed up stimulus categorization, and permit fast and accurate inter-individual communication. This paper provides a review of color processing deficits, from dysfunction of wavelength discrimination in the retinal photoreceptors to deficits of high-level processing in the ventral temporal cortex.

RECENT FINDINGS

Neuroimaging evidence defined the existence and localization of color-preferring domains in the ventral occipito-temporal cortex. Evidence from the performance of a brain-damaged patient with color anomia but preserved color categorization demonstrated the independence of color categorization from color naming in the adult brain. Evidence from patients with brain damage suggests that high-level color processing may be divided into at least three functional domains: perceptual color experience, color naming, and color knowledge.

Using Delaunay triangulation to sample whole-specimen color from digital images

Color variation is one of the most obvious examples of variation in nature, but biologically meaningful quantification and interpretation of variation in color and complex patterns are challenging. Many current methods for assessing variation in color patterns classify color patterns using categorical measures and provide aggregate measures that ignore spatial pattern, or both, losing potentially important aspects of color pattern.Here, we present Colormesh, a novel method for analyzing complex color patterns that offers unique capabilities. Our approach is based on unsupervised color quantification combined with geometric morphometrics to identify regions of putative spatial homology across samples, from histology sections to whole organisms. Colormesh quantifies color at individual sampling points across the whole sample.We demonstrate the utility of Colormesh using digital images of Trinidadian guppies (Poecilia reticulata), for which the evolution of color has been frequently studied. Guppies have repeatedly evolved in response to ecological differences between up- and downstream locations in Trinidadian rivers, resulting in extensive parallel evolution of many phenotypes. Previous studies have, for example, compared the area and quantity of discrete color (e.g., area of orange, number of black spots) between these up- and downstream locations neglecting spatial placement of these areas. Using the Colormesh pipeline, we show that patterns of whole-animal color variation do not match expectations suggested by previous work.Colormesh can be deployed to address a much wider range of questions about color pattern variation than previous approaches. Colormesh is thus especially suited for analyses that seek to identify the biologically important aspects of color pattern when there are multiple competing hypotheses or even no a priori hypotheses at all.

Neural Hierarchy of Color Categorization: From Prototype Encoding to Boundary Encoding

A long-standing debate exists on how our brain assigns the fine-grained perceptual representation of color into discrete color categories. Recent functional magnetic resonance imaging (fMRI) studies have identified several regions as the candidate loci of color categorization, including the visual cortex, language-related areas, and non-language-related frontal regions, but the evidence is mixed. Distinct from most studies that emphasized the representational differences between color categories, the current study focused on the variability among members within a category (e.g., category prototypes and boundaries) to reveal category encoding in the brain. We compared and modeled brain activities evoked by color stimuli with varying distances from the category boundary in an active categorization task. The frontal areas, including the inferior and middle frontal gyri, medial superior frontal cortices, and insular cortices, showed larger responses for colors near the category boundary than those far from the boundary. In addition, the visual cortex encodes both within-category variability and cross-category differences. The left V1 in the calcarine showed greater responses to colors at the category center than to those far from the boundary, and the bilateral V4 showed enhanced responses for colors at the category center as well as colors around the boundary. The additional representational similarity analyses (RSA) revealed that the bilateral insulae and V4a carried information about cross-category differences, as cross-category colors exhibited larger dissimilarities in brain patterns than within-category colors. Our study suggested a hierarchically organized network in the human brain during active color categorization, with frontal (both lateral and medial) areas supporting domain-general decisional processes and the visual cortex encoding category structure and differences, likely due to top-down modulation.

Colour Discrimination From Perceived Differences by Birds

The ability of visual generalists to see and perceive displayed colour signals is essential to understanding decision making in natural environments. Whilst modelling approaches have typically considered relatively simple physiological explanations of how colour may be processed, data on key bee species reveals that colour is a complex multistage perception largely generated by opponent neural representations in a brain. Thus, a biologically meaningful unit of colour information must consider the psychophysics responses of an animal engaged in colour decision making. We extracted previously collected psychophysics data for a Violet-Sensitive (VS) bird, the pigeon (Columba livia), and used a non-linear function that reliably represents the behavioural choices of hymenopteran and dipteran pollinators to produce the first behaviourally validated and biologically meaningful representation of how VS birds use colour information in a probabilistic way. The function describes how similar or dis-similar spectral information can lead to different choice behaviours in birds, even though all such spectral information is above discrimination threshold. This new representation of bird vision will enable enhanced modelling representations of how bird vision can sense and use colour information in complex environments.

Decoding chromaticity and luminance from patterns of EEG activity

A long-standing question in the field of vision research is whether scalp-recorded EEG activity contains sufficient information to identify stimulus chromaticity. Recent multivariate work suggests that it is possible to decode which chromaticity an observer is viewing from the multielectrode pattern of EEG activity. There is debate, however, about whether the claimed effects of stimulus chromaticity on visual evoked potentials (VEPs) are instead caused by unequal stimulus luminances, which are achromatic differences. Here, we tested whether stimulus chromaticity could be decoded when potential confounds with luminance were minimized by (1) equating chromatic stimuli in luminance using heterochromatic flicker photometry for each observer and (2) independently varying the chromaticity and luminance of target stimuli, enabling us to test whether the pattern for a given chromaticity generalized across wide variations in luminance. We also tested whether luminance variations can be decoded from the topography of voltage across the scalp. In Experiment 1, we presented two chromaticities (appearing red and green) at three luminance levels during separate trials. In Experiment 2, we presented four chromaticities (appearing red, orange, yellow, and green) at two luminance levels. Using a pattern classifier and the multielectrode pattern of EEG activity, we were able to accurately decode the chromaticity and luminance level of each stimulus. Furthermore, we were able to decode stimulus chromaticity when we trained the classifier on chromaticities presented at one luminance level and tested at a different luminance level. Thus, EEG topography contains robust information regarding stimulus chromaticity, despite large variations in stimulus luminance.

Color Naming and Categorization Depend on Distinct Functional Brain Networks

Naming a color can be understood as an act of categorization, that is, identifying it as a member of a category of colors that are referred to by the same name. But are naming and categorization equivalent cognitive processes and consequently rely on same neural substrates? Here, we used task and resting-state functional magnetic resonance imaging as well as behavioral measures to identify functional brain networks that modulated naming and categorization of colors. We first identified three bilateral color-sensitive regions in the ventro-occipital cortex. We then showed that, across participants, color naming and categorization response times (RTs) were correlated with different resting state connectivity networks seeded from the color-sensitive regions. Color naming RTs correlated with the connectivity between the left posterior color region, the left middle temporal gyrus, and the left angular gyrus. In contrast, color categorization RTs correlated with the connectivity between the bilateral posterior color regions, and left frontal, right temporal and bilateral parietal areas. The networks supporting naming and categorization had a minimal overlap, indicating that the 2 processes rely on different neural mechanisms.

Ensemble coding of color and luminance contrast

Ensemble coding has been demonstrated for many attributes including color, but the metrics on which this coding is based remain uncertain. We examined ensemble percepts for stimulus sets that varied in chromatic contrast between complementary hues, or that varied in luminance contrast between increments and decrements, in both cases focusing on the ensemble percepts for the neutral gray stimulus defining the category boundary. Each ensemble was composed of 16 circles with four contrast levels. Observers saw the display for 0.5 s and then judged whether a target contrast was a member of the set. False alarms were high for intermediate contrasts (within the range of the ensemble) and fell for higher or lower values. However, for ensembles with complementary hues, gray was less likely to be reported as a member, even when it represented the mean chromaticity of the set. When the settings were repeated for luminance contrast, false alarms for gray were higher and fell off more gradually for out-of-range contrasts. This difference implies that opposite luminance polarities represent a more continuous perceptual dimension than opponent-color variations, and that "gray" is a stronger category boundary for chromatic than luminance contrasts. For color, our results suggest that ensemble percepts reflect pooling within rather than between large hue differences, perhaps because the visual system represents hue differences more like qualitatively different categories than like quantitative differences within an underlying color "space." The differences for luminance and color suggest more generally that ensemble coding for different visual attributes might depend on different processes that in turn depend on the format of the visual representation.

Does conspicuousness scale linearly with colour distance? A test using reef fish

To be effective, animal colour signals must attract attention-and therefore need to be conspicuous. To understand the signal function, it is useful to evaluate their conspicuousness to relevant viewers under various environmental conditions, including when visual scenes are cluttered by objects of varying colour. A widely used metric of colour difference (ΔS) is based on the receptor noise limited (RNL) model, which was originally proposed to determine when two similar colours appear different from one another, termed the discrimination threshold (or just noticeable difference). Estimates of the perceptual distances between colours that exceed this threshold-termed 'suprathreshold' colour differences-often assume that a colour's conspicuousness scales linearly with colour distance, and that this scale is independent of the direction in colour space. Currently, there is little behavioural evidence to support these assumptions. This study evaluated the relationship between ΔS and conspicuousness in suprathreshold colours using an Ishihara-style test with a coral reef fish, Rhinecanthus aculeatus. As our measure of conspicuousness, we tested whether fish, when presented with two colourful targets, preferred to peck at the one with a greater ΔS - from the average distractor colour. We found the relationship between ΔS and conspicuousness followed-- a sigmoidal function, with high ΔS colours perceived as equally conspicuous. We found that the relationship between ΔS and conspicuousness varied across colour space (i.e. for different hues). The sigmoidal detectability curve was little affected by colour variation in the background or when colour distance was calculated using a model that does not incorporate receptor noise. These results suggest that the RNL model may provide accurate estimates for perceptual distance for small suprathreshold distance colours, even in complex viewing environments, but must be used with caution with perceptual distances exceeding- -10 ΔS.

What Cognitive Neurology Teaches Us about Our Experience of Color

Color provides valuable information about the environment, yet the exact mechanisms explaining how colors appear to us remain poorly understood. Retinal signals are processed in the visual cortex through high-level mechanisms that link color perception with top-down expectations and knowledge. Here, we review the neuroimaging evidence about color processing in the brain, and how it is affected by acquired brain lesions in humans. Evidence from patients with brain-damage suggests that high-level color processing may be divided into at least three modules: perceptual color experience, color naming, and color knowledge. These modules appear to be functionally independent but richly interconnected, and serve as cortical relays linking sensory and semantic information, with the final goal of directing object-related behavior. We argue that the relations between colors and their objects are key mechanisms to understand high-level color processing.