Advances in color science: from retina to behavior

Hue and orientation pinwheels in macaque area V4

Area V4 is an intermediate-level area of the macaque visual cortical hierarchy that serves key functions in visual processing by integrating inputs from lower areas such as V1 and V2 and providing feedforward inputs to many higher cortical areas. Previous V4 imaging studies have focused on differential responses to color, orientation, disparity, and motion stimuli, but many details of the spatial organization of significant hue and orientation tuning have not been fully described. We used support vector machine (SVM) decoding of intrinsic cortical single-condition responses to generate high-resolution maps of hue and orientation tuning and to describe the organization of hue and orientation pinwheels in V4. Like V1 and V2, V4 contains maps of orientation that are organized as pinwheels. V4 also contains maps of hue that are organized as pinwheels, whose circular organization more closely represents the perception of hue than is observed in antecedent cortical areas. Unlike V1, where orientation is continuously mapped across the surface, V4 hue and orientation pinwheels are organized in limited numbers of pinwheel sequences. The organization of these sequences and the distance between pinwheels may provide insight into the functional organization of V4. Regions significantly tuned for hue occupy roughly four times that of the orientation, are largely separated from each other, and overlap by roughly 5%. This spatial organization is largely consistent with segregated inputs arising from V2 thin and interstripes. This modular organization of V4 suggests that further integration of color and shape might occur in higher areas in inferotemporal cortical.NEW & NOTEWORTHY The representation of hue and orientation in macaque monkey area V4 was determined by intrinsic cortical imaging of responses to isoluminant hues and achromatic grating stimuli. Vector summation of support vector machine (SVM) decoded single-condition responses was used to generate hue and orientation maps that, like V1 orientation maps, were both characterized by distinct pinwheel patterns. These data suggest that pinwheels are an important structure to represent different stimulus features across multiple visual cortical areas.

Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

The development of artificial intelligence has posed a challenge to machine vision based on conventional complementary metal-oxide semiconductor (CMOS) circuits owing to its high latency and inefficient power consumption originating from the data shuffling between memory and computation units. Gaining more insights into the function of every part of the visual pathway for visual perception can bring the capabilities of machine vision in terms of robustness and generality. Hardware acceleration of more energy-efficient and biorealistic artificial vision highly necessitates neuromorphic devices and circuits that are able to mimic the function of each part of the visual pathway. In this paper, we review the structure and function of the entire class of visual neurons from the retina to the primate visual cortex within reach (Chapter 2) are reviewed. Based on the extraction of biological principles, the recent hardware-implemented visual neurons located in different parts of the visual pathway are discussed in detail in Chapters 3 and 4. Furthermore, valuable applications of inspired artificial vision in different scenarios (Chapter 5) are provided. The functional description of the visual pathway and its inspired neuromorphic devices/circuits are expected to provide valuable insights for the design of next-generation artificial visual perception systems.

Spatial Attention in Visual Working Memory Strengthens Feature-Location Binding

There is a debate about whether working memory (WM) representations are individual features or bound objects. While spatial attention is reported to play a significant role in feature binding, little is known about the role of spatial attention in WM. To address this gap, the current study required participants to maintain multiple items in their WM and employed a memory-driven attention capture paradigm. Spatial attention in WM was manipulated by presenting an exogenous cue at one of the locations that memory items had occupied. The effects of spatial attention on attention guidance in visual search (Experiment 1) and memory performance (Experiments 1 and 2) were explored. The results show that WM-driven attention guidance did not vary based on whether the search features came from the same object in WM; instead, it depended on the number of features, regardless of their source object. In memory tasks, the cued object outperformed the uncued object. Specifically, the test item was better rejected when the features were mis-bound in the cued location than in the uncued location. These findings suggest that memory-driven attention guidance is feature-based, and spatial attention in WM helps bind features into object structures based on location.

Analysis of convolutional neural networks reveals the computational properties essential for subcortical processing of facial expression

Perception of facial expression is crucial for primate social interactions. This visual information is processed through the ventral cortical pathway and the subcortical pathway. However, the subcortical pathway exhibits inaccurate processing, and the responsible architectural and physiological properties remain unclear. To investigate this, we constructed and examined convolutional neural networks with three key properties of the subcortical pathway: a shallow layer architecture, concentric receptive fields at the initial processing stage, and a greater degree of spatial pooling. These neural networks achieved modest accuracy in classifying facial expressions. By replacing these properties, individually or in combination, with corresponding cortical features, performance gradually improved. Similar to amygdala neurons, some units in the final processing layer exhibited sensitivity to retina-based spatial frequencies (SFs), while others were sensitive to object-based SFs. Replacement of any of these properties affected the coordinates of the SF encoding. Therefore, all three properties limit the accuracy of facial expression information and are essential for determining the SF representation coordinate. These findings characterize the role of the subcortical computational processes in facial expression recognition.

Comparing the Dominance of Color and Form Information across the Human Ventral Visual Pathway and Convolutional Neural Networks

Color and form information can be decoded in every region of the human ventral visual hierarchy, and at every layer of many convolutional neural networks (CNNs) trained to recognize objects, but how does the coding strength of these features vary over processing? Here, we characterize for these features both their absolute coding strength-how strongly each feature is represented independent of the other feature-and their relative coding strength-how strongly each feature is encoded relative to the other, which could constrain how well a feature can be read out by downstream regions across variation in the other feature. To quantify relative coding strength, we define a measure called the form dominance index that compares the relative influence of color and form on the representational geometry at each processing stage. We analyze brain and CNN responses to stimuli varying based on color and either a simple form feature, orientation, or a more complex form feature, curvature. We find that while the brain and CNNs largely differ in how the absolute coding strength of color and form vary over processing, comparing them in terms of their relative emphasis of these features reveals a striking similarity: For both the brain and for CNNs trained for object recognition (but not for untrained CNNs), orientation information is increasingly de-emphasized, and curvature information is increasingly emphasized, relative to color information over processing, with corresponding processing stages showing largely similar values of the form dominance index.

The Development of Color Perception and Cognition

Color is a pervasive feature of our psychological experience, having a role in many aspects of human mind and behavior such as basic vision, scene perception, object recognition, aesthetics, and communication. Understanding how humans encode, perceive, talk about, and use color has been a major interdisciplinary effort. Here, we present the current state of knowledge on how color perception and cognition develop. We cover the development of various aspects of the psychological experience of color, ranging from low-level color vision to perceptual mechanisms such as color constancy to phenomena such as color naming and color preference. We also identify neurodiversity in the development of color perception and cognition and implications for clinical and educational contexts. We discuss the theoretical implications of the research for understanding mature color perception and cognition, for identifying the principles of perceptual and cognitive development, and for fostering a broader debate in the psychological sciences.

Effects of acute high intraocular pressure on red-green and blue-yellow cortical color responses in non-human primates

Glaucoma is a leading cause of irreversible blindness worldwide, and intraocular pressure (IOP) is an established and modifiable risk factor for both chronic and acute glaucoma. The relationship between color vision deficits and chronic glaucoma has been described previously. However, the effects of acute glaucoma or acute primary angle closure, which has high prevalence in China, on color vision remains unclear. To address the above question, red-green or blue-yellow color responses in V1, V2, and V4 of seven rhesus macaques were monitored using intrinsic-signal optical imaging while monocular anterior chamber perfusions were performed to reversibly elevate IOP acutely over a clinically observed range of 30 to 90 mmHg. We found that the cortical population responses to both red-green and blue-yellow grating stimuli, systematically decreased as IOP increased from 30 to 90 mmHg. Although a similar decrement in magnitude was noted in V1, V2, and V4, blue-yellow responses were consistently more impaired than red-green responses at all levels of acute IOP elevation and in all monitored visual areas. This physiological study in non-human primates demonstrates that acute IOP elevations substantially depress the ability of the visual cortex to register color information. This effect is more severe for blue-yellow responses than for red-green responses, suggesting selective impairment of the koniocellular pathways compared with the parvocellular pathways. Together, we infer that blue-yellow color vision might be the most vulnerable visual function in acute glaucoma patients.

Signals from Single-Opponent Cortical Cells in the Human cVEP

We used the chromatic visual evoked potential (cVEP) to study responses in human visual cortex evoked by equiluminant color stimuli for 6 male and 11 female observers. Large-area, colored squares were used to stimulate Single-Opponent cells preferentially, and fine color-checkerboard stimuli were used to activate Double-Opponent responses preferentially. Stimuli were modulated along the following two directions in color space: (1) the cardinal direction, L-M or M-L of DKL (Derrington, Krauskopf, and Lennie) space; and (2) the line from the white point to the color of the Red LED in the display screen, which was approximately intermediate between the L-M and -S directions in DKL space in cone-contrast coordinates. The amplitudes of cVEPs to large squares were smaller than those to checkerboards, and the latency of the cVEP response to squares was significantly less than the checkerboard latency. The latency of cVEP responses to the squares varied little with cone-contrast unlike the steep reduction of latency with cone-contrast observed in responses to color checkerboard patterns. The dynamic differences between cVEPs to squares and checkerboards support the hypothesis that a distinct neuronal mechanism responded to squares: Single-Opponent cells. Response amplitude, latency, and transientness-and their dependence on cone-contrast-were similar in the responses in the L-M and Red color directions. The similarity supports the hypothesis that the Single-Opponent signals in the cVEP come from a distinct population of cells that receives subtractive inputs from L and M cones, either L-M or M-L.SIGNIFICANCE STATEMENT This article is about characterizing the visual behavior of a distinct population of neurons in the human visual cortex, the Single-Opponent color cells. Based on single-cell results in the visual cortex of macaque monkeys, we used large uniformly colored stimuli to isolate the responses of Single-Opponent cells in the chromatic visual evoked potential (cVEP) recorded on the scalp of human observers. VEP signals recorded under conditions believed to reveal Single-Opponent responses are small and transient. Their time course is relatively unaffected by cone-contrast, and they are relatively insensitive to stimulus modulation of short wavelength-sensitive S cones. Because Single-Opponent cells convey signals that can be used to judge the color of scene illumination, knowing their visual properties is important for understanding color vision.

Color Sensitivity of the Duration Aftereffect Depends on Sub- and Supra-second Durations

The perception of duration becomes biased after repetitive duration adaptation; this is known as the duration aftereffect. The duration aftereffect exists in both the sub-second and supra-second ranges. However, it is unknown whether the properties and mechanisms of the adaptation aftereffect differ between sub-second and supra-second durations. In the present study, we addressed this question by investigating the color sensitivity of the duration aftereffect in the sub-second (Experiment 1) and supra-second (Experiment 2) ranges separately. We found that the duration aftereffect in the sub-second range could only partly transfer across different visual colors, whereas the duration aftereffect in the supra-second range could completely transfer across different visual colors. That is, the color-sensitivity of the duration aftereffect in the sub-second duration was stronger than that in the supra-second duration. These results imply that the mechanisms underlying the adaptation aftereffects of the sub-second and supra-second ranges are distinct.

Non-cardinal color mechanism elicitation by stimulus shape: Bringing the S versus L+M color plane to the table

Neurons in the cortex typically respond best to elongated stimuli, or gratings, whereas neurons in the lateral geniculate nucleus (LGN) typically prefer circular stimuli, or spots. Further, neural mechanisms specifically tuned for non-cardinal colors largely do not emerge until the cortex; therefore, the use of gratings should better reveal non-cardinal color mechanisms. This hypothesis has been tested in the isoluminant color plane in macaque monkeys (Stoughton, Lafer-Sousa, Gagin, & Conway, 2012) and in the L–M versus L+M color plane in human subjects (Gegenfurtner & Kiper, 1992). Here, this hypothesis was tested in the third color plane, S versus L+M, in human subjects in two experiments. Experiment 1 tested 10 subjects across four directions in this color plane; Experiment 2 tested three subjects in eight to twelve color directions. Consistent with data from the other two color planes, in both experiments in the S versus L+M color plane, gratings revealed the presence of non-cardinal mechanisms more strongly than did spots.

Infant color perception: Insight into perceptual development

A remarkable amount of perceptual development occurs in the first year after birth. In this article, we spotlight the case of color perception. We outline how within just 6 months, infants go from very limited detection of color as newborns to a more sophisticated perception of color that enables them to make sense of objects and the world around them. We summarize the evidence that by 6 months, infants can perceive the dimensions of color and categorize it, and have at least rudimentary mechanisms to keep color perceptually constant despite variation in illumination. In addition, infants’ sensitivity to color relates to statistical regularities of color in natural scenes. We illustrate the contribution of these findings to understanding the development of perceptual skills such as discrimination, categorization, and constancy. We also discuss the relevance of the findings for broader questions about perceptual development and identify directions for research.

Representation of Color, Form, and their Conjunction across the Human Ventral Visual Pathway

Despite decades of research, our understanding of the relationship between color and form processing in the primate ventral visual pathway remains incomplete. Using fMRI multivoxel pattern analysis, we examined coding of color and form, using a simple form feature (orientation) and a mid-level form feature (curvature), in human ventral visual processing regions. We found that both color and form could be decoded from activity in early visual areas V1 to V4, as well as in the posterior color-selective region and shape-selective regions in ventral and lateral occipitotemporal cortex defined based on their univariate selectivity to color or shape, respectively (the central color region only showed color but not form decoding). Meanwhile, decoding biases towards one feature or the other existed in the color- and shape-selective regions, consistent with their univariate feature selectivity reported in past studies. Additional extensive analyses show that while all these regions contain independent (linearly additive) coding for both features, several early visual regions also encode the conjunction of color and the simple, but not the complex, form feature in a nonlinear, interactive manner. Taken together, the results show that color and form are encoded in a biased distributed and largely independent manner across ventral visual regions in the human brain.

The colors of life: an interdisciplinary artist-in-residence project to research fungal pigments as a gateway to empathy and understanding of microbial life

Background

Biological pigmentation is one of the most intriguing traits of many fungi. It holds significance to scientists, as a sign of biochemical metabolism and organism-environment interaction, and to artists, as the source of natural colors that capture the beauty of the microbial world. Furthermore, the functional roles and aesthetic appeal of biological pigmentation may be a path to inspiring human empathy for microorganisms, which is key to understanding and preserving microbial biodiversity. A project focused on cross-species empathy was initiated and conducted as part of an artist-in-residence program in 2021. The aim of this residency is to bridge the current divide between science and art through interdisciplinary practice focused on fungi.

Results

The residency resulted in multiple products that are designed for artistic and scientific audiences with the central theme of biological pigmentation in fungi and other microorganisms. The first product is a video artwork that focuses on Aspergillus niger as a model organism that produces melanin pigment in a biosynthetic process similar to that of humans. The growth and morphology of this commonplace organism are displayed through video, photo, animation, and time-lapse footage, inviting the viewer to examine the likenesses and overlaps between humans and fungi. The second product is The Living Color Database, an online compendium of biological colors for scientists, artists, and designers. It links organisms across the tree of life, focusing on fungi, bacteria, and archaea, and the colors they express through biological pigmentation. Each pigment is represented in terms of its chemistry, its related biosynthesis, and its color expressions according to different indices: HEX, RGB, and Pantone. It is available at color.bio.

Conclusions

As fungal biotechnology continues to mature into new application areas, it is as important as ever that there is human empathy for these organisms to promote the preservation and appreciation of fungal biodiversity. The products presented here provide paths for artists, scientists, and designers to understand microorganisms through the lens of color, promoting interspecies empathy through research, teaching, and practice.

Optimising metameric spectra for integrative lighting to modulate the circadian system without affecting visual appearance

Smart integrative lighting systems aim to support human health and wellbeing by capitalising on the light-induced effects on circadian rhythms, sleep, and cognitive functions, while optimising the light's visual aspects like colour fidelity, visual comfort, visual preference, and visibility. Metameric spectral tuning could be an instrument to solve potential conflicts between the visual preferences of users with respect to illuminance and chromaticity and the circadian consequences of the light exposure, as metamers can selectively modulate melanopsin-based photoreception without affecting visual properties such as chromaticity or illuminance. This work uses a 6-, 8- and 11-channel LED luminaire with fixed illuminance of 250 lx to systematically investigate the metameric tuning range in melanopic equivalent daylight illuminance (EDI) and melanopic daylight efficacy ratio (melanopic DER) for 561 chromaticity coordinates as optimisation targets (2700 K to 7443 K ± Duv 0 to 0.048), while applying colour fidelity index Rf criteria from the TM-30-20 Annex E recommendations (i.e. Rf [Formula: see text] 85, Rf,h1 [Formula: see text] 85). Our results reveal that the melanopic tuning range increases with rising CCT to a maximum tuning range in melanopic DER of 0.24 (CCT: 6702 K, Duv: 0.003), 0.29 (CCT: 7443 K, Duv: 0) and 0.30 (CCT: 6702, Duv: 0.006), depending on the luminaire's channel number of 6, 8 or 11, respectively. This allows to vary the melanopic EDI from 212.5-227.5 lx up to 275-300 lx without changes in the photopic illuminance (250 lx) or chromaticity ([Formula: see text] [Formula: see text] 0.0014). The highest metameric melanopic Michelson contrast for the 6-, 8- and 11-channel luminaire is 0.16, 0.18 and 0.18, which is accomplished at a CCT of 3017 K (Duv: - 0.018), 3456 K (Duv: 0.009) and 3456 K (Duv: 0.009), respectively. By optimising ~ 490,000 multi-channel LED spectra, we identified chromaticity regions in the CIExy colour space that are of particular interest to control the melanopic efficacy with metameric spectral tuning.

A multiplicity of color-responsive cortical mechanisms revealed by the dynamics of cVEPs

Our results connect higher-order color mechanisms deduced from psychophysics with the known diversity of populations of double-opponent, color-responsive cells in V1. We used the chromatic visual evoked potential, the cVEP, to study responses in human visual cortex to equiluminant color patterns. Stimuli were modulated along three directions in color space: the cardinal directions, L-M and S, and along the line in color space from the white point to the color of the Red LED in the display screen (the Red direction). The Red direction is roughly intermediate between L-M and S in DKL space in cone-contrast coordinates. While cVEP response amplitude, latency, and width--and their dependences on cone contrast-- were similar in the L-M and Red directions, the Transientness of the Red response was significantly greater than for responses to stimuli in the L-M direction and in the S direction. This difference in response dynamics supports the concept that there are multiple, distinct neuronal populations, so-called higher- order color mechanisms, for color perception within human V1 cortex.

Electrophysiological evidence for higher-level chromatic mechanisms in humans

Color vision in humans starts with three types of cones (short [S], medium [M], and long [L] wavelengths) in the retina and three retinal and subcortical cardinal mechanisms, which linearly combine cone signals into the luminance channel (L + M), the red-green channel (L - M), and the yellow-blue channel (S-(L + M)). Chromatic mechanisms at the cortical level, however, are less well characterized. The present study investigated such higher-order chromatic mechanisms by recording electroencephalograms (EEGs) on human observers in a noise masking paradigm. Observers viewed colored stimuli that consisted of a target embedded in noise. Color directions of the target and noise varied independently and systematically in an isoluminant plane of color space. The target was flickering on-off at 3 Hz, eliciting steady-state visual evoked potential (SSVEP) responses. As a result, the masking strength could be estimated from the SSVEP amplitude in the presence of 6 Hz noise. Masking was strongest (i.e. target eliciting smallest SSVEPs) when the target and noise were along the same color direction, and was weakest (i.e. target eliciting highest SSVEPs) when the target and noise were along orthogonal directions. This pattern of results was observed both when the target color varied along the cardinal and intermediate directions, which is evidence for higher-order chromatic mechanisms tuned to intermediate axes. The SSVEP result can be well predicted by a model with multiple broadly tuned chromatic mechanisms. In contrast, a model with only cardinal mechanisms failed to account for the data. These results provide strong electrophysiological evidence for multiple chromatic mechanisms in the early visual cortex of humans.

Neural mechanism of spatio-chromatic opponency in the Drosophila amacrine neurons

Visual animals detect spatial variations of light intensity and wavelength composition. Opponent coding is a common strategy for reducing information redundancy. Neurons equipped with both spatial and spectral opponency have been identified in vertebrates but not yet in insects. The Drosophila amacrine neuron Dm8 was recently reported to show color opponency. Here, we demonstrate Dm8 exhibits spatio-chromatic opponency. Antagonistic convergence of the direct input from the UV-sensing R7s and indirect input from the broadband receptors R1-R6 through Tm3 and Mi1 is sufficient to confer Dm8's UV/Vis (ultraviolet/visible light) opponency. Using high resolution monochromatic stimuli, we show the pale and yellow subtypes of Dm8s, inheriting retinal mosaic characteristics, have distinct spectral tuning properties. Using 2D white-noise stimulus and reverse correlation analysis, we found that the UV receptive field (RF) of Dm8 has a center-inhibition/surround-excitation structure. In the absence of UV-sensing R7 inputs, the polarity of the RF is inverted owing to the excitatory input from the broadband photoreceptors R1-R6. Using a new synGRASP method based on endogenous neurotransmitter receptors, we show that neighboring Dm8s form mutual inhibitory connections mediated by the glutamate-gated chloride channel GluClα, which is essential for both Dm8's spatial opponency and animals' phototactic behavior. Our study shows spatio-chromatic opponency could arise in the early visual stage, suggesting a common information processing strategy in both invertebrates and vertebrates.

Hemifield-specific color perception deficits after unilateral V4α lesions

Functional neuroimaging and patient studies demonstrated significant involvement of ventral area V4α, located in the anterior ventral pathway, in color vision. A low number of case studies reported lesions in close vicinity to this region leading to symptoms of hemiachromatopsia indicating hemifield-specific processing of color information. With the present study, we present the first group study investigating hemiachromatopsia after injury to anterior ventral brain areas. In lateral stimulus presentations with several color perception tasks, we observed symptoms of hemiachromatopsia, which were specific to patients with unilateral lesions to the ventral pathway. Particularly, we identified unilateral lesions to area V4α as an important contribution to color perception deficits under demanding viewing conditions. Our results suggest that color information processed along the anterior ventral path is hemifield-specific and that selective deficits in color perception cannot be fully compensated by the intact contralesional visual stream.

Color vision

Color is a fundamental aspect of normal visual experience. This chapter provides an overview of the role of color in human behavior, a survey of current knowledge regarding the genetic, retinal, and neural mechanisms that enable color vision, and a review of inherited and acquired defects of color vision including a discussion of diagnostic tests.

Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4

The perception of color is an internal label for the inferred spectral reflectance of visible surfaces. To study how spectral representation is transformed through modular subsystems of successive cortical areas, we undertook simultaneous optical imaging of intrinsic signals in macaque V1, V2, and V4, supplemented by higher-resolution electrophysiology and two-photon imaging in awake macaques. We find a progressive evolution in the scale and precision of chromotopic maps, expressed by a uniform blob-like architecture of hue responses within each area. Two-photon imaging reveals enhanced hue-specific cell clustering in V2 compared with V1. A phenomenon of endspectral (red and blue) responses that is clear in V1, recedes in V2, and is virtually absent in V4. The increase in mid- and extra-spectral hue representations through V2 and V4 reflects the nature of hierarchical processing as higher areas read out locations in chromatic space from progressive integration of signals relayed by V1.

Neural correlates of perceptual color inferences as revealed by #thedress

Color constancy involves disambiguating the spectral characteristics of lights and surfaces, for example to distinguish red in white light from white in red light. Solving this problem appears especially challenging for bluish tints, which may be attributed more often to shading, and this bias may underlie the individual differences in whether people described the widely publicized image of #thedress as blue-black or white-gold. To probe these higher-level color inferences, we examined neural correlates of the blue-bias, using frequency-tagging and high-density electroencephalography to monitor responses to 3-Hz alternations between different color versions of #thedress. Specifically, we compared relative neural responses to the original “blue” dress image alternated with the complementary “yellow” image (formed by inverting the chromatic contrast of each pixel). This image pair produced a large modulation of the electroencephalography amplitude at the alternation frequency, consistent with a perceived contrast difference between the blue and yellow images. Furthermore, decoding topographical differences in the blue-yellow asymmetries over occipitoparietal channels predicted blue-black and white-gold observers with over 80% accuracy. The blue-yellow asymmetry was stronger than for a “red” versus “green” pair matched for the same component differences in L versus M or S versus LM chromatic contrast as the blue-yellow pair and thus cannot be accounted for by asymmetries within either precortical cardinal mechanism. Instead, the results may point to neural correlates of a higher-level perceptual representation of surface colors.

A metal-free blue chromophore derived from plant pigments

Blue natural pigments are rare, especially among plants. However, flowering species that evolved to attract Hymenoptera pollinators are colored by blue anthocyanin-metal complexes. Plants lacking anthocyanins are pigmented by betalains but are unable to produce blue hues. By extending the π-system of betalains, we designed a photostable and metal-free blue dye named BeetBlue that did not show toxicity to human hepatic and retinal pigment epithelial cells and does not affect zebrafish embryonal development. This chiral dye can be conveniently synthesized from betalamic acid obtained from hydrolyzed red beetroot juice or by enzymatic oxidation of l-dopa. BeetBlue is blue in the solid form and in solution of acidified polar molecular solvents, including water. Its capacity to dye natural matrices makes BeetBlue the prototype of a new class of low-cost bioinspired chromophores suitable for a myriad of applications requiring a blue hue.

Circuit Mechanisms Underlying Chromatic Encoding in Drosophila Photoreceptors

Spectral information is commonly processed in the brain through generation of antagonistic responses to different wavelengths. In many species, these color opponent signals arise as early as photoreceptor terminals. Here, we measure the spectral tuning of photoreceptors in Drosophila. In addition to a previously described pathway comparing wavelengths at each point in space, we find a horizontal-cell-mediated pathway similar to that found in mammals. This pathway enables additional spectral comparisons through lateral inhibition, expanding the range of chromatic encoding in the fly. Together, these two pathways enable efficient decorrelation and dimensionality reduction of photoreceptor signals while retaining maximal chromatic information. A biologically constrained model accounts for our findings and predicts a spatio-chromatic receptive field for fly photoreceptor outputs, with a color opponent center and broadband surround. This dual mechanism combines motifs of both an insect-specific visual circuit and an evolutionarily convergent circuit architecture, endowing flies with the ability to extract chromatic information at distinct spatial resolutions.

The Psychophysical Assessment of Hierarchical Magno-, Parvo- and Konio-Cellular Visual Stream Dysregulations in Migraineurs

Introduction

Although conscious, image-forming illusions have been noted in migraine, few studies have specifically sought to collectively evaluate the role of all three parallel visual processing streams in the retinogeniculostriate pathway involved with image-forming vision and their implications in the development of migraine symptoms.

Methods

We psychophysically assessed the functionality of the inferred magnocellular (MC), parvocellular (PC), and koniocellular (KC) streams at different hierarchical loci across three clinical groups: individuals who experience migraine with aura (MA; n=13), experience migraine without aura (MWO; n=14), and Controls (n=15). Participants completed four experiments: Experiment 1 designed to assess retinal short-wavelength-sensitive (S-) cone sensitivities; Experiment 2 intended to measure postretinal temporal and spatiochromatic contrast sensitivities; Experiment 3 intended to assess postretinal spatiotemporal achromatic contrast sensitivities; and Experiment 4 designed to measure thalamocortical color discriminations along the three cone-excitation axes.

Results

S-cone deficits were revealed with greater retinal areas being affected in MA compared to MWO participants. Findings across the four experiments suggest a prominent retinal locus of dysfunction in MA (lesser in MWO) with potential feedforward compensations occurring within the KC visual stream.

Conclusion

Complex, integrative network compensations need to be factored in when considering the dysregulating influences of migraine along the visual pathway.

Reconciling the statistics of spectral reflectance and colour

The spectral reflectance function of a surface specifies the fraction of the illumination reflected by it at each wavelength. Jointly with the illumination spectral density, this function determines the apparent colour of the surface. Models for the distribution of spectral reflectance functions in the natural environment are considered. The realism of the models is assessed in terms of the individual reflectance functions they generate, and in terms of the overall distribution of colours which they give rise to. Both realism assessments are made in comparison to empirical datasets. Previously described models (PCA- and fourier-based) of reflectance function statistics are evaluated, as are improved versions; and also a novel model, which synthesizes reflectance functions as a sum of sigmoid functions. Key model features for realism are identified. The new sigmoid-sum model is shown to be the most realistic, generating reflectance functions that are hard to distinguish from real ones, and accounting for the majority of colours found in natural images with the exception of an abundance of vegetation green and sky blue.

What Cognitive Neurology Teaches Us about Our Experience of Color

Color provides valuable information about the environment, yet the exact mechanisms explaining how colors appear to us remain poorly understood. Retinal signals are processed in the visual cortex through high-level mechanisms that link color perception with top-down expectations and knowledge. Here, we review the neuroimaging evidence about color processing in the brain, and how it is affected by acquired brain lesions in humans. Evidence from patients with brain-damage suggests that high-level color processing may be divided into at least three modules: perceptual color experience, color naming, and color knowledge. These modules appear to be functionally independent but richly interconnected, and serve as cortical relays linking sensory and semantic information, with the final goal of directing object-related behavior. We argue that the relations between colors and their objects are key mechanisms to understand high-level color processing.

Color Constancy Algorithms Related to Human Visual Cognitive Process

Based on the cognition of the physiological structure of the human visual system, this paper considers that the mechanism of the human visual system to perceive the image color appearance includes the adaptive mechanism of the retinal photoreceptor to the ambient light and the spatial frequency response mechanism of the Neuronal receptive field in the visual pathway. In this paper, we first provide the computing framework of the image color appearance model related to human cognitive process, then propose using Gabor wavelet as the basis function of the visual nerve cells response to apply CIECAT02 model to the calculation of image color adaption and to simulate the multi-scale superposition of human visual spatial frequency tuning curves, and finally accomplish the development of the algorithm for predicting image color appearance. The results show that the prediction algorithm proposed in this paper is closer to the visual perception of human eyes than the similar algorithm.

The Study of Spatial Frequency Channels for Human Visual System

Similar to auditory perception of sound system, color perception of the human visual system also presents a multi-frequency channel property. In order to study the multi-frequency channel mechanism of how the human visual system processes color information, the paper proposed a psychophysical experiment to measure the contrast sensitivities based on 17 color samples of 16 spatial frequencies on CIELAB opponent color space. Correlation analysis was carried out on the psychophysical experiment data, and the results show obvious linear correlations of observations for different spatial frequencies of different observers, which indicates that a linear model can be used to model how human visual system processes spatial frequency information. The results of solving the model based on the experiment data of color samples show that 9 spatial frequency tuning curves can exist in human visual system with each lightness, R–G and Y–B color channel and each channel can be represented by 3 tuning curves, which reflect the “center-around” form of the human visual receptive field. It is concluded that there are 9 spatial frequency channels in human vision system. The low frequency tuning curve of a narrow-frequency bandwidth shows the characteristics of lower level receptive field for human vision system, the medium frequency tuning curve shows a low pass property of the change of medium frequent colors and the high frequency tuning curve of a width-frequency bandwidth, which has a feedback effect on the low and medium frequency channels and shows the characteristics of higher level receptive field for human vision system, which represents the discrimination of details.

A neural field model for color perception unifying assimilation and contrast

We address the question of color-space interactions in the brain, by proposing a neural field model of color perception with spatial context for the visual area V1 of the cortex. Our framework reconciles two opposing perceptual phenomena, known as simultaneous contrast and chromatic assimilation. They have been previously shown to act synergistically, so that at some point in an image, the color seems perceptually more similar to that of adjacent neighbors, while being more dissimilar from that of remote ones. Thus, their combined effects are enhanced in the presence of a spatial pattern, and can be measured as larger shifts in color matching experiments. Our model supposes a hypercolumnar structure coding for colors in V1, and relies on the notion of color opponency introduced by Hering. The connectivity kernel of the neural field exploits the balance between attraction and repulsion in color and physical spaces, so as to reproduce the sign reversal in the influence of neighboring points. The color sensation at a point, defined from a steady state of the neural activities, is then extracted as a nonlinear percept conveyed by an assembly of neurons. It connects the cortical and perceptual levels, because we describe the search for a color match in asymmetric matching experiments as a mathematical projection on color sensations. We validate our color neural field alongside this color matching framework, by performing a multi-parameter regression to data produced by psychophysicists and ourselves. All the results show that we are able to explain the nonlinear behavior of shifts observed along one or two dimensions in color space, which cannot be done using a simple linear model.

A Compound Computational Model for Filling-In Processes Triggered by Edges: Watercolor Illusions

The goal of our research was to develop a compound computational model with the ability to predict different variations of the "watercolor effects" and additional filling-in effects that are triggered by edges. The model is based on a filling-in mechanism solved by a Poisson equation, which considers the different gradients as "heat sources" after the gradients modification. The biased (modified) contours (edges) are ranked and determined according to their dominancy across the different chromatic and achromatic channels. The color and intensity of the perceived surface are calculated through a diffusive filling-in process of color triggered by the enhanced and biased edges of stimulus formed as a result of oriented double-opponent receptive fields. The model can successfully predict both the assimilative and non-assimilative watercolor effects, as well as a number of "conflicting" visual effects. Furthermore, the model can also predict the classic Craik-O'Brien-Cornsweet (COC) effect. In summary, our proposed computational model is able to predict most of the "conflicting" filling-in effects that derive from edges that have been recently described in the literature, and thus supports the theory that a shared visual mechanism is responsible for the vast variety of the "conflicting" filling-in effects that derive from edges.

Colour Constancy Beyond the Classical Receptive Field

The problem of removing illuminant variations to preserve the colours of objects (colour constancy) has already been solved by the human brain using mechanisms that rely largely on centre-surround computations of local contrast. In this paper we adopt some of these biological solutions described by long known physiological findings into a simple, fully automatic, functional model (termed Adaptive Surround Modulation or ASM). In ASM, the size of a visual neuron's receptive field (RF) as well as the relationship with its surround varies according to the local contrast within the stimulus, which in turn determines the nature of the centre-surround normalisation of cortical neurons higher up in the processing chain. We modelled colour constancy by means of two overlapping asymmetric Gaussian kernels whose sizes are adapted based on the contrast of the surround pixels, resembling the change of RF size. We simulated the contrast-dependent surround modulation by weighting the contribution of each Gaussian according to the centre-surround contrast. In the end, we obtained an estimation of the illuminant from the set of the most activated RFs' outputs. Our results on three single-illuminant and one multi-illuminant benchmark datasets show that ASM is highly competitive against the state-of-the-art and it even outperforms learning-based algorithms in one case. Moreover, the robustness of our model is more tangible if we consider that our results were obtained using the same parameters for all datasets, that is, mimicking how the human visual system operates. These results suggest a dynamical adaptation mechanisms contribute to achieving higher accuracy in computational colour constancy.

Disruption of Inferior Longitudinal Fasciculus Microstructure in Parkinson's Disease: A Systematic Review of Diffusion Tensor Imaging Studies

Parkinson's disease (PD) is a neurodegenerative disorder accompanied by a series of pathological mechanisms which contribute to a variety of motor and non-motor symptoms. Recently, there has been an increasing interest in structural diffusion tensor imaging (DTI) in PD which has shed light on our understanding of structural abnormalities underlying PD symptoms or its associations with pathological mechanisms. One of the white matter tracts shown to be disrupted in PD with a possible contribution to some PD symptoms is the inferior longitudinal fasciculus (ILF). On the whole, lower ILF integrity contributes to thought disorders, impaired visual emotions, cognitive impairments such as semantic fluency deficits, and mood disorders. This review outlines the microstructural changes in ILF associated with systemic inflammation and various PD symptoms like cognitive decline, facial emotion recognition deficit, depression, color discrimination deficit, olfactory dysfunction, and tremor genesis. However, few studies have investigated DTI correlates of each symptom and larger studies with standardized imaging protocols are required to extend these preliminary findings and lead to more promising results.

Long-wavelength (reddish) hues induce unusually large gamma oscillations in the primate primary visual cortex

Electrophysiological signals recorded from the brain exhibit prominent gamma oscillations (∼30–80 Hz) under sensory stimulation. These oscillations are modulated by stimulus properties and behavioral state, and implicated to play a role in cognitive functions, such as attention and object-binding. In visual areas, gamma oscillations have mainly been studied using achromatic gratings/gabors. Here we show that color stimuli generate unprecedented levels of gamma oscillations in the local field potentials recorded from primate area V1. The strongest oscillations are induced by long-wavelength (reddish) hues. Importantly, their strength depends on color saturation but not on luminance, and is strongly correlated with the L−M cone contrast produced by stimuli, suggesting that gamma oscillations may represent key components of the processing of visual chromatic information.

Gamma oscillations (∼30–80 Hz) are a prominent signature of electrophysiological signals, with a purported role in natural vision. Previous studies in the primary visual cortex (area V1) have shown that achromatic gratings or gabor stimuli generate salient gamma oscillations, whose strength and frequency depend on stimulus properties such as their size, contrast, and orientation. Surprisingly, although natural images are rarely achromatic, the effect of chromatic input on gamma has not been thoroughly investigated. Recording from primate V1, we show that gamma oscillations of extremely high magnitude (peak increase of ∼300-fold in some cases), far exceeding the gamma generated by optimally tuned achromatic gratings, are induced in the local field potentials by full-field color stimuli of different hues. Furthermore, gamma oscillations are sensitive to the hue of the chromatic input, with the strongest oscillations for long-wavelength (reddish) hues and another, smaller gamma response peak for hues in the short-wavelength (bluish) range, which lie approximately on the two cardinal chromatic response axes of the upstream lateral geniculate nucleus neurons. These oscillations depended critically on the purity of the hue, decreasing with hue desaturation, but remained robust for pure hue stimuli even at reduced luminance. Importantly, the magnitude of gamma oscillations was highly correlated with positive L−M cone contrast produced by the stimuli, suggesting that gamma could be a marker of the specific mechanisms underlying this computation. These findings provide insights into the generation of gamma oscillations, as well as the processing of color along the visual pathway.

Entrainment to the CIECAM02 and CIELAB colour appearance models in the human cortex

In human visual processing, information from the visual field passes through numerous transformations before perceptual attributes such as colour are derived. The sequence of transforms involved in constructing perceptions of colour can be approximated by colour appearance models such as the CIE (2002) colour appearance model, abbreviated as CIECAM02. In this study, we test the plausibility of CIECAM02 as a model of colour processing by looking for evidence of its cortical entrainment. The CIECAM02 model predicts that colour is split in to two opposing chromatic components, red-green and cyan-yellow (termed CIECAM02-a and CIECAM02-b respectively), and an achromatic component (termed CIECAM02-A). Entrainment of cortical activity to the outputs of these components was estimated using measurements of electro- and magnetoencephalographic (EMEG) activity, recorded while healthy subjects watched videos of dots changing colour. We find entrainment to chromatic component CIECAM02-a at approximately 35 ms latency bilaterally in occipital lobe regions, and entrainment to achromatic component CIECAM02-A at approximately 75 ms latency, also bilaterally in occipital regions. For comparison, transforms from a less physiologically plausible model (CIELAB) were also tested, with no significant entrainment found.

Measurements of neuronal color tuning: Procedures, pitfalls, and alternatives

Measuring the color tuning of visual neurons is important for understanding the neural basis of vision, but it is challenging because of the inherently three-dimensional nature of color. Color tuning cannot be represented by a one-dimensional curve, and measuring three-dimensional tuning curves is difficult. One approach to addressing this challenge is to analyze neuronal color tuning data through the lens of mathematical models that make assumptions about the shapes of tuning curves. In this paper, we discuss the linear-nonlinear cascade model as a platform for measuring neuronal color tuning. We compare fitting this model by three techniques: two using response-weighted averaging and one using numerical optimization of likelihood. We highlight the advantages and disadvantages of each technique and emphasize the effects of the stimulus distribution on color tuning measurements.

Nonlinear dynamics of cortical responses to color in the human cVEP

The main finding of this paper is that the human visual cortex responds in a very nonlinear manner to the color contrast of pure color patterns. We examined human cortical responses to color checkerboard patterns at many color contrasts, measuring the chromatic visual evoked potential (cVEP) with a dense electrode array. Cortical topography of the cVEPs showed that they were localized near the posterior electrode at position Oz, indicating that the primary cortex (V1) was the major source of responses. The choice of fine spatial patterns as stimuli caused the cVEP response to be driven by double-opponent neurons in V1. The cVEP waveform revealed nonlinear color signal processing in the V1 cortex. The cVEP time-to-peak decreased and the waveform's shape was markedly narrower with increasing cone contrast. Comparison of the linear dynamics of retinal and lateral geniculate nucleus responses with the nonlinear dynamics of the cortical cVEP indicated that the nonlinear dynamics originated in the V1 cortex. The nature of the nonlinearity is a kind of automatic gain control that adjusts cortical dynamics to be faster when color contrast is greater.

Improved color constancy in honey bees enabled by parallel visual projections from dorsal ocelli

How can a pollinator, like the honey bee, perceive the same colors on visited flowers, despite continuous and rapid changes in ambient illumination and background color? A hundred years ago, von Kries proposed an elegant solution to this problem, color constancy, which is currently incorporated in many imaging and technological applications. However, empirical evidence on how this method can operate on animal brains remains tenuous. Our mathematical modeling proposes that the observed spectral tuning of simple ocellar photoreceptors in the honey bee allows for the necessary input for an optimal color constancy solution to most natural light environments. The model is fully supported by our detailed description of a neural pathway allowing for the integration of signals originating from the ocellar photoreceptors to the information processing regions in the bee brain. These findings reveal a neural implementation to the classic color constancy problem that can be easily translated into artificial color imaging systems.

Chromatic interocular-switch rivalry

Interocular-switch rivalry (also known as stimulus rivalry) is a kind of binocular rivalry in which two rivalrous images are swapped between the eyes several times a second. The result is stable periods of one image and then the other, with stable intervals that span many eye swaps (Logothetis, Leopold, & Sheinberg, 1996). Previous work used this close kin of binocular rivalry with rivalrous forms. Experiments here test whether chromatic interocular-switch rivalry, in which the swapped stimuli differ in only chromaticity, results in slow alternation between two colors. Swapping equiluminant rivalrous chromaticities at 3.75 Hz resulted in slow perceptual color alternation, with one or the other color often continuously visible for two seconds or longer (during which there were 15+ eye swaps). A well-known theory for sustained percepts from interocular-switch rivalry with form is inhibitory competition between binocular neurons driven by monocular neurons with matched orientation tuning in each eye; such binocular neurons would produce a stable response when a given orientation is swapped between the eyes. A similar model can account for the percepts here from chromatic interocular-switch rivalry and is underpinned by the neurophysiological finding that color-preferring binocular neurons are driven by monocular neurons from each eye with well-matched chromatic selectivity (Peirce, Solomon, Forte, & Lennie, 2008). In contrast to chromatic interocular-switch rivalry, luminance interocular-switch rivalry with swapped stimuli that differ in only luminance did not result in slowly alternating percepts of different brightnesses.

Color-coded visualization of magnetic resonance imaging multiparametric maps

Multiparametric magnetic resonance imaging (mpMRI) data are emergingly used in the clinic e.g. for the diagnosis of prostate cancer. In contrast to conventional MR imaging data, multiparametric data typically include functional measurements such as diffusion and perfusion imaging sequences. Conventionally, these measurements are visualized with a one-dimensional color scale, allowing only for one-dimensional information to be encoded. Yet, human perception places visual information in a three-dimensional color space. In theory, each dimension of this space can be utilized to encode visual information. We addressed this issue and developed a new method for tri-variate color-coded visualization of mpMRI data sets. We showed the usefulness of our method in a preclinical and in a clinical setting: In imaging data of a rat model of acute kidney injury, the method yielded characteristic visual patterns. In a clinical data set of N = 13 prostate cancer mpMRI data, we assessed diagnostic performance in a blinded study with N = 5 observers. Compared to conventional radiological evaluation, color-coded visualization was comparable in terms of positive and negative predictive values. Thus, we showed that human observers can successfully make use of the novel method. This method can be broadly applied to visualize different types of multivariate MRI data.

Colour in the eye of the beholder: receptor sensitivities and neural circuits underlying colour opponency and colour perception

Colour vision-the ability to discriminate spectral differences irrespective of variations in intensity-has two basic requirements: (1) photoreceptors with different spectral sensitivities, and (2) neural comparison of signals from these photoreceptors. Major progress has been made understanding the evolution of the basic stages of colour vision-opsin pigments, screening pigments, and the first neurons coding chromatic opponency, and similarities between mammals and insects point to general mechanisms. However, much work is still needed to unravel full colour pathways in various animals. While primates may have brain regions entirely dedicated to colour coding, animals with small brains, such as insects, likely combine colour information directly in parallel multisensory pathways controlling various behaviours.

Representation of Perceptual Color Space in Macaque Posterior Inferior Temporal Cortex (the V4 Complex)

The lateral geniculate nucleus is thought to represent color using two populations of cone-opponent neurons [L vs M; S vs (L + M)], which establish the cardinal directions in color space (reddish vs cyan; lavender vs lime). How is this representation transformed to bring about color perception? Prior work implicates populations of glob cells in posterior inferior temporal cortex (PIT; the V4 complex), but the correspondence between the neural representation of color in PIT/V4 complex and the organization of perceptual color space is unclear. We compared color-tuning data for populations of glob cells and interglob cells to predictions obtained using models that varied in the color-tuning narrowness of the cells, and the color preference distribution across the populations. Glob cells were best accounted for by simulated neurons that have nonlinear (narrow) tuning and, as a population, represent a color space designed to be perceptually uniform (CIELUV). Multidimensional scaling and representational similarity analyses showed that the color space representations in both glob and interglob populations were correlated with the organization of CIELUV space, but glob cells showed a stronger correlation. Hue could be classified invariant to luminance with high accuracy given glob responses and above-chance accuracy given interglob responses. Luminance could be read out invariant to changes in hue in both populations, but interglob cells tended to prefer stimuli having luminance contrast, regardless of hue, whereas glob cells typically retained hue tuning as luminance contrast was modulated. The combined luminance/hue sensitivity of glob cells is predicted for neurons that can distinguish two colors of the same hue at different luminance levels (orange/brown).

Properties of the Visible Light Phototaxis and UV Avoidance Behaviors in the Larval Zebrafish

For many organisms, color is an essential source of information from visual scenes. The larval zebrafish has the potential to be a model for the study of this topic, given its tetrachromatic retina and high dependence on vision. In this study we took a step toward understanding how the larval zebrafish might use color sensing. To this end, we used a projector-based paradigm to force a choice of a color stimulus at every turn of the larva. The stimuli used spanned most of the larval spectral range, including activation of its Ultraviolet (UV) cone, which has not been described behaviorally before. We found that zebrafish larvae swim toward visible wavelengths (>400 nm) when choosing between them and darkness, as has been reported with white light. However, when presented with UV light and darkness zebrafish show an intensity dependent avoidance behavior. This UV avoidance does not interact cooperatively with phototaxis toward longer wavelengths, but can compete against it in an intensity dependent manner. Finally, we show that the avoidance behavior depends on the presence of eyes with functional UV cones. These findings open future avenues for studying the neural circuits that underlie color sensing in the larval zebrafish.

Representing vision and blindness

BACKGROUND

There have been relatively few attempts to represent vision or blindness ontologically. This is unsurprising as the related phenomena of sight and blindness are difficult to represent ontologically for a variety of reasons. Blindness has escaped ontological capture at least in part because: blindness or the employment of the term 'blindness' seems to vary from context to context, blindness can present in a myriad of types and degrees, and there is no precedent for representing complex phenomena such as blindness.

METHODS

We explore current attempts to represent vision or blindness, and show how these attempts fail at representing subtypes of blindness (viz., color blindness, flash blindness, and inattentional blindness). We examine the results found through a review of current attempts and identify where they have failed.

RESULTS

By analyzing our test cases of different types of blindness along with the strengths and weaknesses of previous attempts, we have identified the general features of blindness and vision. We propose an ontological solution to represent vision and blindness, which capitalizes on resources afforded to one who utilizes the Basic Formal Ontology as an upper-level ontology.

CONCLUSIONS

The solution we propose here involves specifying the trigger conditions of a disposition as well as the processes that realize that disposition. Once these are specified we can characterize vision as a function that is realized by certain (in this case) biological processes under a range of triggering conditions. When the range of conditions under which the processes can be realized are reduced beyond a certain threshold, we are able to say that blindness is present. We characterize vision as a function that is realized as a seeing process and blindness as a reduction in the conditions under which the sight function is realized. This solution is desirable because it leverages current features of a major upper-level ontology, accurately captures the phenomenon of blindness, and can be implemented in many domain-specific ontologies.