Human color constancy based on the geometry of color distributions

Color constancy mechanisms in virtual reality environments

Prior research has demonstrated high levels of color constancy in real-world scenarios featuring single light sources, extensive fields of view, and prolonged adaptation periods. However, exploring the specific cues humans rely on becomes challenging, if not unfeasible, with actual objects and lighting conditions. To circumvent these obstacles, we employed virtual reality technology to craft immersive, realistic settings that can be manipulated in real time. We designed forest and office scenes illuminated by five colors. Participants selected a test object most resembling a previously shown achromatic reference. To study color constancy mechanisms, we modified scenes to neutralize three contributors: local surround (placing a uniform-colored leaf under test objects), maximum flux (keeping the brightest object constant), and spatial mean (maintaining a neutral average light reflectance), employing two methods for the latter: changing object reflectances or introducing new elements. We found that color constancy was high in conditions with all cues present, aligning with past research. However, removing individual cues led to varied impacts on constancy. Local surrounds significantly reduced performance, especially under green illumination, showing strong interaction between greenish light and rose-colored contexts. In contrast, the maximum flux mechanism barely affected performance, challenging assumptions used in white balancing algorithms. The spatial mean experiment showed disparate effects: Adding objects slightly impacted performance, while changing reflectances nearly eliminated constancy, suggesting human color constancy relies more on scene interpretation than pixel-based calculations.

Color constancy in real-world settings

Color constancy denotes the ability to assign a particular and stable color percept to an object, irrespective of its surroundings and illumination. The light reaching the eye confounds illumination and spectral reflectance of the object, making the recovery of constant object color an ill-posed problem. How good the visual system is at accomplishing this task is still a matter of heated debate, despite more than a 100 years of research. Depending on the laboratory task and the specific cues available to observers, color constancy was found to be at levels ranging between 15% and 80%, which seems incompatible with the relatively stable color appearance of objects around us and the consistent usage of color names in real life. Here, we show close-to-perfect color constancy using real objects in a natural task and natural environmental conditions, chosen to mimic the role of color constancy in everyday life. Participants had to identify the color of a (non-present) item familiar to them in an office room under five different experimental illuminations. They mostly selected the same colored Munsell chip as their match to the absent object, even though the light reaching the eye in each case differed substantially. Our results demonstrate that color constancy under ideal conditions in the real world can indeed be exceptionally good. We found it to be as good as visual memory permits and not generally compromised by sensory uncertainty.

Label-Free and Colorimetric Detection of Influenza A Virus via Receptor-Mediated Viral Fusion with Plasmonic Vesicles

The rapid transmission and numerous re-emerging human influenza virus variants that spread via the respiratory system have led to severe global damage, emphasizing the need for detection tools that can recognize active and intact virions with infectivity. Here, this work presents a plasmonic vesicle-mediated fusogenic immunoassay (PVFIA) comprising gold nanoparticle (GNP) encapsulating fusogenic polymeric vesicles (plasmonic vesicles; PVs) for the label-free and colorimetric detection of influenza A virus (IAV). The PVFIA combines two sequential assays: a biochip-based immunoassay for target-specific capture and a PV-induced fusion assay for color change upon the IAV-PV fusion complex formation. The PVFIA demonstrates excellent specificity in capturing the target IAV, while the fusion conditions and GNP induce a significant color change, enabling visual detection. The integration of two consecutive assays results in a low detection limit (100.7919 EID50 mL-1 ) and good reliability (0.9901), indicating sensitivity that is 104.208 times higher than conventional immunoassay. Leveraging the PV viral membrane fusion activity renders the PVFIA promising for point-of-care diagnostics through colorimetric detection. The innovative approach addresses the critical need for detecting active and intact virions with infectivity, providing a valuable tool with which to combat the spread of the virus.

Invariant categorical color regions across illuminant change coincide with focal colors

Are there regions in a color space where color categories are invariant across illuminant changes? If so, what characteristics make them more stable than other regions? To address these questions, we asked observers to give a color name to 424 colored surfaces, presented one at a time, under various chromatic illuminants. Results showed a high degree of categorical color constancy, especially under illuminants that occur in the natural environment. It was also shown that surfaces selected as a focal color (the best example of a color category) are more resistant to illuminant change than nonfocal color samples. We additionally ran an asymmetric color matching experiment to quantify the shift of color appearance induced by illuminant changes using surfaces that were all named gray, thereby disentangling the appearance-based color constancy from the categorical color constancy (which are often confounded). Results suggested that the appearance of color samples largely shifted owing to illuminant changes, even though all samples were named gray; showing that the constancy of a color category is substantially more robust than the constancy of color appearance.

Robust categorical color constancy along daylight locus in red-green color deficiency

Categorical color constancy in normal trichromats has been found to be very robust in real scenes. In this study, we investigated categorical color constancy in red-green dichromats and anomalous trichromats. Eight dichromats (two protanopes and six deuteranopes), eight anomalous trichromats (four protanomalous and four deuteranomalous trichromats), and eight normal trichromats sorted 208 Munsell matte surfaces into Berlin and Kay's basic color categories under D65 illuminant, F illuminant with correlated color temperature 4200 K, and TL84 illuminant with correlated color temperature 2700 K. Color constancy was quantified by a color constancy index. The results showed that the constancy index of dichromats (0.79) was considerable and significantly lower than that of normal trichromats (0.87) while that of anomalous trichromats (0.84) was not. The impairment of color constancy performance in dichromats was expected to be caused by their large intra-subject variabilities in color naming. The results indicate robust categorical color constancy along daylight locus in red-green dichromats and anomalous trichromats, which might be contributed by cone adaptation mechanism and be independent of color discrimination mechanism. It suggests that the color categorization by color vision deficient subjects can be reasonable without any assistants of artificial equipment in daily life under sunlight and common illuminations.

Spectral measurement of daylights and surface properties of natural objects in Japan

We present a spectral dataset of daylights and surface reflectances and transmittances of natural objects measured in Japan. Daylights were measured under the sun and under shadow from dawn to dusk on four different days to capture their temporal spectral transition. We separately measured daylight spectra at five different locations (including an open space and a forest) with minimum time difference to reveal whether a local environment alters daylight spectra reaching the ground. We found that colors of natural objects were spread in a limited area of color space, and data points were absent around saturated green regions. Daylight spectra were found to have a larger variation across time, weather, and local environments than previously thought. Datasets are made freely available, expanding past public datasets mainly collected in Northern America and Europe.

Luminosity thresholds of colored surfaces are determined by their upper-limit luminances empirically internalized in the visual system

We typically have a fairly good idea whether a given object is self-luminous or illuminated, but it is not fully understood how we make this judgment. This study aimed to identify determinants of the luminosity threshold, a luminance level at which a surface begins to appear self-luminous. We specifically tested a hypothesis that our visual system knows the maximum luminance level that a surface can reach under the physical constraint that a surface cannot reflect more light than any incident light and applies this prior to determine the luminosity thresholds. Observers were presented with a 2-degree circular test field surrounded by numerous overlapping colored circles and luminosity thresholds were measured as a function of (i) the chromaticity of the test field, (ii) the shape of surrounding color distribution, and (iii) the color of the illuminant of the surrounding colors. We found that the luminosity thresholds peaked around the chromaticity of test illuminants and decreased as the purity of the test chromaticity increased. However, the loci of luminosity thresholds across chromaticities were nearly invariant to the shape of the surrounding color distribution and generally resembled the loci drawn from theoretical upper-limit luminances and upper-limit luminance boundaries of real objects. These trends were particularly evident for illuminants on the black-body locus and did not hold well under atypical illuminants, such as magenta or green. These results support the idea that our visual system empirically internalizes the gamut of surface colors under natural illuminants and a given object appears self-luminous when its luminance exceeds this internalized upper-limit luminance.