The dress and individual differences in the perception of surface properties

Colour expectations across illumination changes

This study investigates human expectations towards naturalistic colour changes under varying illuminations. Understanding colour expectations is key to both scientific research on colour constancy and applications of colour and lighting in art and industry. We reanalysed data from asymmetric colour matches of a previous study and found that colour adjustments tended to align with illuminant-induced colour shifts predicted by naturalistic, rather than artificial, illuminants and reflectances. We conducted three experiments using hyperspectral images of naturalistic scenes to test if participants judged colour changes based on naturalistic illuminant and reflectance spectra as more plausible than artificial ones, which contradicted their expectations. When we consistently manipulated the illuminant (Experiment 1) and reflectance (Experiment 2) spectra across the whole scene, observers chose the naturalistic renderings significantly above the chance level (>25 %) but barely more often than any of the three artificial ones, collectively (>50 %). However, when we manipulated only one object/area's reflectance (Experiment 3), observers more reliably identified the version in which the object had a naturalistic reflectance like the rest of the scene. Results from Experiments 2-3 and additional analyses suggested that relational colour constancy strongly contributed to observer expectations, and stable cone-excitation ratios are not limited to naturalistic illuminants and reflectances but also occur for our artificial renderings. Our findings indicate that relational colour constancy and prior knowledge about surface colour shifts help to disambiguate surface colour identity under illumination changes, enabling human observers to recognise surface colours reliably in naturalistic conditions. Additionally, relational colour constancy may even be effective in many artificial conditions.

Explaining individual differences

Most psychological research aims to uncover generalizations about the mind that hold across subjects. Philosophical discussions of scientific explanation have focused on such generalizations, but in doing so, have often overlooked an important phenomenon: variation. Variation is ubiquitous in psychology and many other domains, and an important target of explanation in its own right. Here I characterize explananda that concern individual differences and formulate an account of what it takes to explain them. I argue that the notion of actual difference making, the only causal concept in the literature that explicitly addresses variation, cannot be used to ground such an account. Instead, I propose a view on which explaining individual differences involves identifying causes that could be intervened on to reduce the variability in the population. This account provides criteria of success for explaining variation and deepens our understanding of causal explanation.

What colour are your eyes? Teaching the genetics of eye colour & colour vision. Edridge Green Lecture RCOphth Annual Congress Glasgow May 2019

Eye colour and colour perception are excellent examples to use when teaching genetics as they encompass not simply the basic Mendelian genetics of dominant, recessive and X-linked disorders, but also many of the new concepts such as non-allelic diseases, polygenic disease, phenocopies, genome-wide association study (GWAS), founder effects, gene-environment interaction, evolutionary drivers for variations, copy number variation, insertions deletions, methylation and gene inactivation. Beyond genetics, colour perception touches on concepts involving optics, physics, physiology and psychology and can capture the imagination of the population, as we saw with social media trend of "#the dress". Television shows such as Game of Thrones focused attention on the eye colour of characters, as well as their Dire-wolves and Dragons. These themes in popular culture can be leveraged as tools to teach and engage everyone in genetics, which is now a key component in all eye diseases. As the explosion of data from genomics, big data and artificial intelligence transforms medicine, ophthalmologists need to be genetically literate. Genetics is relevant, not just for Inherited Retinal Diseases and congenital abnormalities but also for the leading causes of blindness: age-related macular degeneration, glaucoma, myopia, diabetic retinopathy and cataract. Genetics should be part of the armamentarium of every practicing ophthalmologist. We need to ask every patient about their family history. In the near future, patients will attend eye clinics with genetic results showing they are at high risk of certain eye diseases and ophthalmologists will need to know how to screen, follow and treat these patients.

Crystal or jelly? Effect of color on the perception of translucent materials with photographs of real-world objects

Translucent materials are ubiquitous in nature (e.g. teeth, food, and wax), but our understanding of translucency perception is limited. Previous work in translucency perception has mainly used monochromatic rendered images as stimuli, which are restricted by their diversity and realism. Here, we measure translucency perception with photographs of real-world objects. Specifically, we use three behavior tasks: binary classification of "translucent" versus "opaque," semantic attribute rating of perceptual qualities (see-throughness, glossiness, softness, glow, and density), and material categorization. Two different groups of observers finish the three tasks with color or grayscale images. We find that observers' agreements depend on the physical material properties of the objects such that translucent materials generate more interobserver disagreements. Further, there are more disagreements among observers in the grayscale condition in comparison to that in the color condition. We also discover that converting images to grayscale substantially affects the distributions of attribute ratings for some images. Furthermore, ratings of see-throughness, glossiness, and glow could predict individual observers' binary classification of images in both grayscale and color conditions. Last, converting images to grayscale alters the perceived material categories for some images such that observers tend to misjudge images of food as non-food and vice versa. Our result demonstrates that color is informative about material property estimation and recognition. Meanwhile, our analysis shows that mid-level semantic estimation of material attributes might be closely related to high-level material recognition. We also discuss individual differences in our results and highlight the importance of such consideration in material perception.

Individual Differences in Colour Perception: The Role of Low-Saturated and Complementary Colours in Ambiguous Images

Individual differences in colour perception, as evidenced by the popular debate of “The Dress” picture, have garnered additional interest with the popularisation of additional, similar photographs. We investigated which colorimetric characteristics were responsible for individual differences in colour perception. All objects of the controversial photographs are composed of two representative colours, which are low in saturation and are either complementary to each other or reminiscent of complementary colours. Due to these colorimetric characteristics, we suggest that one of the two complementary pixel clusters should be estimated as the illuminant hue depending on assumed brightness. Thus, people perceive the object's colours as being biased toward complementarily different colour directions and perceive different pixel clusters as chromatic and achromatic. Even though the distance between colours that people perceive differently is small in colour space, people perceive the object's colour as differently categorized colours in these ambiguous photographs, thereby causing debate. We suggest that people perceive the object's colours using different “modes of colour appearance” between surface-colour and self-luminous modes.

Color Judgments of #The Dress and #The Jacket in a Sample of Different Cultures

Two viral photographs, #The Dress and #The Jacket, have received recent attention in research on perception as the colors in these photos are ambiguous. In the current study, we examined perception of these photographs across three different cultural samples: Sweden (Western culture), China (Eastern culture), and India (between Western and Eastern cultures). Participants also answered questions about gender, age, morningness, and previous experience of the photographs. Analyses revealed that only age was a significant predictor for the perception of The Dress, as older people were more likely to perceive the colors as blue and black than white and gold. In contrast, multiple factors predicted perception of The Jacket, including age, previous experience, and country. Consistent with some previous research, this suggests that the perception of The Jacket is a different phenomenon from perception of The Dress and is influenced by additional factors, most notably culture.

Explaining #theShoe based on the optimal color hypothesis: The role of chromaticity vs. luminance distribution in an ambiguous image

The image of #theShoe is a derivative image of #theDress which induces vastly different color experiences across individuals. The majority of people perceive that the shoe has grey leather with turquoise laces, but others report pink leather with white laces. We hypothesized #theShoe presents a problem of color constancy, where different people estimate different illuminants falling onto the shoe. The present study specifically aimed to understand what cues in the shoe image caused the ambiguity based on the optimal color hypothesis: our visual system knows the gamut of surface colors under various illuminants and applies the knowledge for illuminant estimation. The analysis showed that estimated illuminant chromaticity largely changes according to the assumed intensity of the illuminant. When the illuminant intensity was assumed to be low, a high color temperature was estimated. In contrast, assuming high illuminant intensity led to the estimation of low color temperature. A simulation based on a von Kries correction showed that the subtraction of estimated illuminants from the original image shifts the appearance of the shoe towards the reported states (i.e. gray-turquoise or pink-white). These results suggest that the optimal color hypothesis provides a theoretical interpretation to #theShoe phenomenon. Moreover, this luminance-dependent color-shift was observed in #theDress phenomenon, supporting the notion that the same trigger induces #theShoe.

Effect of stimulus dimension on perception and cognition

Stimuli characteristics ha a decisive role in our perception and cognition. In the present study, we aimed to evaluate the effects of dimension of stimuli, two-dimensional (2D) versus three-dimensional (3D), on perception and working memory. In the first experiment, using the method of eye tracking, a higher blink rate, pupil size, and the number of saccade for three compared to 2D stimuli revealed a higher perceptual demand of 3D stimuli. In the second experiment, visual search task shows a higher response time for 3D stimuli and an equal performance with 2- and 3D stimuli in spatial working memory task. In the third experiment, four working memory tasks with high and low cognitive and perceptual load revealed 3D stimuli are memorized better in the both low and high load of working memory. We can conclude that 3D stimulus, compared 2D, imposes a higher load on perceptual system, but it is memorized better. It could be concluded that the phenomenon of filtering should occur in the early perceptual system for preventing overload.

How to make a #theDress

If we completely understand how a phenomenon works, we should be able to produce it ourselves. However, the individual differences in color appearance observed with #theDress seem to be a peculiarity of that photo, and it remains unclear how the proposed mechanisms underlying #theDress can be generalized to other images. Here, we developed a simple algorithm that transforms any image with bicolored objects into an image with the properties of #theDress. We measured the colors perceived in such images and compared them to those perceived in #theDress. Color adjustments confirmed that observers strongly differ in how they perceive the colors of the new images in a similar way as for #theDress. Most importantly, these differences were not unsystematic, but correlated with how observers perceive #theDress. These results imply that the color distribution is sufficient to produce the striking individual differences in color perception originally observed with #theDress-at least as long as the image appears realistic and hence compels the viewer to make assumptions about illuminations and surfaces. The algorithm can be used for stimulus production beyond this study.

Dressing Up for a BBQ on a Blurry Street: #TheDress Is Not Only Ambiguous in Terms of Illumination But Also in Terms of Scene Content

Explicit or implicit assumptions about the source of illumination are a key determinant of perceived colours from the image of #TheDress. In addition, previous work showed that the extent of the processing of contextual cues in the image may be reduced in blue and black perceivers. This is a brief report of a questionnaire study which focused on the ambiguity of light direction as well as on the ambiguity of the content of #TheDress photograph itself. We replicated previous reports about the importance of perceived light direction: White and gold perceivers were more likely to report light from the back than sideways light. Descriptions of #TheDress image did not relate to perceived colour or light direction, but there were many erroneous reports and a high level of ambiguity. It is highly likely that the ambiguity of image content feeds into the importance of implicit factors that influence perceived illumination as determinants of dress colour.

Color brightness model and its imaging applications

We have developed an empirical umbrella model for predicting the brightness of colors. It is based on a modified concept of the radiance factor. Instead of a single reference, i.e., white, for all colors, each color has its own reference color. Our model shows that, for near neutral colors, the boundary of the object-color solid accounts for most of the hue angles, except in the cyan-blue region, where the boundary has to be adjusted by experiments on color charts. We use an exponential function to extrapolate the umbrella to the colors of higher purity. The model is used to adjust the luminance of the Munsell colors to make them equally bright by compensating for the Helmholtz-Kohlrausch effect. It is also applied to real consumer images to reduce their brightness after boosting their color saturation. For both applications, the comparison images show that the model is quite effective.

Color Perception: Objects, Constancy, and Categories

Color has been scientifically investigated by linking color appearance to colorimetric measurements of the light that enters the eye. However, the main purpose of color perception is not to determine the properties of incident light, but to aid the visual perception of objects and materials in our environment. We review the state of the art on object colors, color constancy, and color categories to gain insight into the functional aspects of color perception. The common ground between these areas of research is that color appearance is tightly linked to the identification of objects and materials and the communication across observers. In conclusion, we argue that research should focus on how color processing is adapted to the surface properties of objects in the natural environment in order to bridge the gap between the known early stages of color perception and the subjective appearance of color.

Multidimensional internal dynamics underlying the perception of motion

When ambiguous visual stimuli are presented continuously, they often lead to oscillations between usually two perceptions. Because of these oscillations, it has been thought that the underlying neural dynamics also arises from a binary or two-state system. Contradicting the binary assumption, it has been shown recently that the perception of some ambiguous stimuli is governed by continuously varying internal states, measured as biases that differ considerably from one observer to the next and that can also evolve over time (Wexler, Duyck, & Mamassian, 2015). Here I study bias patterns in the motion quartet, an ambiguous apparent motion stimulus, as the quartet's orientation is varied. The bias patterns are robustly idiosyncratic, and are even more complex than those that have been described previously. There are two qualitatively different bias types: Some observers prefer a translation axis, while others show preference for a rotation direction. Each type also varies parametrically: the orientation of the preferred axis, and the direction of preferred rotation. There are also clear cases of combination of the two bias types. When measured repeatedly over 9 hr, the bias patterns usually remain stable, but also sometimes evolve both parametrically (e.g., change of preferred axis), as well as across bias type (change from axial to rotational bias). Control experiments revealed that the variety of bias patterns observed across subjects, and their changes over time, are not due to voluntary decisions. Overall, these results exhibit the multidimensional complexity of internal states underlying the perception of even simple stimuli.

Age, pupil size differences, and color choices for the "dress" and the "jacket"

The color identification responses to photographs of #thedress (white/gold and blue/black) and a jacket (white/blue and green/black, and teal) reveal obvious individual differences in color perception. To explore possible association between pupil size/retinal illuminance and color perception, we recorded the pupil diameters of participants shown 22 uniformly colored (generated from the RGB values using a laptop LCD display) screens followed by photographs of #thedress and jacket. We analyzed (a) pupil size difference in the color groups and (b) age-related pupil size and/or reflex change and its influence on color perception. The data confirms that the average pupil size of the white/gold group was significantly less than the blue/black group for the dress. The pupil size difference between the color groups is slightly higher in the 21-30-year and 31-55-year age groups but not in the 18-20-year age group, while a similar variance was not observed for the jacket color groups. Interestingly, the average pupil size of both color groups was smaller for the dress compared to the baseline (collected with a gray hue displayed on the screen), whereas an opposite effect was observed for the jacket. The contrasting results for the two photographs do not allow for a strong inference of only pupil size change principal for differences in color perception. But, a probable explanation of the pupil size difference could be the subjective variation in the perceptual interpretation of illumination cues in the photographs.