Adaptation and visual salience

Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation

Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as "looking similar"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; P = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], P = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], P = .78), and a reduced reading time (24.3 vs 27.9 seconds, P < .001), fixation count (47 vs 52, P < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, P < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; P = .70), specificity (84% [820 of 975], P = .37), sensitivity (80% [784 of 975], P = .79), fixation count (54, P = .05), or fixation time in malignant regions (4.6 seconds, P > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, P = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Grimm in this issue.

Tilt aftereffect spreads across the visual field

The tilt aftereffect (TAE) is observed when adaptation to a tilted contour alters the perceived tilt of a subsequently presented contour. Thus far, TAE has been treated as a local aftereffect observed only at the location of the adapter. Whether and how TAE spreads to other locations in the visual field has not been systematically studied. Here, we sought an answer to this question by measuring TAE magnitudes at locations including but not limited to the adapter location. The adapter was a tilted grating presented at the same peripheral location throughout an experimental session. In a single trial, participants indicated the perceived tilt of a test grating presented after the adapter at one of fifteen locations in the same visual hemifield as the adapter. We found non-zero TAE magnitudes in all locations tested, showing that the effect spreads across the tested visual hemifield. Next, to establish a link between neuronal activity and behavioral results and to predict the possible neuronal origins of the spread, we built a computational model based on known characteristics of the visual cortex. The simulation results showed that the model could successfully capture the pattern of the behavioral results. Furthermore, the pattern of the optimized receptive field sizes suggests that mid-level visual areas, such as V4, could be critically involved in TAE and its spread across the visual field.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

V1-Origin Bidirectional Plasticity in Visual Thalamo-Ventral Pathway and Its Contribution to Saliency Detection of Dynamic Visual Inputs

Visual neural plasticity and V1 saliency detection are vital for efficient coding of dynamically changing visual inputs. However, how does neural plasticity contribute to saliency detection of temporal statistically distributed visual stream remains unclear. Therefore, we adopted randomly presented but unevenly distributed stimuli with multiple orientations and examined the single-unit responses evoked by this biased orientation-adaptation protocol by single-unit recordings in the visual thalamo-ventral pathway of cats (of either sex). We found neuronal responses potentiated when the probability of biased orientation was slightly higher than other nonbiased ones and suppressed when the probability became much higher. This single neuronal short-term bidirectional plasticity is selectively induced by optimal stimuli but is interocularly transferable. It is inducible in LGN, Area 17, and Area 21a with distinct and hierarchically progressive patterns. With the results of latency analysis, receptive field structural test, cortical lesion, and simulations, we suggest this bidirectional plasticity may principally originate from the adaptation competition between excitatory and inhibitory components of V1 neuronal receptive field. In our simulation, above bidirectional plasticity could achieve saliency detection of dynamic visual inputs. These findings demonstrate a rapid probability dependent plasticity on the neural coding of visual stream and suggest its functional role in the efficient coding and saliency detection of dynamic environment.SIGNIFICANCE STATEMENT Novel elements within a dynamic visual stream can pop up from the context, which is vital for rapid response to a dynamically changing world. Saliency detection is a promising bottom-up mechanism contributing to efficient selection of visual inputs, wherein visual adaptation also plays a significant role. However, the saliency detection of dynamic visual stream is poorly understood. Here, we found a novel form of visual short-term bidirectional plasticity in multistages of the visual system that contributes to saliency detection of dynamic visual inputs. This bidirectional plasticity may principally originate from the local balance of excitation inhibition in primary visual cortex and propagates to lower and higher visual areas with progressive pattern change. Our findings suggest the excitation-inhibition balance within the visual system contributes to visual efficient coding.

Interactions Between Visual Working Memory, Attention, and Color Categories: A Pupillometry Study

Recent studies have found that visual working memory (VWM) for color shows a categorical bias: observers typically remember colors as more prototypical to the category they belong to than they actually are. Here, we further examine color-category effects on VWM using pupillometry. Participants remembered a color for later reproduction on a color wheel. During the retention interval, a colored probe was presented, and we measured the pupil constriction in response to this probe, assuming that the strength of constriction reflects the visual saliency of the probe. We found that the pupil initially constricted most strongly for non-matching colors that were maximally different from the memorized color; this likely reflects a lack of visual adaptation for these colors, which renders them more salient than memory-matching colors (which were shown before). Strikingly, this effect reversed later in time, such that pupil constriction was more prolonged for memory-matching colors as compared to non-matching colors; this likely reflects that memory-matching colors capture attention more strongly, and perhaps for a longer time, than non-matching colors do. We found no effects of color categories on pupil constriction: after controlling for color distance, (non-matching) colors from the same category as the memory color did not result in a different pupil response as compared to colors from a different category; however, we did find that behavioral responses were biased by color categories. In summary, we found that pupil constriction to colored probes reflects both visual adaptation and VWM content, but, unlike behavioral measures, is not notably affected by color categories.

What we talk about when we talk about colors

Do we talk about some colors more often than others? And do the colors we communicate about most frequently vary across cultures? A classic finding shows that languages around the world partition colors into words in remarkably similar, although not identical, ways. The biology of human color perception helps explain similar color vocabularies across languages, but less is known about how often speakers need to reference different colors. The inference method we develop reveals extensive variation in communicative needs across colors, and a diversity in needs across 130 languages, which helps explain variation in their color vocabularies. Our results open the door to studying cross-cultural variation in demands on different colors, and factors that drive color demands in linguistic communities.

Names for colors vary widely across languages, but color categories are remarkably consistent. Shared mechanisms of color perception help explain consistent partitions of visible light into discrete color vocabularies. But the mappings from colors to words are not identical across languages, which may reflect communicative needs—how often speakers must refer to objects of different color. Here we quantify the communicative needs of colors in 130 different languages by developing an inference algorithm for this problem. We find that communicative needs are not uniform: Some regions of color space exhibit 30-fold greater demand for communication than other regions. The regions of greatest demand correlate with the colors of salient objects, including ripe fruits in primate diets. Our analysis also reveals a hidden diversity in the communicative needs of colors across different languages, which is partly explained by differences in geographic location and the local biogeography of linguistic communities. Accounting for language-specific, nonuniform communicative needs improves predictions for how a language maps colors to words, and how these mappings vary across languages. Our account closes an important gap in the compression theory of color naming, while opening directions to study cross-cultural variation in the need to communicate different colors and its impact on the cultural evolution of color categories.

Testing temporal integration of feature probability distributions using role-reversal effects in visual search

The visual system is sensitive to statistical properties of complex scenes and can encode feature probability distributions in detail. But does the brain use these statistics to build probabilistic models of the ever-changing visual input? To investigate this, we examined how observers temporally integrate two different orientation distributions from sequentially presented visual search trials. If the encoded probabilistic information is used in a Bayesian optimal way, observers should weigh more reliable information more strongly, such as feature distributions with low variance. We therefore manipulated the variance of the two feature distributions. Participants performed sequential odd-one-out visual search for an oddly oriented line among distractors. During successive learning trials, the distractor orientations were sampled from two different Gaussian distributions on alternating trials. Then, observers performed a 'test trial' where the orientations of the target and distractors were switched, allowing us to assess observer's internal representation of distractor distributions based on changes in response times. In three experiments we observed that observer's search times on test trials depended mainly on the very last learning trial, indicating a strong recency effect. Since temporal integration has been previously observed with this method, we conclude that when the input is unreliable, the visual system relies more on the most recent stimulus. This indicates that the visual system prefers to utilize sensory history when the statistical properties of the environment are relatively stable.

Contrast adaptation improves spatial integration

The effects of contrast adaptation and contrast area summation (spatial integration) were investigated using a contrast discrimination task. The task consisted of a target of variable size, and a pedestal with a fixed base contrast. Discrimination performance was examined for a condition in which the pedestal size was fixed, equal to the largest target size, and for a condition in which the pedestal size matched the target size and thus varied with it. Repeated performance of the task produced rapid within-session improvements for both conditions. For stimuli with a matching size of target and pedestal, the performance improved only for the larger targets, indicating the development of spatial integration, which was initially absent for these stimuli. However, the improvements were mostly temporary, and were not fully retained between subsequent daily sessions. The temporary nature of the sensitivity gains implies that they resulted, at least in part, from rapid adaptation to the stimulus contrast. We suggest that adaptation decorrelates and thus reduces the spatial noise generated by a high-contrast pedestal, leading to improved spatial integration (area summation) and better contrast sensitivity. A decorrelation model successfully predicted our experimental results.

Reduced alpha amplitudes predict perceptual suppression

The amplitude of prestimulus alpha oscillations over parieto-occipital cortex has been shown to predict visual detection of masked and threshold-level stimuli. Whether alpha activity similarly predicts target visibility in perceptual suppression paradigms, another type of illusion commonly used to investigate visual awareness, is presently unclear. Here, we examined prestimulus alpha activity in the electroencephalogram (EEG) of healthy participants in the context of a generalized flash suppression (GFS) task during which salient target stimuli are rendered subjectively invisible in a subset of trials following the onset of a full-field motion stimulus. Unlike for masking or threshold paradigms, alpha (8-12 Hz) amplitude prior to motion onset was significantly higher when targets remained subjectively visible compared to trials during which the targets became perceptually suppressed. Furthermore, individual prestimulus alpha amplitudes strongly correlated with the individual trial-to-trial variability quenching following motion stimulus onset, indicating that variability quenching in visual cortex is closely linked to prestimulus alpha activity. We conclude that predictive correlates of conscious perception derived from perceptual suppression paradigms differ substantially from those obtained with "near threshold paradigms", possibly reflecting the effectiveness of the suppressor stimulus.

Limited Spatial Spread Explains the Dependence of Visual Response Adaptation on Stimulus Size in Rat Superior Colliculus Neurons

Although adaptation to light occurs in the eye and mainly preserves the full dynamic range of neuronal responses during changing background illumination, it affects the entire visual system and helps to optimize visual information processing. We have shown recently that in rat superior colliculus (SC) neurons adaptation to light acts as a local low-pass filter because, in contrast to the primate SC, in rat collicular neurons adaptation to small stimuli is largely limited to the vicinity of the adaptor stimulus. However, it was unclear whether large visual stimuli would induce the same spatially limited adaptation. We addressed this question by evaluating the effects of 1.8°, 6.2° and 20.8° wide adaptor stimuli on test stimuli of variable size. Single unit recordings in the adult rat SC were employed to estimate the response amplitude. Small, 1.8° and 6.2° adaptors habituated visual responses only to stimuli smaller than the adaptive stimuli. However, the 20.8° adaptor dramatically reduced responses even to test stimuli >3 times wider than the adaptor (up to 70° wide). The latter result may be explained by a nearly complete occlusion by a large adaptor of the neuron's receptive field (RF). All these results are consistent with the idea of a limited spatial spread of adaptation in rat SC neurons that is the consequence of high convergence of retinal inputs, in which small RFs limit the spatial spread of adaptation. It is concluded that, in this limited spatial spread of adaptation, rodent SC resembles higher visual system areas in primates and indicates potential differences in visual information processing between rodents and primates.

Visual mode switching learned through repeated adaptation to color

When the environment changes, vision adapts to maintain accurate perception. For repeatedly encountered environments, learning to adjust more rapidly would be beneficial, but past work remains inconclusive. We tested if the visual system can learn such visual mode switching for a strongly color-tinted environment, where adaptation causes the dominant hue to fade over time. Eleven observers wore bright red glasses for five 1-hr periods per day, for 5 days. Color adaptation was measured by asking observers to identify 'unique yellow', appearing neither reddish nor greenish. As expected, the world appeared less and less reddish during the 1-hr periods of glasses wear. Critically, across days the world also appeared significantly less reddish immediately upon donning the glasses. These results indicate that the visual system learned to rapidly adjust to the reddish environment, switching modes to stabilize color vision. Mode switching likely provides a general strategy to optimize perceptual processes.

Individual differences in the tendency to see the expected

Prior knowledge has been shown to facilitate the incorporation of visual stimuli into awareness. We adopted an individual differences approach to explore whether a tendency to 'see the expected' is general or method-specific. We administered a binocular rivalry task and manipulated selective attention, as well as induced expectations via predictive context, self-generated imagery, expectancy cues, and perceptual priming. Most prior manipulations led to a facilitated awareness of the biased percept in binocular rivalry, whereas strong signal primes led to a suppressed awareness, i.e., adaptation. Correlations and factor analysis revealed that the facilitatory effect of priors on visual awareness is closely related to attentional control. We also investigated whether expectation-based biases predict perceptual abilities. Adaptation to strong primes predicted improved naturalistic change detection and the facilitatory effect of weak primes predicted the experience of perceptual anomalies. Taken together, our results indicate that the facilitatory effect of priors may be underpinned by an attentional mechanism but the tendency to 'see the expected' is method-specific.

Size aftereffect is non-local

It is well known that prolonged exposure to a certain size stimulus alters the perceived size of a subsequently presented stimulus at the same location. How the rest of the visual space is affected by this size adaptation, however, has not been systematically studied before. Here, to fill this gap in literature, we tested size adaptation at the adapter location as well as the rest of the visual space. We used peripherally presented solid discs (Experiment 1) and rings (Experiment 2) as adapter and target (test) stimuli. Observers adapted to a mid-sized stimulus and judged the size of the subsequently presented smaller or larger target stimuli. Results showed that the perceived sizes of target stimuli were repelled away from the adapter size, not only at the adapter location but also at other locations. These findings demonstrate that size adaptation causes widespread distortion of the visual space and alters perceived size. We discuss possible computational models that may underpin the perceptual effect.

Neural correlates of perceptual color inferences as revealed by #thedress

Color constancy involves disambiguating the spectral characteristics of lights and surfaces, for example to distinguish red in white light from white in red light. Solving this problem appears especially challenging for bluish tints, which may be attributed more often to shading, and this bias may underlie the individual differences in whether people described the widely publicized image of #thedress as blue-black or white-gold. To probe these higher-level color inferences, we examined neural correlates of the blue-bias, using frequency-tagging and high-density electroencephalography to monitor responses to 3-Hz alternations between different color versions of #thedress. Specifically, we compared relative neural responses to the original “blue” dress image alternated with the complementary “yellow” image (formed by inverting the chromatic contrast of each pixel). This image pair produced a large modulation of the electroencephalography amplitude at the alternation frequency, consistent with a perceived contrast difference between the blue and yellow images. Furthermore, decoding topographical differences in the blue-yellow asymmetries over occipitoparietal channels predicted blue-black and white-gold observers with over 80% accuracy. The blue-yellow asymmetry was stronger than for a “red” versus “green” pair matched for the same component differences in L versus M or S versus LM chromatic contrast as the blue-yellow pair and thus cannot be accounted for by asymmetries within either precortical cardinal mechanism. Instead, the results may point to neural correlates of a higher-level perceptual representation of surface colors.

A Bayesian and efficient observer model explains concurrent attractive and repulsive history biases in visual perception

Human perceptual decisions can be repelled away from (repulsive adaptation) or attracted towards recent visual experience (attractive serial dependence). It is currently unclear whether and how these repulsive and attractive biases interact during visual processing and what computational principles underlie these history dependencies. Here we disentangle repulsive and attractive biases by exploring their respective timescales. We find that perceptual decisions are concurrently attracted towards the short-term perceptual history and repelled from stimuli experienced up to minutes into the past. The temporal pattern of short-term attraction and long-term repulsion cannot be captured by an ideal Bayesian observer model alone. Instead, it is well captured by an ideal observer model with efficient encoding and Bayesian decoding of visual information in a slowly changing environment. Concurrent attractive and repulsive history biases in perceptual decisions may thus be the consequence of the need for visual processing to simultaneously satisfy constraints of efficiency and stability.

The Verriest Lecture: Adventures in blue and yellow

Conventional models of color vision assume that blue and yellow (along with red and green) are the fundamental building blocks of color appearance, yet how these hues are represented in the brain and whether and why they might be special are questions that remain shrouded in mystery. Many studies have explored the visual encoding of color categories, from the statistics of the environment to neural processing to perceptual experience. Blue and yellow are tied to salient features of the natural color world, and these features have likely shaped several important aspects of color vision. However, it remains less certain that these dimensions are encoded as primary or "unique" in the visual representation of color. There are also striking differences between blue and yellow percepts that may reflect high-level inferences about the world, specifically about the colors of light and surfaces. Moreover, while the stimuli labeled as blue or yellow or other basic categories show a remarkable degree of constancy within the observer, they all vary independently of one another across observers. This pattern of variation again suggests that blue and yellow and red and green are not a primary or unitary dimension of color appearance, and instead suggests a representation in which different hues reflect qualitatively different categories rather than quantitative differences within an underlying low-dimensional "color space."

Evidence for a central component in adaptation to chromatic light

Adaptation to environmental light allows our visual system to compensate for dynamic changes in the visual environment for avoiding everyday hazards (e.g., misreading traffic lights) and for accurate reaching. We investigated the hypothesis that adaptation to coloured light is achieved not only via photoreceptors in the retina and monocular contrast adaptation, but also by a binocular process that may occur at the level of the cerebral cortex. In the present study, to determine the role of higher-order cortical binocular processes in adaptation to coloured light, participants were adapted to chromatic light such that the duration of adaptation during monocular processing differed from that during binocular processing. A dichoptic device was used to adapt each eye independently. The extent of after-effects, measured as the distance between the neutral points before and after adaptation to coloured light, depended on the duration of adaptation not only at the monocular level but also at a higher cortical level downstream from binocular fusion. Thus, contrast adaptation to coloured light occurs on at least two levels; it is a result of monocular processes at one level and binocular processes at the other, and each type of process exhibits different temporal characteristics. The results of this study suggest a significant cortical role in adaptation to changes in lighting conditions or the optical environment, including the effects of age on the eye, and the necessity of further investigation to clarify the functional connection between chromatic adaptation by photoreceptors and chromatic adaptation by cortical systems.

Psychophysical evaluation of individual low-level feature influences on visual attention

In this study we provide the analysis of eye movement behavior elicited by low-level feature distinctiveness with a dataset of synthetically-generated image patterns. Design of visual stimuli was inspired by the ones used in previous psychophysical experiments, namely in free-viewing and visual searching tasks, to provide a total of 15 types of stimuli, divided according to the task and feature to be analyzed. Our interest is to analyze the influences of low-level feature contrast between a salient region and the rest of distractors, providing fixation localization characteristics and reaction time of landing inside the salient region. Eye-tracking data was collected from 34 participants during the viewing of a 230 images dataset. Results show that saliency is predominantly and distinctively influenced by: 1. feature type, 2. feature contrast, 3. temporality of fixations, 4. task difficulty and 5. center bias. This experimentation proposes a new psychophysical basis for saliency model evaluation using synthetic images.

Sensory and decision-making processes underlying perceptual adaptation

Perceptual systems adapt to their inputs. As a result, prolonged exposure to particular stimuli alters judgments about subsequent stimuli. This phenomenon is commonly assumed to be sensory in origin. Changes in the decision-making process, however, may also be a component of adaptation. Here, we quantify sensory and decision-making contributions to adaptation in a facial expression paradigm. As expected, exposure to happy or sad expressions shifts the psychometric function toward the adaptor. More surprisingly, response times show both an overall decline and an asymmetry, with faster responses opposite the adapting category, implicating a substantial change in the decision-making process. Specifically, we infer that sensory changes from adaptation are accompanied by changes in how much sensory information is accumulated for the two choices. We speculate that adaptation influences implicit expectations about the stimuli one will encounter, causing modifications in the decision-making process as part of a normative response to a change in context.

Visual adaptation and the amplitude spectra of radiological images

We examined how visual sensitivity and perception are affected by adaptation to the characteristic amplitude spectra of X-ray mammography images. Because of the transmissive nature of X-ray photons, these images have relatively more low-frequency variability than natural images, a difference that is captured by a steeper slope of the amplitude spectrum (~ − 1.5) compared to the ~ 1/f (slope of − 1) spectra common to natural scenes. Radiologists inspecting these images are therefore exposed to a different balance of spectral components, and we measured how this exposure might alter spatial vision. Observers (who were not radiologists) were adapted to images of normal mammograms or the same images sharpened by filtering the amplitude spectra to shallower slopes. Prior adaptation to the original mammograms significantly biased judgments of image focus relative to the sharpened images, demonstrating that the images are sufficient to induce substantial after-effects. The adaptation also induced strong losses in threshold contrast sensitivity that were selective for lower spatial frequencies, though these losses were very similar to the threshold changes induced by the sharpened images. Visual search for targets (Gaussian blobs) added to the images was also not differentially affected by adaptation to the original or sharper images. These results complement our previous studies examining how observers adapt to the textural properties or phase spectra of mammograms. Like the phase spectrum, adaptation to the amplitude spectrum of mammograms alters spatial sensitivity and visual judgments about the images. However, unlike the phase spectrum, adaptation to the amplitude spectra did not confer a selective performance advantage relative to more natural spectra.

Representing Color Ensembles

Colors are rarely uniform, yet little is known about how people represent color distributions. We introduce a new method for studying color ensembles based on intertrial learning in visual search. Participants looked for an oddly colored diamond among diamonds with colors taken from either uniform or Gaussian color distributions. On test trials, the targets had various distances in feature space from the mean of the preceding distractor color distribution. Targets on test trials therefore served as probes into probabilistic representations of distractor colors. Test-trial response times revealed a striking similarity between the physical distribution of colors and their internal representations. The results demonstrate that the visual system represents color ensembles in a more detailed way than previously thought, coding not only mean and variance but, most surprisingly, the actual shape (uniform or Gaussian) of the distribution of colors in the environment.

Adaptation in the visual cortex: a case for probing neuronal populations with natural stimuli

The perception of, and neural responses to, sensory stimuli in the present are influenced by what has been observed in the past—a phenomenon known as adaptation. We focus on adaptation in visual cortical neurons as a paradigmatic example. We review recent work that represents two shifts in the way we study adaptation, namely (i) going beyond single neurons to study adaptation in populations of neurons and (ii) going beyond simple stimuli to study adaptation to natural stimuli. We suggest that efforts in these two directions, through a closer integration of experimental and modeling approaches, will enable a more complete understanding of cortical processing in natural environments.

Influence of stimulus size on revealing non-cardinal color mechanisms

Multiple studies have shown that performance of subjects on a number of visual tasks is worse for non-cardinal than cardinal colors, especially in the red-green/luminance (RG/LUM) and tritan/luminance (TRIT/LUM) color planes. Inspired by neurophysiological evidence that suppressive surround input to receptive fields is particularly sensitive to luminance, we hypothesized that non-cardinal mechanisms in the RG/LUM and TRIT/LUM planes would be more sensitive to stimulus size than are isoluminant non-cardinal mechanisms. In Experiment 1 we tested 9-10 color-normal subjects in each of the three color planes (RG/TRIT, RG/LUM, and TRIT/LUM) on visual search at four bull's-eye dot sizes (0.5°/1°, 1°/2°, 2°/4°, and 3°/6° center/annulus dot diameter). This study yielded a significant main effect of dot size in each of the three color planes. In Experiment 2 we tested the same hypothesis using noise masking, at three stimulus sizes (3°, 6° and 9° diameter Gabors), again in all three color planes (5 subjects per color plane). This experiment yielded, in the RG/TRIT plane, a significant main effect of stimulus size; in the RG/LUM plane, significant evidence for non-cardinal mechanisms only for the 9° stimulus; but in the TRIT/LUM plane no evidence for non-cardinal mechanisms at any stimulus size. These results suggest that non-cardinal mechanisms, particularly in the RG/LUM color plane, are more sensitive to stimulus size than are non-cardinals in the RG/TRIT plane, supporting our hypothesis.

Responses to Pop-Out Stimuli in the Barn Owl's Optic Tectum Can Emerge through Stimulus-Specific Adaptation

Here, we studied neural correlates of orientation-contrast-based saliency in the optic tectum (OT) of barn owls. Neural responses in the intermediate/deep layers of the OT were recorded from lightly anesthetized owls confronted with arrays of bars in which one bar (the target) was orthogonal to the remaining bars (the distractors). Responses to target bars were compared with responses to distractor bars in the receptive field (RF). Initially, no orientation-contrast sensitivity was observed. However, if the position of the target bar in the array was randomly shuffled across trials so that it occasionally appeared in the RF, then such sensitivity emerged. The effect started to become significant after three or four positional changes of the target bar and strengthened with additional trials. Our data further suggest that this effect arises due to specific adaptation to the stimulus in the RF combined with suppression from the surround. By jittering the position of the bar inside the RF across trials, we demonstrate that the adaptation has two components, one position specific and one orientation specific. The findings give rise to the hypothesis that barn owls, by active scanning of the scene, can induce adaptation of the tectal circuitry to the common orientation and thus achieve a "pop-out" of rare orientations. Such a model is consistent with several behavioral observations in owls and may be relevant to other visual features and species.

SIGNIFICANCE STATEMENT

Natural scenes are often characterized by a dominant orientation, such as the scenery of a pine forest or the sand dunes in a windy desert. Therefore, orientation that contrasts the regularity of the scene is perceived salient for many animals as a means to break camouflage. By actively moving the scene between each trial, we show here that neurons in the retinotopic map of the barn owl's optic tectum specifically adapt to the common orientation, giving rise to preferential representation of odd orientations. Based on this, we suggest a new mechanism for orientation-based camouflage breaking that links active scanning of scenes with neural adaptation. This mechanism may be relevant to pop-out in other species and visual features.

Adaptation and visual search in mammographic images

Radiologists face the visually challenging task of detecting suspicious features within the complex and noisy backgrounds characteristic of medical images. We used a search task to examine whether the salience of target features in x-ray mammograms could be enhanced by prior adaptation to the spatial structure of the images. The observers were not radiologists, and thus had no diagnostic training with the images. The stimuli were randomly selected sections from normal mammograms previously classified with BIRADS Density scores of "fatty" versus "dense," corresponding to differences in the relative quantities of fat versus fibroglandular tissue. These categories reflect conspicuous differences in visual texture, with dense tissue being more likely to obscure lesion detection. The targets were simulated masses corresponding to bright Gaussian spots, superimposed by adding the luminance to the background. A single target was randomly added to each image, with contrast varied over five levels so that they varied from difficult to easy to detect. Reaction times were measured for detecting the target location, before or after adapting to a gray field or to random sequences of a different set of dense or fatty images. Observers were faster at detecting the targets in either dense or fatty images after adapting to the specific background type (dense or fatty) that they were searching within. Thus, the adaptation led to a facilitation of search performance that was selective for the background texture. Our results are consistent with the hypothesis that adaptation allows observers to more effectively suppress the specific structure of the background, thereby heightening visual salience and search efficiency.

Assessment of perceptibility and acceptability of color variations between matched teeth among trainee dentist and lay person

Aim:

The aim of this study was to find the difference in perceptibility and acceptability of changes done to various color coordinates of matched teeth, between trainee dental surgeons, and lay person.

Materials and Methods:

A photograph with a set of matched central incisor teeth was selected. In one of the central incisors, the color coordinates (hue, value, and chroma) were altered to a preset value. These pictures were presented to trainee dental surgeons and lay person and their level of perception of color change and acceptance of color change was registered and compared.

Results:

It was found that trainee dental surgeons fared better in perceiving the color change and accepted less of the color changed specimens. The dimension of color that was more discerned both by lay person and trainee dental surgeons was value, hue, and last chroma.

Conclusion:

When compared to a lay person, dental surgeons are more acute in perceiving color changes and do not accept the color difference between teeth to a higher degree.

Visual Adaptation

Sensory systems continuously mold themselves to the widely varying contexts in which they must operate. Studies of these adaptations have played a long and central role in vision science. In part this is because the specific adaptations remain a powerful tool for dissecting vision, by exposing the mechanisms that are adapting. That is, "if it adapts, it's there." Many insights about vision have come from using adaptation in this way, as a method. A second important trend has been the realization that the processes of adaptation are themselves essential to how vision works, and thus are likely to operate at all levels. That is, "if it's there, it adapts." This has focused interest on the mechanisms of adaptation as the target rather than the probe. Together both approaches have led to an emerging insight of adaptation as a fundamental and ubiquitous coding strategy impacting all aspects of how we see.

Striking individual differences in color perception uncovered by 'the dress' photograph

'The dress' is a peculiar photograph: by themselves the dress' pixels are brown and blue, colors associated with natural illuminants, but popular accounts (#TheDress) suggest the dress appears either white/gold or blue/black. Could the purported categorical perception arise because the original social-media question was an alternative-forced-choice? In a free-response survey (N = 1401), we found that most people, including those naïve to the image, reported white/gold or blue/black, but some said blue/brown. Reports of white/gold over blue/black were higher among older people and women. On re-test, some subjects reported a switch in perception, showing the image can be multistable. In a language-independent measure of perception, we asked subjects to identify the dress' colors from a complete color gamut. The results showed three peaks corresponding to the main descriptive categories, providing additional evidence that the brain resolves the image into one of three stable percepts. We hypothesize that these reflect different internal priors: some people favor a cool illuminant (blue sky), discount shorter wavelengths, and perceive white/gold; others favor a warm illuminant (incandescent light), discount longer wavelengths, and see blue/black. The remaining subjects may assume a neutral illuminant, and see blue/brown. We show that by introducing overt cues to the illumination, we can flip the dress color.

Deciding on race: a diffusion model analysis of race-categorisation

It has long been known that a person's race can affect their decisions about people of another race; an observation that clearly taps into some deep societal issues. However, in order to behave differently in response to someone else's race, you must first categorise that person as other-race. The current study investigates the process of race-categorisation. Two groups of participants, Asian and Caucasian, rapidly classified facial images that varied from strongly Asian, through racially intermediate, to strongly Caucasian. In agreement with previous findings, there was a difference in category boundary between the two groups. Asian participants more frequently judged intermediate images as Caucasian and vice versa. We fitted a decision model, the Ratcliff diffusion model, to our two choice reaction time data. This model provides an account of the processes thought to underlie binary choice decisions. Within its architecture it has two components that could reasonably lead to a difference in race category boundary, these being evidence accumulation rate and a priori bias. The latter is the expectation or prior belief that a participant brings to the task, whilst the former indexes sensitivity to race-dependent perceptual cues. Whilst we find no good evidence for a difference in a priori bias between our two groups, we do find evidence for a difference in evidence accumulation rate. Our Asian participants were more sensitive to Caucasian cues within the images than were our Caucasian participants (and vice versa). These results support the idea that differences in perceptual sensitivity to race-defining visual characteristics drive differences in race categorisation. We propose that our findings fit with a wider view in which perceptual adaptation plays a central role in the visual processing of own and other race.

Seeing, adapting to, and reproducing the appearance of nature

The perception of color in nature is a complex multidimensional phenomenon. The vast range and high dimensionality of the light stimulus in a natural scene is reduced in range and dimension by the human visual system. The color experience is reduced to the appearance attributes of brightness, lightness, colorfulness, chroma, saturation, and hue from spectral energy distributions in the scene, while the vast range of light levels present in the world is reduced to a more manageable perceptual range through local adaptation. These processes set the stage for our efforts to capture, process, and reproduce the colors of nature as well as make artistic interpretations of them. This paper reviews the challenges involved in accurately capturing and reproducing optical phenomena observed in nature.

Probing the functions of contextual modulation by adapting images rather than observers

Countless visual aftereffects have illustrated how visual sensitivity and perception can be biased by adaptation to the recent temporal context. This contextual modulation has been proposed to serve a variety of functions, but the actual benefits of adaptation remain uncertain. We describe an approach we have recently developed for exploring these benefits by adapting images instead of observers, to simulate how images should appear under theoretically optimal states of adaptation. This allows the long-term consequences of adaptation to be evaluated in ways that are difficult to probe by adapting observers, and provides a common framework for understanding how visual coding changes when the environment or the observer changes, or for evaluating how the effects of temporal context depend on different models of visual coding or the adaptation processes. The approach is illustrated for the specific case of adaptation to color, for which the initial neural coding and adaptation processes are relatively well understood, but can in principle be applied to examine the consequences of adaptation for any stimulus dimension. A simple calibration that adjusts each neuron's sensitivity according to the stimulus level it is exposed to is sufficient to normalize visual coding and generate a host of benefits, from increased efficiency to perceptual constancy to enhanced discrimination. This temporal normalization may also provide an important precursor for the effective operation of contextual mechanisms operating across space or feature dimensions. To the extent that the effects of adaptation can be predicted, images from new environments could be "pre-adapted" to match them to the observer, eliminating the need for observers to adapt.

Moving sensory adaptation beyond suppressive effects in single neurons

How an object is perceived depends on the temporal context in which it is encountered. Sensory signals in the brain also depend on temporal context, a phenomenon often referred to as adaptation. Traditional descriptions of adaptation effects emphasize various forms of response fatigue in single neurons, which grow in strength with exposure to a stimulus. Recent work on vision, and other sensory modalities, has shown that this description has substantial shortcomings. Here we review our emerging understanding of how adaptation alters the balance between excitatory and suppressive signals, how effects depend on adaptation duration, and how adaptation influences representations that are distributed within and across multiple brain structures. This work points to a sophisticated set of mechanisms for adjusting to recent sensory experience, and suggests new avenues for understanding their function.

Perceiving the average hue of color arrays

The average of a color distribution has special significance for color coding (e.g., to estimate the illuminant) but how it depends on the visual representation (e.g., perceptual versus cone-opponent) or nonlinearities (e.g., categorical coding) is unknown. We measured the perceived average of two colors shown alternated in spatial arrays. Observers adjusted the components until the average equaled a specified reference hue. Matches for red, blue-red, or yellow-green were consistent with the arithmetic mean chromaticity, while blue-green settings deviated toward blue. The settings show little evidence for categorical coding, and cannot be predicted from the scaled appearances of the individual components.

Adaptation aftereffects in the perception of radiological images

Radiologists must classify and interpret medical images on the basis of visual inspection. We examined how the perception of radiological scans might be affected by common processes of adaptation in the visual system. Adaptation selectively adjusts sensitivity to the properties of the stimulus in current view, inducing an aftereffect in the appearance of stimuli viewed subsequently. These perceptual changes have been found to affect many visual attributes, but whether they are relevant to medical image perception is not well understood. To examine this we tested whether aftereffects could be generated by the characteristic spatial structure of radiological scans, and whether this could bias their appearance along dimensions that are routinely used to classify them. Measurements were focused on the effects of adaptation to images of normal mammograms, and were tested in observers who were not radiologists. Tissue density in mammograms is evaluated visually and ranges from "dense" to "fatty." Arrays of images varying in intermediate levels between these categories were created by blending dense and fatty images with different weights. Observers first adapted by viewing image samples of dense or fatty tissue, and then judged the appearance of the intermediate images by using a texture matching task. This revealed pronounced perceptual aftereffects - prior exposure to dense images caused an intermediate image to appear more fatty and vice versa. Moreover, the appearance of the adapting images themselves changed with prolonged viewing, so that they became less distinctive as textures. These aftereffects could not be accounted for by the contrast differences or power spectra of the images, and instead tended to follow from the phase spectrum. Our results suggest that observers can selectively adapt to the properties of radiological images, and that this selectivity could strongly impact the perceived textural characteristics of the images.

Adaptation improves performance on a visual search task

Temporal context, or adaptation, profoundly affects visual perception. Despite the strength and prevalence of adaptation effects, their functional role in visual processing remains unclear. The effects of spatial context and their functional role are better understood: these effects highlight features that differ from their surroundings and determine stimulus salience. Similarities in the perceptual and physiological effects of spatial and temporal context raise the possibility that they serve similar functions. We therefore tested the possibility that adaptation can enhance stimulus salience. We measured the effects of prolonged (40 s) adaptation to a counterphase grating on performance in a search task in which targets were defined by an orientation offset relative to a background of distracters. We found that, for targets with small orientation offsets, adaptation reduced reaction times and decreased the number of saccades made to find targets. Our results provide evidence that adaptation may function to highlight features that differ from the temporal context in which they are embedded.

Evolving concepts of sensory adaptation

Sensory systems constantly adapt their responses to match the current environment. These adjustments occur at many levels of the system and increasingly appear to calibrate even for highly abstract perceptual representations of the stimulus. The similar effects of adaptation across very different stimulus domains point to common design principles but also continue to raise questions about the purpose of adaptation.

Perceptual learning reconfigures the effects of visual adaptation

Our sensory experiences over a range of different timescales shape our perception of the environment. Two particularly striking short-term forms of plasticity with manifestly different time courses and perceptual consequences are those caused by visual adaptation and perceptual learning. Although conventionally treated as distinct forms of experience-dependent plasticity, their neural mechanisms and perceptual consequences have become increasingly blurred, raising the possibility that they might interact. To optimize our chances of finding a functionally meaningful interaction between learning and adaptation, we examined in humans the perceptual consequences of learning a fine discrimination task while adapting the neurons that carry most information for performing this task. Learning improved discriminative accuracy to a level that ultimately surpassed that in an unadapted state. This remarkable improvement came at a price: adapting directions that before learning had little effect elevated discrimination thresholds afterward. The improvements in discriminative accuracy grew quickly and surpassed unadapted levels within the first few training sessions, whereas the deterioration in discriminative accuracy had a different time course. This learned reconfiguration of adapted discriminative accuracy occurred without a concomitant change to the characteristic perceptual biases induced by adaptation, suggesting that the system was still in an adapted state. Our results point to a functionally meaningful push-pull interaction between learning and adaptation in which a gain in sensitivity in one adapted state is balanced by a loss of sensitivity in other adapted states.

Color tuning in alert macaque V1 assessed with fMRI and single-unit recording shows a bias toward daylight colors

Colors defined by the two intermediate directions in color space, "orange-cyan" and "lime-magenta," elicit the same spatiotemporal average response from the two cardinal chromatic channels in the lateral geniculate nucleus (LGN). While we found LGN functional magnetic resonance imaging (fMRI) responses to these pairs of colors were statistically indistinguishable, primary visual cortex (V1) fMRI responses were stronger to orange-cyan. Moreover, linear combinations of single-cell responses to cone-isolating stimuli of V1 cone-opponent cells also yielded stronger predicted responses to orange-cyan over lime-magenta, suggesting these neurons underlie the fMRI result. These observations are consistent with the hypothesis that V1 recombines LGN signals into "higher-order" mechanisms tuned to noncardinal color directions. In light of work showing that natural images and daylight samples are biased toward orange-cyan, our findings further suggest that V1 is adapted to daylight. V1, especially double-opponent cells, may function to extract spatial information from color boundaries correlated with scene-structure cues, such as shadows lit by ambient blue sky juxtaposed with surfaces reflecting sunshine.

Uniform color spaces and natural image statistics

Many aspects of visual coding have been successfully predicted by starting from the statistics of natural scenes and then asking how the stimulus could be efficiently represented. We started from the representation of color characterized by uniform color spaces, and then asked what type of color environment they implied. These spaces are designed to represent equal perceptual differences in color discrimination or appearance by equal distances in the space. The relative sensitivity to different axes within the space might therefore reflect the gamut of colors in natural scenes. To examine this, we projected perceptually uniform distributions within the Munsell, CIE L(*)u(*)v(*) or CIE L(*)a(*)b(*) spaces into cone-opponent space. All were elongated along a bluish-yellowish axis reflecting covarying signals along the L-M and S-(L+M) cardinal axes, a pattern typical (though not identical) to many natural environments. In turn, color distributions from environments were more uniform when projected into the CIE L(*)a(*)b(*) perceptual space than when represented in a normalized cone-opponent space. These analyses suggest the bluish-yellowish bias in environmental colors might be an important factor shaping chromatic sensitivity, and also suggest that perceptually uniform color metrics could be derived from natural scene statistics and potentially tailored to specific environments.

All in a sniff: olfaction as a model for active sensing

Sensation is an active process involving the sampling and central processing of external stimuli selectively in space and time. Olfaction in particular depends strongly on active sensing due to the fact that-at least in mammals-inhalation of air into the nasal cavity is required for odor detection. This seemingly simple first step in odor sensation profoundly shapes nearly all aspects of olfactory system function, from the distribution of odorant receptors to the functional organization of central processing to the perception of odors. The dependence of olfaction on inhalation also allows for profound modulation of olfactory processing by changes in odor sampling strategies in coordination with attentional state and sensory demands. This review discusses the role of active sensing in shaping olfactory system function at multiple levels and draws parallels with other sensory modalities to highlight the importance of an active sensing perspective in understanding how sensory systems work in the behaving animal.

Adaptation and visual coding

Visual coding is a highly dynamic process and continuously adapting to the current viewing context. The perceptual changes that result from adaptation to recently viewed stimuli remain a powerful and popular tool for analyzing sensory mechanisms and plasticity. Over the last decade, the footprints of this adaptation have been tracked to both higher and lower levels of the visual pathway and over a wider range of timescales, revealing that visual processing is much more adaptable than previously thought. This work has also revealed that the pattern of aftereffects is similar across many stimulus dimensions, pointing to common coding principles in which adaptation plays a central role. However, why visual coding adapts has yet to be fully answered.