Visual Adaptation

The perceived beauty of art is not strongly calibrated to the statistical regularities of real-world scenes

Aesthetic judgements are partly predicted by image statistics, although the extent to which they are calibrated to the statistics of real-world scenes and the 'visual diet' of daily life is unclear. Here, we investigated the extent to which the beauty ratings of Western oil paintings from the JenAesthetics dataset can be accounted for by real-world scene statistics. We computed spatial and chromatic image statistics for the paintings and a set of real-world scenes captured by a head-mounted camera as participants went about daily lives. Partial least squares regression (PLSR) indicated that 6-15% of the variance in beauty ratings of the art can be accounted for by the art's image statistics. The luminance contrast of paintings made an important contribution to the PLSR models: paintings were perceived as more beautiful the greater the variation in luminance. PLSR models which expressed the art's image statistics relative to real-world scene statistics explained a similar amount of variance to models using the art's image statistics. The importance of an image statistic to perceived beauty was not related to how closely art reproduces the value from the real world. The findings suggest that beauty judgements of art are not strongly calibrated to the scene statistics of the real world.

Temporal regularities shape perceptual decisions and striatal dopamine signals

Perceptual decisions should depend on sensory evidence. However, such decisions are also influenced by past choices and outcomes. These choice history biases may reflect advantageous strategies to exploit temporal regularities of natural environments. However, it is unclear whether and how observers can adapt their choice history biases to different temporal regularities, to exploit the multitude of temporal correlations that exist in nature. Here, we show that male mice adapt their perceptual choice history biases to different temporal regularities of visual stimuli. This adaptation was slow, evolving over hundreds of trials across several days. It occurred alongside a fast non-adaptive choice history bias, limited to a few trials. Both fast and slow trial history effects are well captured by a normative reinforcement learning algorithm with multi-trial belief states, comprising both current trial sensory and previous trial memory states. We demonstrate that dorsal striatal dopamine tracks predictions of the model and behavior, suggesting that striatal dopamine reports reward predictions associated with adaptive choice history biases. Our results reveal the adaptive nature of perceptual choice history biases and shed light on their underlying computational principles and neural correlates.

Adaptation in the visual system: Networked fatigue or suppressed prediction error signalling?

Our brains are constantly adapting to changes in our visual environments. Neural adaptation exerts a persistent influence on the activity of sensory neurons and our perceptual experience, however there is a lack of consensus regarding how adaptation is implemented in the visual system. One account describes fatigue-based mechanisms embedded within local networks of stimulus-selective neurons (networked fatigue models). Another depicts adaptation as a product of stimulus expectations (predictive coding models). In this review, I evaluate neuroimaging and psychophysical evidence that poses fundamental problems for predictive coding models of neural adaptation. Specifically, I discuss observations of distinct repetition and expectation effects, as well as incorrect predictions of repulsive adaptation aftereffects made by predictive coding accounts. Based on this evidence, I argue that networked fatigue models provide a more parsimonious account of adaptation effects in the visual system. Although stimulus expectations can be formed based on recent stimulation history, any consequences of these expectations are likely to co-occur (or interact) with effects of fatigue-based adaptation. I conclude by proposing novel, testable hypotheses relating to interactions between fatigue-based adaptation and other predictive processes, focusing on stimulus feature extrapolation phenomena.

Altered mechanisms of adaptation in social anxiety: differences in adapting to positive versus negative emotional faces

Social anxiety is characterised by fear of negative evaluation and negative perceptual biases; however, the cognitive mechanisms underlying these negative biases are not well understood. We investigated a possible mechanism which could maintain negative biases: altered adaptation to emotional faces. Heightened sensitivity to negative emotions could result from weakened adaptation to negative emotions, strengthened adaptation to positive emotions, or both mechanisms. We measured adaptation from repeated exposure to either positive or negative emotional faces, in individuals high versus low in social anxiety. We quantified adaptation strength by calculating the point of subjective equality (PSE) before and after adaptation for each participant. We hypothesised: (1) weaker adaptation to angry vs happy faces in individuals high in social anxiety, (2) no difference in adaptation to angry vs happy faces in individuals low in social anxiety, and (3) no difference in adaptation to sad vs happy faces in individuals high in social anxiety. Our results revealed a weaker adaptation to angry compared to happy faces in individuals high in social anxiety (Experiment 1), with no such difference in individuals low in social anxiety (Experiment 1), and no difference in adaptation strength to sad vs happy faces in individuals high in social anxiety (Experiment 2).

Number adaptation: A critical look

It is often assumed that adaptation - a temporary change in sensitivity to a perceptual dimension following exposure to that dimension - is a litmus test for what is and is not a "primary visual attribute". Thus, papers purporting to find evidence of number adaptation motivate a claim of great significance: That number is something that can be seen in much the way that canonical visual features, like color, contrast, size, and speed, can. Fifteen years after its reported discovery, number adaptation's existence seems to be nearly undisputed, with dozens of papers documenting support for the phenomenon. The aim of this paper is to offer a counterweight - to critically assess the evidence for and against number adaptation. After surveying the many reasons for thinking that number adaptation exists, we introduce several lesser-known reasons to be skeptical. We then advance an alternative account - the old news hypothesis - which can accommodate previously published findings while explaining various (otherwise unexplained) anomalies in the existing literature. Next, we describe the results of eight pre-registered experiments which pit our novel old news hypothesis against the received number adaptation hypothesis. Collectively, the results of these experiments undermine the number adaptation hypothesis on several fronts, whilst consistently supporting the old news hypothesis. More broadly our work raises questions about the status of adaptation itself as a means of discerning what is and is not a visual attribute.

Size adaptation: Do you know it when you see it?

The visual system adapts to a wide range of visual features, from lower-level features like color and motion to higher-level features like causality and, perhaps, number. According to some, adaptation is a strictly perceptual phenomenon, such that the presence of adaptation licenses the claim that a feature is truly perceptual in nature. Given the theoretical importance of claims about adaptation, then, it is important to understand exactly when the visual system does and does not exhibit adaptation. Here, we take as a case study one specific kind of adaptation: visual adaptation to size. Supported by evidence from four experiments, we argue that, despite robust effects of size adaptation in the lab, (1) size adaptation effects are phenomenologically underwhelming (in some cases, hardly appreciable at all), (2) some effects of size adaptation appear contradictory, and difficult to explain given current theories of size adaptation, and (3) prior studies on size adaptation may have failed to isolate size as the adapted dimension. Ultimately, we argue that while there is evidence to license the claim that size adaptation is genuine, size adaptation is a puzzling and poorly understood phenomenon.

Cross-linguistic syntactic priming as rational expectation for syntactic repetition in the bilingual environment

Recent research suggests that syntactic priming in language comprehension-the facilitated processing of repeated syntactic structures-arises from the expectation for syntactic repetition due to rational adaptation to the linguistic environment. To further evaluate the generalizability of this expectation adaptation account in cross-linguistic syntactic priming and explore the influence of second language (L2) proficiency, we conducted a self-paced reading study with Chinese L2 learners of English by utilizing the sentential complement-direct object (SC-DO) ambiguity. The results showed that participants exposed to clusters of SC structures subsequently processed repetitions of this structure more rapidly (i.e., larger priming effects) than those exposed to the same number of SC structures but spaced in time, despite the prime and target being in two different languages (Chinese and English). Furthermore, this difference in priming strength was more pronounced for participants with higher L2 (English) proficiency. These findings demonstrate that cross-linguistic syntactic priming is consistent with the expectation for syntactic repetition that rationally adapts to syntactic clustering properties in surrounding bilingual environments, and such adaptation is enhanced as L2 proficiency increases. Taken together, our study extends the expectation adaptation account to cross-linguistic syntactic priming and integrates the role of L2 proficiency, which can shed new light on the mechanisms underlying syntactic priming, bilingual shared syntactic representations and expectation-based sentence processing.

Serial dependence: A matter of memory load

In serial dependence, perceptual decisions are biased towards stimuli encountered in the recent past. Here, we investigate whether and how serial dependence is affected by the availability of visual working memory (VWM) resources. In two experiments, participants reproduced the orientation of a series of stimuli. On alternating trials, we included an additional VWM task with randomly varying levels of load. Serial dependence was not only affected by the additional load task but also clearly modulated by the level of load: a high load in the previous trial reduced serial dependence while a high load in the present increased it. These results were independent of the effects of VWM load on the precision of reproduction responses. Our findings provide new insights into the mechanisms that may regulate serial dependence, revealing its intimate link with VWM resources.

Significance statement

Our perception, thoughts, and behavior are continuously influenced by recent events. For instance, the way we process and understand current visual information depends on what we have seen in the preceding seconds, a phenomenon known as serial dependence. The precise mechanisms and factors involved in serial dependence are still unclear. Here, we demonstrated that working memory resources are a crucial component. Specifically, when we are currently experiencing a heavy memory load, the influence of prior stimuli becomes stronger. Conversely, when prior stimuli were shown under a high memory load, their influence was reduced. These findings highlight the importance of working memory resources in shaping our interpretation of the present based on the recent past.

Recent visual experience reshapes V4 neuronal activity and improves perceptual performance

Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.

Dynamics of sensory and decisional biases in perceptual decision making: Insights from the face distortion illusion

Bias in perceptual decision making can have both sensory and decisional origins. These distinct sources of bias are typically seen as static and stable over time. However, human behavior is dynamic and constantly adapting. Yet it remains unclear how sensory and decisional biases progress in distinct ways over time. We addressed this question by tracking the dynamics of sensory and decisional biases during a task that involves a visual illusion. Observers saw multiple pairs of peripherally presented faces that induce a strong illusion making the faces appear distorted and grotesque. The task was to judge whether one of the last two faces had true physical distortion (experimentally introduced in half of the trials). Initially, participants classified most faces as distorted as exemplified by a liberal response bias. However, over the course of the experiment, this response bias gradually disappeared even though the distortion illusion remained equally strong, as demonstrated by a separate subjective rating task without artificially distorted faces. The results suggest that the sensory bias was progressively countered by an opposite decisional bias. This transition was accompanied by an increase in reaction times and a decrease in confidence relative to a condition that does not induce the visual illusion. All results were replicated in a second experiment with inverted faces. These findings demonstrate that participants dynamically adjust their decisional bias to compensate for sensory biases, and that these two biases together determine how humans make perceptual decisions.

Super recognizers: Increased sensitivity or reduced biases? Insights from serial dependence

Super recognizers (SRs) are people that exhibit a naturally occurring superiority for processing facial identity. Despite the increase of SR research, the mechanisms underlying their exceptional abilities remain unclear. Here, we investigated whether the enhanced facial identity processing of SRs could be attributed to the lack of sequential effects, such as serial dependence. In serial dependence, perception of stimulus features is assimilated toward stimuli presented in previous trials. This constant error in visual perception has been proposed as a mechanism that promotes perceptual stability in everyday life. We hypothesized that an absence of this constant source of error in SRs could account for their superior processing-potentially in a domain-general fashion. We tested SRs (n = 17) identified via a recently proposed diagnostic framework (Ramon, 2021) and age-matched controls (n = 20) with two experiments probing serial dependence in the face and shape domains. In each experiment, observers were presented with randomly morphed face identities or shapes and were asked to adjust a face's identity or a shape to match the stimulus they saw. We found serial dependence in controls and SRs alike, with no difference in its magnitude across groups. Interestingly, we found that serial dependence impacted the performance of SRs more than that of controls. Taken together, our results show that enhanced face identity processing skills in SRs cannot be attributed to the lack of serial dependence. Rather, serial dependence, a beneficial nested error in our visual system, may in fact further stabilize the perception of SRs and thus enhance their visual processing proficiency.

Selection drives divergence of eye morphology in sympatric Heliconius butterflies

When populations experience different sensory conditions, natural selection may favor sensory system divergence, affecting peripheral structures and/or downstream neural pathways. We characterized the outer eye morphology of sympatric Heliconius butterflies from different forest types and their first-generation reciprocal hybrids to test for adaptive visual system divergence and hybrid disruption. In Panama, Heliconius cydno occurs in closed forests, whereas Heliconius melpomene resides at the forest edge. Among wild individuals, H. cydno has larger eyes than H. melpomene, and there are heritable, habitat-associated differences in the visual brain structures that exceed neutral divergence expectations. Notably, hybrids have intermediate neural phenotypes, suggesting disruption. To test for similar effects in the visual periphery, we reared both species and their hybrids in common garden conditions. We confirm that H. cydno has larger eyes and provide new evidence that this is driven by selection. Hybrid eye morphology is more H. melpomene-like despite body size being intermediate, contrasting with neural trait intermediacy. Overall, our results suggest that eye morphology differences between H. cydno and H. melpomene are adaptive and that hybrids may suffer fitness costs due to a mismatch between the peripheral visual structures and previously described neural traits that could affect visual performance.

The effect of an odd-one-out visual search task on attentional bias, body size adaptation, and body dissatisfaction

Body image disturbance is a both a risk factor for, and a symptom of, many eating disorders and refers to the misperception of and dissatisfaction with one's own body. Women with high body dissatisfaction have been shown to direct more attention to low body mass index (BMI) bodies, which results in the overestimation of body size via body size adaptation. Therefore, attention may have a causal role in body image disturbance. We conducted a novel training visual search task with 142 young adult women who we trained to attend to either high or low BMI bodies. We assessed the effects of this training on attention to bodies of different sizes, body size adaptation, and body dissatisfaction. Women trained to attend to low BMI bodies decreased their perceptions of a 'normal' body size via adaptation from pre- to post-training (p < 0.001); however, women trained to attend to high BMI bodies showed no change in their perception of a 'normal' body size. We found no lasting effects of the training on attention to body size or body dissatisfaction; however, our visual search task showed poor internal consistency as a measure of attention. These findings indicate that attention to low BMI bodies may exacerbate body image disturbance in women. However, more reliable measures of attentional are required to confirm this finding.

Representation and computation in visual working memory

The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.

A preference to look closer to the eyes is associated with a position-invariant face neural code

When looking at faces, humans invariably move their eyes to a consistent preferred first fixation location on the face. While most people have the preferred fixation location just below the eyes, a minority have it between the nose-tip and mouth. Not much is known about whether these long-term differences in the preferred fixation location are associated with distinct neural representations of faces. To study this, we used a gaze-contingent face adaptation aftereffect paradigm to test in two groups of observers, one with their mean preferred fixation location closer to the eyes (upper lookers) and the other closer to the mouth (lower lookers). In this task, participants were required to maintain their gaze at either their own group's mean preferred fixation location or that of the other group during adaptation and testing. The two possible fixation locations were 3.6° apart on the face. We measured the face adaptation aftereffects when the adaptation and testing happened while participants maintained fixation at either the same or different locations on the face. Both groups showed equally strong adaptation effects when the adaptation and testing happened at the same fixation location. Crucially, only the upper lookers showed a partial transfer of the FAE across the two fixation locations, when adaptation occurred at the eyes. Lower lookers showed no spatial transfer of the FAE irrespective of the adaptation position. Given the classic finding that neural tuning is increasingly position invariant as one moves higher in the visual hierarchy, this result suggests that differences in the preferred fixation location are associated with distinct neural representations of faces.

The color of fruits in photographs and still life paintings

Still life paintings comprise a wealth of data on visual perception. Prior work has shown that the color statistics of objects show a marked bias for warm colors. Here, we ask about the relative chromatic contrast of these object-associated colors compared with background colors in still life paintings. We reasoned that, owing to the memory color effect, where the color of familiar objects is perceived more saturated, warm colors will be relatively more saturated than cool colors in still life paintings as compared with photographs. We analyzed color in 108 slides of still life paintings of fruit from the teaching slide collection of the Fogg University Art Museum and 41 color-calibrated photographs of fruit from the McGill data set. The results show that the relatively higher chromatic contrast of warm colors was greater for paintings compared with photographs, consistent with the hypothesis.

Adaptation and exogenous attention interact in the early visual cortex: A TMS study

Transcranial magnetic stimulation (TMS) to early visual cortex modulates the effect of adaptation and eliminates the effect of exogenous (involuntary) attention on contrast sensitivity. Here we investigated whether adaptation modulates exogenous attention under TMS to V1/V2. Observers performed an orientation discrimination task while attending to one of two stimuli, with or without adaptation. Following an attentional cue, two stimuli were presented in the stimulated region and its contralateral symmetric region. A response cue indicated the stimulus whose orientation observers had to discriminate. Without adaptation, in the distractor-stimulated condition, contrast sensitivity increased at the attended location and decreased at the unattended location via response gain-but these effects were eliminated in the target-stimulated condition. Critically, after adaptation, exogenous attention altered performance similarly in both distractor-stimulated and target-stimulated conditions. These results reveal that (1) adaptation and attention interact in the early visual cortex, and (2) adaptation shields exogenous attention from TMS effects.

Deep Aphantasia: a visual brain with minimal influence from priors or inhibitory feedback?

The authors are both self-described congenital aphantasics, who feel they have never been able to have volitional imagined visual experiences during their waking lives. In addition, Loren has atypical experiences of a number of visual phenomena that involve an extrapolation or integration of visual information across space. In this perspective, we describe Loren's atypical experiences of a number of visual phenomena, and we suggest these ensue because her visual experiences are not strongly shaped by inhibitory feedback or by prior expectations. We describe Loren as having Deep Aphantasia, and Derek as shallow, as for both a paucity of feedback might prevent the generation of imagined visual experiences, but for Loren this additionally seems to disrupt activity at a sufficiently early locus to cause atypical experiences of actual visual inputs. Our purpose in describing these subjective experiences is to alert others to the possibility of there being sub-classes of congenital aphantasia, one of which-Deep Aphantasia, would be characterized by atypical experiences of actual visual inputs.

Are ipRGCs involved in human color vision? Hints from physiology, psychophysics, and natural image statistics

Human photoreceptors consist of cones, rods, and melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs). First studied in circadian regulation and pupillary control, ipRGCs project to a variety of brain centers suggesting a broader involvement beyond non-visual functions. IpRGC responses are stable, long-lasting, and with a particular codification of photoreceptor signals. In comparison with the transient and adaptive nature of cone and rod signals, ipRGCs' signaling might provide an ecological advantage to different attributes of color vision. Previous studies have indicated melanopsin's influence on visual responses yet its contribution to color perception in humans remains debated. We summarized evidence and hypotheses (from physiology, psychophysics, and natural image statistics) about direct and indirect involvement of ipRGCs in human color vision, by first briefly assessing the current knowledge about the role of melanopsin and ipRGCs in vision and codification of spectral signals. We then approached the question about melanopsin activation eliciting a color percept, discussing studies using the silent substitution method. Finally, we explore various avenues through which ipRGCs might impact color perception indirectly, such as through involvement in peripheral color matching, post-receptoral pathways, color constancy, long-term chromatic adaptation, and chromatic induction. While there is consensus about the role of ipRGCs in brightness perception, confirming its direct contribution to human color perception requires further investigation. We proposed potential approaches for future research, emphasizing the need for empirical validation and methodological thoroughness to elucidate the exact role of ipRGCs in human color vision.

Implicit weight bias: shared neural substrates for overweight and angry facial expressions revealed by cross-adaptation

The perception of facial expression plays a crucial role in social communication, and it is known to be influenced by various facial cues. Previous studies have reported both positive and negative biases toward overweight individuals. It is unclear whether facial cues, such as facial weight, bias facial expression perception. Combining psychophysics and event-related potential technology, the current study adopted a cross-adaptation paradigm to examine this issue. The psychophysical results of Experiments 1A and 1B revealed a bidirectional cross-adaptation effect between overweight and angry faces. Adapting to overweight faces decreased the likelihood of perceiving ambiguous emotional expressions as angry compared to adapting to normal-weight faces. Likewise, exposure to angry faces subsequently caused normal-weight faces to appear thinner. These findings were corroborated by bidirectional event-related potential results, showing that adaptation to overweight faces relative to normal-weight faces modulated the event-related potential responses of emotionally ambiguous facial expression (Experiment 2A); vice versa, adaptation to angry faces relative to neutral faces modulated the event-related potential responses of ambiguous faces in facial weight (Experiment 2B). Our study provides direct evidence associating overweight faces with facial expression, suggesting at least partly common neural substrates for the perception of overweight and angry faces.

Designing for sensory adaptation: what you see depends on what you've been looking at - Recommendations, guidelines and standards should reflect this

Sensory systems continuously recalibrate their responses according to the current stimulus environment. As a result, perception is strongly affected by the current and recent context. These adaptative changes affect both sensitivity (e.g., habituating to noise, seeing better in the dark) and appearance (e.g. how things look, what catches attention) and adjust to many perceptual properties (e.g. from light level to the characteristics of someone's face). They therefore have a profound effect on most perceptual experiences, and on how and how well the senses work in different settings. Characterizing the properties of adaptation, how it manifests, and when it influences perception in modern environments can provide insights into the diversity of human experience. Adaptation could also be leveraged both to optimize perceptual abilities (e.g. in visual inspection tasks like radiology) and to mitigate unwanted consequences (e.g. exposure to potentially unhealthy stimulus environments).

The interplay of motor adaptation and groupitizing in numerosity perception: Insights from visual motion adaptation and proprioceptive motor adaptation

Groupitizing is a well-established strategy in numerosity perception that enhances speed and sensory precision. Building on the ATOM theory, Anobile proposed the sensorimotor numerosity system, which posits a strong link between number and action. Previous studies using motor adaptation technology have shown that high-frequency motor adaptation leads to underestimation of numerosity perception, while low-frequency adaptation leads to overestimation. However, the impact of motor adaptation on groupitizing, and whether visual motion adaptation produces similar effects, remain unclear. In this study, we investigate the persistence of the advantage of groupitizing after motor adaptation and explore the effects of visual motion adaptation. Surprisingly, our findings reveal that proprioceptive motor adaptation weakens the advantage of groupitizing, indicating a robust effect of motor adaptation even when groupitizing is employed. Moreover, we observe a bidirectional relationship, as groupitizing also weakens the adaptation effect. These results highlight the complex interplay between motor adaptation and groupitizing in numerosity perception. Furthermore, our study provides evidence that visual motion adaptation also has an adaptation effect, but does not fully replicate the effects of proprioceptive motor adaptation on groupitizing. In conclusion, our research underscores the importance of groupitizing as a valuable strategy in numerosity perception, and sheds light on the influence of motion adaptation on this strategy.

The distinct development of stimulus and response serial dependence

Serial dependence (SD) is a phenomenon wherein current perceptions are biased by the previous stimulus and response. This helps to attenuate perceptual noise and variability in sensory input and facilitates stable ongoing perceptions of the environment. However, little is known about the developmental trajectory of SD. This study investigates how the stimulus and response biases of the SD effect develop across three age groups. Conventional analyses, in which previous stimulus and response biases were assessed separately, revealed significant changes in the biases over time. Previous stimulus bias shifted from repulsion to attraction, while previous response bias evolved from attraction to greater attraction. However, there was a strong correlation between stimulus and response orientations. Therefore, a generalized linear mixed-effects (GLME) analysis that simultaneously considered both previous stimulus and response, outperformed separate analyses. This revealed that previous stimulus and response resulted in two distinct biases with different developmental trajectories. The repulsion bias of previous stimulus remained relatively stable across all age groups, whereas the attraction bias of previous response was significantly stronger in adults than in children and adolescents. These findings demonstrate that the repulsion bias towards preceding stimuli is established early in the developing brain (at least by around 10 years old), while the attraction bias towards responses is not fully developed until adulthood. Our findings provide new insights into the development of the SD phenomenon and how humans integrate two opposing mechanisms into their perceptual responses to external input during development.

Effects of Neural Adaptation to Habitual Spherical Aberration on Depth of Focus

We investigated how long-term visual experience with habitual spherical aberration (SA) influences subjective depth of focus (DoF). Nine healthy cycloplegic eyes with habitual SAs of different signs and magnitudes were enrolled. An adaptive optics (AO) visual simulator was used to measure through-focus high-contrast visual acuity after correcting all monochromatic aberrations and imposing +0.5 μm and -0.5 μm SAs for a 6-mm pupil. The positive (n=6) and negative (n=3) SA groups ranged from 0.17 to 0.8 μm and from -1.2 to -0.12 μm for a 6-mm pupil, respectively. For the positive habitual SA group, the median DoF with positive AO-induced SA (2.18D) was larger than that with negative AO-induced SA (1.91D); for the negative habitual SA group, a smaller DoF was measured with positive AO-induced SA (1.81D) than that with negative AO-induced SA (2.09D). The difference in the DoF of individual participants between the induced positive and negative SA groups showed a quadratic relationship with the habitual SA. Subjective DoF tended to be larger when the induced SA in terms of the sign and magnitude was closer to the participant's habitual SA, suggesting the importance of considering the habitual SA when applying the extended DoF method using optical or surgical procedures.

The push-pull of serial dependence effects: Attraction to the prior response and repulsion from the prior stimulus

In the "serial dependence" effect, responses to visual stimuli appear biased toward the last trial's stimulus. However, several kinds of serial dependence exist, with some reflecting prior stimuli and others reflecting prior responses. One-factor analyses consider the prior stimulus alone or the prior response alone and can consider both variables only via separate analyses. We demonstrate that one-factor analyses are potentially misleading and can reach conclusions that are opposite from the truth if both dependencies exist. To address this limitation, we developed two-factor analyses (model comparison with hierarchical Bayesian modeling and an empirical "quadrant analysis"), which consider trial-by-trial combinations of prior response and prior stimulus. Two-factor analyses can tease apart the two dependencies if applied to a sufficiently large dataset. We applied these analyses to a new study and to four previously published studies. When applying a model that included the possibility of both dependencies, there was no evidence of attraction to the prior stimulus in any dataset, but there was evidence of attraction to the prior response in all datasets. Two of the datasets contained sufficient constraint to determine that both dependencies were needed to explain the results. For these datasets, the dependency on the prior stimulus was repulsive rather than attractive. Our results are consistent with the claim that both dependencies exist in most serial dependence studies (the two-dependence model was not ruled out for any dataset) and, furthermore, that the two dependencies work against each other.

Cortical quantity representations of visual numerosity and timing overlap increasingly into superior cortices but remain distinct

Many sensory brain areas are organized as topographic maps where neural response preferences change gradually across the cortical surface. Within association cortices, 7-Tesla fMRI and neural model-based analyses have also revealed many topographic maps for quantities like numerosity and event timing, often in similar locations. Numerical and temporal quantity estimations also show behavioral similarities and even interactions. For example, the duration of high-numerosity displays is perceived as longer than that of low-numerosity displays. Such interactions are often ascribed to a generalized magnitude system with shared neural responses across quantities. Anterior quantity responses are more closely linked to behavior. Here, we investigate whether common quantity representations hierarchically emerge by asking whether numerosity and timing maps become increasingly closely related in their overlap, response preferences, and topography. While the earliest quantity maps do not overlap, more superior maps overlap increasingly. In these overlapping areas, some intraparietal maps have consistently correlated numerosity and timing preferences, and some maps have consistent angles between the topographic progressions of numerosity and timing preferences. However, neither of these relationships increases hierarchically like the amount of overlap does. Therefore, responses to different quantities are initially derived separately, then progressively brought together, without generally becoming a common representation. Bringing together distinct responses to different quantities may underlie behavioral interactions and allow shared access to comparison and action planning systems.

Repeated passive visual experience modulates spontaneous and non-familiar stimuli-evoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

Repulsive Aftereffects of Visual Space

Prolonged exposure to a sensory stimulus induces perceptual adaptation aftereffects. Traditionally, aftereffects are known to change the appearance of stimulus features, like contrast, color, or shape. However, shifts in the spatial position of objects have also been observed to follow adaptation. Here, I demonstrate that visual adaptation produced by different adapter stimuli generates a bi-directional spatial repulsion. Observers had to judge the distance between a probe dot pair presented in the adapted region and compare them to a reference dot pair presented in a region not affected by adaptation. If the probe dot pair was present inside the adapted area, observers underestimated the distance. If, however, the dot pair straddled the adapted area, the distance was perceived as larger with a stronger distance expansion than compression. Bi-directional spatial repulsion was found with a similar magnitude for size and density adapters. Localization estimates with mouse pointing revealed that adaptation also affected absolute position judgments. Bi-directional spatial repulsion is most likely produced by the lines of adapter stimuli since single bars used as adapters were sufficient to induce spatial repulsion. Spatial repulsion was stronger for stimuli presented in the periphery. This finding explains why distance expansion is stronger than distance compression.

Predictive extrapolation effects can have a greater impact on visual decisions, while visual adaptation has a greater impact on conscious visual experience

Human vision is shaped by historic and by predictive processes. The lingering impact of visual adaptation, for instance, can act to exaggerate differences between past and present inputs, whereas predictive processes can promote extrapolation effects that allow us to anticipate the near future. It is unclear to what extent either of these effects manifest in changes to conscious visual experience. It is also unclear how these influences combine, when acting in concert or opposition. We had people make decisions about the sizes of inputs, and report on levels of decisional confidence. Tests were either selectively subject to size adaptation, to an extrapolation effect, or to both of these effects. When these two effects were placed in opposition, extrapolation had a greater impact on decision making. However, our data suggest the influence of extrapolation is primarily decisional, whereas size adaptation more fully manifests in changes to conscious visual awareness.

The reduction of saccadic inhibition by distractor repetition

When visual distractors are presented far from the goal of an impending voluntary saccadic eye movement, saccade execution will occur less frequently about 90 ms after distractor appearance, a phenomenon known as saccadic inhibition. However, it is also known that neural responses in visual and visuomotor areas of the brain will be attenuated if a visual stimulus appears several times in the same location in rapid succession. In particular, such visual adaptation can affect neurons in the mammalian superior colliculus (SC). As the SC is known to be intimately involved in the production of saccadic eye movements, and thus perhaps in saccadic inhibition, we used a memory-guided saccade task to test whether saccadic inhibition in humans would diminish if a distractor appeared several times in quick succession. We found that distractor repetition reduced saccadic inhibition considerably when distractors appeared opposite in space to the goal of the impending saccade. In addition, when three distractors appeared in quick succession but in different, spatially disparate locations, with only the final distractor appearing opposite the saccade goal, saccadic inhibition was reduced by an intermediate level, suggesting that its reduction due to distractor inhibition spatially generalizes. This suggests that distractor suppression can help reduce the impact that suddenly appearing visual stimuli have on purposive eye movement behavior.NEW & NOTEWORTHY This work combines approaches studying saccadic inhibition and visual adaptation to demonstrate that saccadic inhibition is largely eliminated with stimulus repetition. This is likely to be the largest demonstrated effect of visual stimulus context on saccadic inhibition. It also provides evidence for the existence of a mechanism that acts to suppress the effect of frequently appearing visual stimuli on purposive eye movement behavior in dynamic visual environments.

Frequency of adapting events affects face aftereffects but not blur aftereffects

The dynamics of visual adaptation remain poorly understood. Recent studies have found that the strength of adaptation aftereffects in the perception of numerosity depends more strongly on the number of adaptation events than on the duration of the adaptation. We investigated whether such effects can be observed for other visual attributes. We measured blur (perceived focus-sharp vs blurred adapt) and face (perceived race- Asian vs. White adapt) aftereffects by varying the number of adaptation events (4 or 16) and the duration of each adaptation event (0.25 s or 1 s). We found evidence for an effect of event number on face but not on blur adaptation, though the effect for faces was significant for only one of the two face adapt conditions (Asian). Our results suggest that different perceptual dimensions may vary in how adaptation effects accrue, potentially because of differences in factors such as the sites (early or late) of the sensitivity changes or nature of the stimulus. These differences may impact how and how rapidly the visual system can adjust to different visual properties.

Repeated passive visual experience modulates spontaneous and non-familiar stimulievoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

Mirror exposure following visual body-size adaptation does not affect own body image

Prolonged visual exposure to large bodies produces a thinning aftereffect on subsequently seen bodies, and vice versa. This visual adaptation effect could contribute to the link between media exposure and body shape misperception. Indeed, people exposed to thin bodies in the media, who experience fattening aftereffects, may internalize the distorted image of their body they see in the mirror. This preregistered study tested this internalization hypothesis by exposing 196 young women to an obese adaptor before showing them their reflection in the mirror, or to a control condition. Then, we used a psychophysical task to measure the effects of this procedure on perceptual judgements about their own body size, relative to another body and to the control mirror exposure condition. We found moderate evidence against the hypothesized self-specific effects of mirror exposure on perceptual judgements. Our work strengthens the idea that body size adaptation affects the perception of test stimuli rather than the participants' own body image. We discuss recent studies which may provide an alternative framework to study media-related distortions of perceptual body image.

On why we lack confidence in some signal-detection-based analyses of confidence

Signal-detection theory (SDT) is one of the most popular frameworks for analyzing data from studies of human behavior - including investigations of confidence. SDT-based analyses of confidence deliver both standard estimates of sensitivity (d'), and a second estimate informed by high-confidence decisions - meta d'. The extent to which meta d' estimates fall short of d' estimates is regarded as a measure of metacognitive inefficiency, quantifying the contamination of confidence by additional noise. These analyses rely on a key but questionable assumption - that repeated exposures to an input will evoke a normally-shaped distribution of perceptual experiences (the normality assumption). Here we show, via analyses inspired by an experiment and modelling, that when distributions of experience do not conform with the normality assumption, meta d' can be systematically underestimated relative to d'. Our data highlight that SDT-based analyses of confidence do not provide a ground truth measure of human metacognitive inefficiency. We explain why deviance from the normality assumption is especially a problem for some popular SDT-based analyses of confidence, in contrast to other analyses inspired by the SDT framework, which are more robust to violations of the normality assumption.

Self-powered and broadband opto-sensor with bionic visual adaptation function based on multilayer γ-InSe flakes

Visual adaptation that can autonomously adjust the response to light stimuli is a basic function of artificial visual systems for intelligent bionic robots. To improve efficiency and reduce complexity, artificial visual systems with integrated visual adaptation functions based on a single device should be developed to replace traditional approaches that require complex circuitry and algorithms. Here, we have developed a single two-terminal opto-sensor based on multilayer γ-InSe flakes, which successfully emulated the visual adaptation behaviors with a new working mechanism combining the photo-pyroelectric and photo-thermoelectric effect. The device can operate in self-powered mode and exhibit good human-eye-like adaptation behaviors, which include broadband light-sensing image adaptation (from ultraviolet to near-infrared), near-complete photosensitivity recovery (99.6%), and synergetic visual adaptation, encouraging the advancement of intelligent opto-sensors and machine vision systems.

Modulation of cortical activity by spherical blur and its correlation with retinal defocus

Cortical activity, as recorded via electroencephalography, has been linked to the refractive error of an individual. It is however unclear which optical metric modulates this response. Here, we measured simultaneously the brain activity and the retinal defocus of a visual stimulus perceived through several values of spherical blur. We found that, contrary to the existing literature on the topic, the cortical response as a function of the overcorrections follows a sigmoidal shape rather than the classical bell shape, with the inflection point corresponding to the subjective refraction and to the stimulus being in focus on the retina. However, surprisingly, the amplitude of the cortical response does not seem to be a good indicator of how much the stimulus is in or out of focus on the retina. Nonetheless, the defocus is not equivalent to the retinal image quality, nor is an absolute predictor of the visual performance of an individual. Simulations of the retinal image quality seem to be a powerful tool to predict the modulation of the cortical response with the refractive error.

Unobtrusive Refractive Power Monitoring: Using EOG to Detect Blurred Vision

The rise in population and aging has led to a significant increase in the number of individuals affected by common causes of vision loss. Early diagnosis and treatment are crucial to avoid the consequences of visual impairment. However, in early stages, many visual problems are making it difficult to detect. Visual adaptation can compensate for several visual deficits with adaptive eye movements. These adaptive eye movements may serve as indicators of vision loss. In this work, we investigate the association between eye movement and blurred vision. By using Electrooculography (EOG) to record eye movements, we propose a new tracking model to identify the deterioration of refractive power. We verify the technical feasibility of this method by designing a blurred vision simulation experiment. Six sets of prescription lenses and a pair of flat lenses were used to create different levels of blurring effects. We analyzed binocular movements through EOG signals and performed a seven-class classification using the ResNet18 architecture. The results revealed an average classification accuracy of 94.7% in the subject-dependent model. However, the subject-independent model presented poor performance, with the highest accuracy reaching only 34.5%. Therefore, the potential of an EOG-based visual quality monitoring system is proven. Furthermore, our experimental design provides a novel approach to assessing blurred vision.

Adaptation in auditory processing

Adaptation is an essential feature of auditory neurons, which reduces their responses to unchanging and recurring sounds and allows their response properties to be matched to the constantly changing statistics of sounds that reach the ears. As a consequence, processing in the auditory system highlights novel or unpredictable sounds and produces an efficient representation of the vast range of sounds that animals can perceive by continually adjusting the sensitivity and, to a lesser extent, the tuning properties of neurons to the most commonly encountered stimulus values. Together with attentional modulation, adaptation to sound statistics also helps to generate neural representations of sound that are tolerant to background noise and therefore plays a vital role in auditory scene analysis. In this review, we consider the diverse forms of adaptation that are found in the auditory system in terms of the processing levels at which they arise, the underlying neural mechanisms, and their impact on neural coding and perception. We also ask what the dynamics of adaptation, which can occur over multiple timescales, reveal about the statistical properties of the environment. Finally, we examine how adaptation to sound statistics is influenced by learning and experience and changes as a result of aging and hearing loss.

Neural correlates of visual acuity for fine text

Human sensitivity to visual input often scales with the magnitude of evoked responses in the brain. Here, we demonstrate an exception. We record electroencephalography (EEG) while people attempt to resolve fine print - similar to people attempting to read eye charts (the world's most popular means of testing vision). We find that the ability to resolve fine print is associated with smaller evoked responses recorded by large clusters of occipital-parietal sensors ∼150 ms after people see words. Moreover, we find that a better ability to resolve fine print is associated with enhanced alpha-band oscillatory brain activity immediately prior to word presentations. These investigations were inspired by psychophysical data, which suggested the ability to resolve fine print can be enhanced by pre-adaptation to flicker, which should encourage a reduced neural response to inputs. We included this manipulation in this study, and our results are broadly consistent with this conjecture. As alpha-band activity has been linked to inhibitory interactions in visual cortex, we regard our data as evidence that smaller neural responses to fine print can be promoted by inhibitory processes that target unhelpful blur-related signals, which thereby sharpen subsequent visual experiences.

Gaining the system: limits to compensating color deficiencies through post-receptoral gain changes

Color percepts of anomalous trichromats are often more similar to normal trichromats than predicted from their receptor spectral sensitivities, suggesting that post-receptoral mechanisms can compensate for chromatic losses. The basis for these adjustments and the extent to which they could discount the deficiency are poorly understood. We modeled the patterns of compensation that might result from increasing the gains in post-receptoral neurons to offset their weakened inputs. Individual neurons and the population responses jointly encode luminance and chromatic signals. As a result, they cannot independently adjust for a change in the chromatic inputs, predicting only partial recovery of the chromatic responses and increased responses to achromatic contrast. These analyses constrain the potential sites and mechanisms of compensation for a color loss and characterize the utility and limits of neural gain changes for calibrating color vision.

Modeling facial perception in group context from a serial perception perspective

By utilizing statistical properties and summary statistics, the visual system can efficiently integrate perception of spatially and temporally adjacent stimuli into perception of a given target. For instance, perception of a target face can either be biased positively toward previous faces (e.g. the serial dependence effect) or be biased negatively by surrounding faces in the same trial/space (e.g. spatial ensemble averaging). However, both aspects were investigated separately. As spatial and temporal processing share the same purpose to reduce redundancy in visual processing, if one statistical processing occurs, would the statistical processing in the other domain still exist or be discarded? We investigated this question by exploring whether serial dependence of face perception (of attractiveness and averageness) survives when the changed face perception in the group context occurs. The results of Markov Chain modeling and conventional methods suggested that serial dependence (the temporal aspect) co-occurs with changed face perception in the group context (the spatial aspect). We also utilized the Hidden Markov modeling, as a new mathematical method, to model statistical processing from both domains. The results confirmed the co-occurrence of temporal effect and changed face perception in the group context for both attractiveness and averageness, suggesting potentially different spatial and temporal compression mechanisms in high-level vision. Further modeling and cluster analysis further revealed that the detailed computation of spatially and temporally adjacent faces in the attractiveness and averageness processing were similar yet different among different individuals. This work builds a bridge to understanding mathematical principles underlying changed face perception in the group context from the serial perspective.

Temporal stability of human heading perception

Humans are capable of accurately judging their heading from optic flow during straight forward self-motion. Despite the global coherence in the optic flow field, however, visual clutter and other naturalistic conditions create constant flux on the eye. This presents a problem that must be overcome to accurately perceive heading from optic flow-the visual system must maintain sensitivity to optic flow variations that correspond with actual changes in self-motion and disregard those that do not. One solution could involve integrating optic flow over time to stabilize heading signals while suppressing transient fluctuations. Stability, however, may come at the cost of sluggishness. Here, we investigate the stability of human heading perception when subjects judge their heading after the simulated direction of self-motion changes. We found that the initial heading exerted an attractive influence on judgments of the final heading. Consistent with an evolving heading representation, bias toward the initial heading increased with the size of the heading change and as the viewing duration of the optic flow consistent with the final heading decreased. Introducing periods of sensory dropout (blackouts) later in the trial increased bias whereas an earlier one did not. Simulations of a neural model, the Competitive Dynamics Model, demonstrates that a mechanism that produces an evolving heading signal through recurrent competitive interactions largely captures the human data. Our findings characterize how the visual system balances stability in heading perception with sensitivity to change and support the hypothesis that heading perception evolves over time.

Visual adaptation to medical images: a comparison of digital mammography and tomosynthesis

Purpose

Radiologists and other image readers spend prolonged periods inspecting medical images. The visual system can rapidly adapt or adjust sensitivity to the images that an observer is currently viewing, and previous studies have demonstrated that this can lead to pronounced changes in the perception of mammogram images. We compared these adaptation effects for images from different imaging modalities to explore both general and modality-specific consequences of adaptation in medical image perception.

Approach

We measured perceptual changes induced by adaptation to images acquired by digital mammography (DM) or digital breast tomosynthesis (DBT), which have both similar and distinct textural properties. Participants (nonradiologists) adapted to images from the same patient acquired from each modality or for different patients with American College of Radiology-Breast Imaging Reporting and Data System (BI-RADS) classification of dense or fatty tissue. The participants then judged the appearance of composite images formed by blending the two adapting images (i.e., DM versus DBT or dense versus fatty in each modality).

Results

Adaptation to either modality produced similar significant shifts in the perception of dense and fatty textures, reducing the salience of the adapted component in the test images. In side-by-side judgments, a modality-specific adaptation effect was not observed. However, when the images were directly fixated during adaptation and testing, so that the textural differences between the modalities were more visible, significantly different changes in the sensitivity to the noise in the images were observed.

Conclusions

These results confirm that observers can readily adapt to the visual properties or spatial textures of medical images in ways that can bias their perception of the images, and that adaptation can also be selective for the distinctive visual features of images acquired by different modalities.

Visual adaptation reveals multichannel coding for numerosity

Visual numerosity is represented automatically and rapidly, but much remains unknown about the computations underlying this perceptual experience. For example, it is unclear whether numerosity is represented with an opponent channel or multichannel coding system. Within an opponent channel system, all numerical values are represented via the relative activity of two pools of neurons (i.e., one pool with a preference for small numerical values and one pool with a preference for large numerical values). However, within a multichannel coding system, all numerical values are represented directly, with separate pools of neurons for each (discriminable) numerical value. Using an adaptation paradigm, we assessed whether the visual perception of number is better characterized by an opponent channel or multichannel system. Critically, these systems make distinct predictions regarding the pattern of aftereffects exhibited when an observer is adapted to an intermediate numerical value. Opponent channel coding predicts no aftereffects because both pools of neurons adapt equally. By contrast, multichannel coding predicts repulsive aftereffects, wherein numerical values smaller than the adapter are underestimated and those larger than the adapter are overestimated. Consistent with multichannel coding, visual adaptation to an intermediate value (50 dots) yielded repulsive aftereffects, such that participants underestimated stimuli ranging from 10-50 dots, but overestimated stimuli ranging from 50-250 dots. These findings provide novel evidence that the visual perception of number is supported by a multichannel, not opponent channel, coding system, and raise important questions regarding the contributions of different cortical regions, such as the ventral and lateral intraparietal areas, to the representation of number.

After-image formation by adaptation to dynamic color gradients

The eye's retinotopic exposure to an adapter typically produces an after-image. For example, an observer who fixates a red adapter on a gray background will see an illusory cyan after-image after removing the adapter. The after-image's content, like its color or intensity, gives insight into mechanisms responsible for adaptation and processing of a specific feature. To facilitate adaptation, vision scientists traditionally present stable, unchanging adapters for prolonged durations. How adaptation affects perception when features (e.g., color) dynamically change over time is not understood. To investigate adaptation to a dynamically changing feature, participants viewed a colored patch that changed from a color to gray, following either a direct or curved path through the (roughly) equiluminant color plane of CIE LAB space. We varied the speed and curvature of color changes across trials and experiments. Results showed that dynamic adapters produce after-images, vivid enough to be reported by the majority of participants. An after-image consisted of a color complementary to the average of the adapter's colors with a small bias towards more recent rather than initial adapter colors. The modelling of the reported after-image colors further confirmed that adaptation rapidly instigates and gradually dissipates. A second experiment replicated these results and further showed that the probability of observing an after-image diminishes only slightly when the adapter displays transient (stepwise, abrupt) color transitions. We conclude from the results that the visual system can adapt to dynamic colors, to a degree that is robust to the potential interference of transient changes in adapter content.

Efficient processing of natural scenes in visual cortex

Neural circuits in the periphery of the visual, auditory, and olfactory systems are believed to use limited resources efficiently to represent sensory information by adapting to the statistical structure of the natural environment. This "efficient coding" principle has been used to explain many aspects of early visual circuits including the distribution of photoreceptors, the mosaic geometry and center-surround structure of retinal receptive fields, the excess OFF pathways relative to ON pathways, saccade statistics, and the structure of simple cell receptive fields in V1. We know less about the extent to which such adaptations may occur in deeper areas of cortex beyond V1. We thus review recent developments showing that the perception of visual textures, which depends on processing in V2 and beyond in mammals, is adapted in rats and humans to the multi-point statistics of luminance in natural scenes. These results suggest that central circuits in the visual brain are adapted for seeing key aspects of natural scenes. We conclude by discussing how adaptation to natural temporal statistics may aid in learning and representing visual objects, and propose two challenges for the future: (1) explaining the distribution of shape sensitivity in the ventral visual stream from the statistics of object shape in natural images, and (2) explaining cell types of the vertebrate retina in terms of feature detectors that are adapted to the spatio-temporal structures of natural stimuli. We also discuss how new methods based on machine learning may complement the normative, principles-based approach to theoretical neuroscience.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Attractive and repulsive effects of sensory history concurrently shape visual perception

BACKGROUND

Sequential effects of environmental stimuli are ubiquitous in most behavioral tasks involving magnitude estimation, memory, decision making, and emotion. The human visual system exploits continuity in the visual environment, which induces two contrasting perceptual phenomena shaping visual perception. Previous work reported that perceptual estimation of a stimulus may be influenced either by attractive serial dependencies or repulsive aftereffects, with a number of experimental variables suggested as factors determining the direction and magnitude of sequential effects. Recent studies have theorized that these two effects concurrently arise in perceptual processing, but empirical evidence that directly supports this hypothesis is lacking, and it remains unclear whether and how attractive and repulsive sequential effects interact in a trial. Here we show that the two effects concurrently modulate estimation behavior in a typical sequence of perceptual tasks.

RESULTS

We first demonstrate that observers' estimation error as a function of both the previous stimulus and response cannot be fully described by either attractive or repulsive bias but is instead well captured by a summation of repulsion from the previous stimulus and attraction toward the previous response. We then reveal that the repulsive bias is centered on the observer's sensory encoding of the previous stimulus, which is again repelled away from its own preceding trial, whereas the attractive bias is centered precisely on the previous response, which is the observer's best prediction about the incoming stimuli.

CONCLUSIONS

Our findings provide strong evidence that sensory encoding is shaped by dynamic tuning of the system to the past stimuli, inducing repulsive aftereffects, and followed by inference incorporating the prediction from the past estimation, leading to attractive serial dependence.

Nonequilibrium dynamics of adaptation in sensory systems

Adaptation is used by biological sensory systems to respond to a wide range of environmental signals, by adapting their response properties to the statistics of the stimulus in order to maximize information transmission. We derive rules of optimal adaptation to changes in the mean and variance of a continuous stimulus in terms of Bayesian filters and map them onto stochastic equations that couple the state of the environment to an internal variable controlling the response function. We calculate numerical and exact results for the speed and accuracy of adaptation and its impact on information transmission. We find that, in the regime of efficient adaptation, the speed of adaptation scales sublinearly with the rate of change of the environment. Finally, we exploit the mathematical equivalence between adaptation and stochastic thermodynamics to quantitatively relate adaptation to the irreversibility of the adaptation time course, defined by the rate of entropy production. Our results suggest a means to empirically quantify adaptation in a model-free and nonparametric way.