Adaptation and visual coding

Viewpoint adaptation revealed potential representational differences between 2D images and 3D objects

For convenience and experimental control, cognitive science has relied largely on images as stimuli rather than the real, tangible objects encountered in the real world. Recent evidence suggests that the cognitive processing of images may differ from real objects, especially in the processing of spatial locations and actions, thought to be mediated by the dorsal visual stream. Perceptual and semantic processing in the ventral visual stream, however, has been assumed to be largely unaffected by the realism of objects. Several studies have found that one key difference accounting for differences between real objects and images is actability; however, less research has investigated another potential difference - the three-dimensional nature of real objects as conveyed by cues like binocular disparity. To investigate the extent to which perception is affected by the realism of a stimulus, we compared viewpoint adaptation when stimuli (a face or a kettle) were 2D (flat images without binocular disparity) vs. 3D (i.e., real, tangible objects or stereoscopic images with binocular disparity). For both faces and kettles, adaptation to 3D stimuli induced stronger viewpoint aftereffects than adaptation to 2D images when the adapting orientation was rightward. A computational model suggested that the difference in aftereffects could be explained by broader viewpoint tuning for 3D compared to 2D stimuli. Overall, our finding narrowed the gap between understanding the neural processing of visual images and real-world objects by suggesting that compared to 2D images, real and simulated 3D objects evoke more broadly tuned neural representations, which may result in stronger viewpoint invariance.

Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation

Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as "looking similar"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; P = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], P = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], P = .78), and a reduced reading time (24.3 vs 27.9 seconds, P < .001), fixation count (47 vs 52, P < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, P < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; P = .70), specificity (84% [820 of 975], P = .37), sensitivity (80% [784 of 975], P = .79), fixation count (54, P = .05), or fixation time in malignant regions (4.6 seconds, P > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, P = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Grimm in this issue.

Inattentional aftereffects: The role of attention on the strength of the motion aftereffect

The way that attention affects the processing of visual information is one of the most intriguing fields in the study of visual perception. One way to examine this interaction is by studying the way perceptual aftereffects are modulated by attention. In the present study, we have manipulated attention during adaptation to translational motion generated by coherently moving random dots, in order to investigate the effect of the distraction of attention on the strength of the peripheral dynamic motion aftereffect (MAE). A foveal rapid serial visual presentation task (RSVP) of varying difficulty was introduced during the adaptation period while the adaptation and test stimuli were presented peripherally. Furthermore, to examine the interaction between the physical characteristics of the stimulus and attention, we have manipulated the motion coherence level of the adaptation stimuli. Our results suggested that the removal of attention through an irrelevant task modulated the MAE's magnitude moderately and that such an effect depends on the stimulus strength. We also showed that the MAE still persists with subthreshold and unattended stimuli, suggesting that perhaps attention is not required for the complete development of the MAE.

Super recognizers: Increased sensitivity or reduced biases? Insights from serial dependence

Super recognizers (SRs) are people that exhibit a naturally occurring superiority for processing facial identity. Despite the increase of SR research, the mechanisms underlying their exceptional abilities remain unclear. Here, we investigated whether the enhanced facial identity processing of SRs could be attributed to the lack of sequential effects, such as serial dependence. In serial dependence, perception of stimulus features is assimilated toward stimuli presented in previous trials. This constant error in visual perception has been proposed as a mechanism that promotes perceptual stability in everyday life. We hypothesized that an absence of this constant source of error in SRs could account for their superior processing-potentially in a domain-general fashion. We tested SRs (n = 17) identified via a recently proposed diagnostic framework (Ramon, 2021) and age-matched controls (n = 20) with two experiments probing serial dependence in the face and shape domains. In each experiment, observers were presented with randomly morphed face identities or shapes and were asked to adjust a face's identity or a shape to match the stimulus they saw. We found serial dependence in controls and SRs alike, with no difference in its magnitude across groups. Interestingly, we found that serial dependence impacted the performance of SRs more than that of controls. Taken together, our results show that enhanced face identity processing skills in SRs cannot be attributed to the lack of serial dependence. Rather, serial dependence, a beneficial nested error in our visual system, may in fact further stabilize the perception of SRs and thus enhance their visual processing proficiency.

Implicit weight bias: shared neural substrates for overweight and angry facial expressions revealed by cross-adaptation

The perception of facial expression plays a crucial role in social communication, and it is known to be influenced by various facial cues. Previous studies have reported both positive and negative biases toward overweight individuals. It is unclear whether facial cues, such as facial weight, bias facial expression perception. Combining psychophysics and event-related potential technology, the current study adopted a cross-adaptation paradigm to examine this issue. The psychophysical results of Experiments 1A and 1B revealed a bidirectional cross-adaptation effect between overweight and angry faces. Adapting to overweight faces decreased the likelihood of perceiving ambiguous emotional expressions as angry compared to adapting to normal-weight faces. Likewise, exposure to angry faces subsequently caused normal-weight faces to appear thinner. These findings were corroborated by bidirectional event-related potential results, showing that adaptation to overweight faces relative to normal-weight faces modulated the event-related potential responses of emotionally ambiguous facial expression (Experiment 2A); vice versa, adaptation to angry faces relative to neutral faces modulated the event-related potential responses of ambiguous faces in facial weight (Experiment 2B). Our study provides direct evidence associating overweight faces with facial expression, suggesting at least partly common neural substrates for the perception of overweight and angry faces.

Did you skip leg day? The neural mechanisms of muscle perception for body parts

While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.

Cortical quantity representations of visual numerosity and timing overlap increasingly into superior cortices but remain distinct

Many sensory brain areas are organized as topographic maps where neural response preferences change gradually across the cortical surface. Within association cortices, 7-Tesla fMRI and neural model-based analyses have also revealed many topographic maps for quantities like numerosity and event timing, often in similar locations. Numerical and temporal quantity estimations also show behavioral similarities and even interactions. For example, the duration of high-numerosity displays is perceived as longer than that of low-numerosity displays. Such interactions are often ascribed to a generalized magnitude system with shared neural responses across quantities. Anterior quantity responses are more closely linked to behavior. Here, we investigate whether common quantity representations hierarchically emerge by asking whether numerosity and timing maps become increasingly closely related in their overlap, response preferences, and topography. While the earliest quantity maps do not overlap, more superior maps overlap increasingly. In these overlapping areas, some intraparietal maps have consistently correlated numerosity and timing preferences, and some maps have consistent angles between the topographic progressions of numerosity and timing preferences. However, neither of these relationships increases hierarchically like the amount of overlap does. Therefore, responses to different quantities are initially derived separately, then progressively brought together, without generally becoming a common representation. Bringing together distinct responses to different quantities may underlie behavioral interactions and allow shared access to comparison and action planning systems.

A power law describes the magnitude of adaptation in neural populations of primary visual cortex

How do neural populations adapt to the time-varying statistics of sensory input? We used two-photon imaging to measure the activity of neurons in mouse primary visual cortex adapted to different sensory environments, each defined by a distinct probability distribution over a stimulus set. We find that two properties of adaptation capture how the population response to a given stimulus, viewed as a vector, changes across environments. First, the ratio between the response magnitudes is a power law of the ratio between the stimulus probabilities. Second, the response direction to a stimulus is largely invariant. These rules could be used to predict how cortical populations adapt to novel, sensory environments. Finally, we show how the power law enables the cortex to preferentially signal unexpected stimuli and to adjust the metabolic cost of its sensory representation to the entropy of the environment.

Visual Representations: Insights from Neural Decoding

Patterns of brain activity contain meaningful information about the perceived world. Recent decades have welcomed a new era in neural analyses, with computational techniques from machine learning applied to neural data to decode information represented in the brain. In this article, we review how decoding approaches have advanced our understanding of visual representations and discuss efforts to characterize both the complexity and the behavioral relevance of these representations. We outline the current consensus regarding the spatiotemporal structure of visual representations and review recent findings that suggest that visual representations are at once robust to perturbations, yet sensitive to different mental states. Beyond representations of the physical world, recent decoding work has shone a light on how the brain instantiates internally generated states, for example, during imagery and prediction. Going forward, decoding has remarkable potential to assess the functional relevance of visual representations for human behavior, reveal how representations change across development and during aging, and uncover their presentation in various mental disorders.

Art Value Creation and Destruction

I present a theory of creative and destructive value state referring to abstract art. Value is a probabilistic state held as a mixture of its expectation and information forces that coexist in a give-and-take relationship. Expectations are driven by the disclosure of novel information about the value state of various events of desire. Each bit of accumulated information contributes to the improvement of perception up to a threshold level, beyond which begin conscious states. The desire to disclose a value state triggers a triadic system of evaluation which uses concepts, observables and approaches. While the triadic valuation mechanisms can be used to assess various commodities, the scope of this work is limited to the case of artworks, in particular abstract paintings. I assume that art value is basically mediated by the interplay between these value state mechanisms of creation and destruction. Expectations in artwork develop attraction by challenging its contemplator to evaluate (predict) its meaning. Once the relevant information, corresponding to its creative expectations, is acquired (and conditioned), emotional states of indifference, disinterest and desensitization develop.

Brief Adaptation to Astigmatism Reduces Meridional Anisotropy in Contrast Sensitivity

Purpose

To investigate the effect of visual adaptation to orientation-dependent optical blur on meridional contrast sensitivity function in artificially imposed astigmatism.

Methods

The study adopted a top-up adapt-test paradigm. During the blur adaptation process, the 18 non-astigmatic young adult participants were briefly presented with natural scene images (first trial, 10 minutes; subsequent trials, 6 seconds). Contrast sensitivities for horizontal and vertical gratings at spatial frequencies ranging from 1 to 8 cycles per degree (cpd) were measured immediately before and after adaptation to +3.00 diopters cylinder (DC) with-the-rule or against-the-rule astigmatism. Meridional anisotropy was measured to quantify the contrast sensitivity difference between the two grating orientations.

Results

Adapting to astigmatic blur enhanced contrast sensitivity at the blurred power meridian but reduced contrast sensitivity at the least affected axis meridian. In with-the-rule conditions, contrast sensitivity for horizontal gratings was significantly increased, whereas that for vertical gratings was significantly decreased. Similarly, in against-the-rule conditions, contrast sensitivity for vertical gratings was significantly increased, whereas that for horizontal gratings was significantly decreased. These two factors together resulted in a substantial systematic reduction, averaging 34%, in meridional anisotropy of contrast sensitivity across the spatial frequency spectrum.

Conclusions

Astigmatism adaptation occurs in natural scene viewing. Brief exposure to astigmatic blur altered contrast sensitivity in the opposite direction at the two principal meridians, indicating that the mature visual system possesses functional plasticity to recalibrate the response characteristics of orientationally tuned cortical filters and thus promote substantial reductions of meridional anisotropy in astigmatic vision, to some extent counterbalancing the elongated oval shape of astigmatic blur.

Visual adaptation changes the susceptibility to the fission illusion

Sound-induced flash illusion (SiFI) is the illusion that participants perceive incorrectly that the number of visual flashes is equal to the number of auditory beeps when presented within 100 ms. Although previous studies found that repetition suppression can reduce an individual's perceptual sensitivity to the SiFI, there is not yet a consensus as to how visual adaptation affects the SiFI. In the present study, we added prolonged adapting visual stimuli prior to the presentation of audiovisual stimuli to investigate whether the bottom-up factor of adaptation affects the SiFI. The adapting visual stimuli consisted of one or two of the same visual stimuli that lasted for 2 minutes in succession, followed by the audiovisual stimuli. Both adaptation conditions showed SiFI effects. The accuracy of adapting double-flashes was significantly lower than that of in adapting a single flash for the fission illusion. Our analyses indicated that such a pattern could be attributed to a lower d' in adapting double-flashes than in adapting a single flash. However, the accuracy, discriminability and criterion were not significantly different between the two adaptation conditions because of the instability of the fusion illusion. Thus, the present study indicated that the reduced perceptual sensitivity based on visual adaptation could enhance the fission illusion in multisensory integration.

A power law of cortical adaptation

How do neural populations adapt to the time-varying statistics of sensory input? To investigate, we measured the activity of neurons in primary visual cortex adapted to different environments, each associated with a distinct probability distribution over a stimulus set. Within each environment, a stimulus sequence was generated by independently sampling form its distribution. We find that two properties of adaptation capture how the population responses to a given stimulus, viewed as vectors, are linked across environments. First, the ratio between the response magnitudes is a power law of the ratio between the stimulus probabilities. Second, the response directions are largely invariant. These rules can be used to predict how cortical populations adapt to novel, sensory environments. Finally, we show how the power law enables the cortex to preferentially signal unexpected stimuli and to adjust the metabolic cost of its sensory representation to the entropy of the environment.

A category contingent aftereffect for faces labelled with different religious affiliation is seen 7 days after adaptation

Visual adaptation occurs after a prolonged exposure to a stimulus. The duration of aftereffects differs across stimuli type, and face aftereffects may be especially long lasting. The current study investigates adaptation decay of category contingent opposing aftereffects. Specifically, we tested whether naïve undergraduate participants' adaptation to photos of faces with explicit religious labels, differed from that of participants who had adapted to the same faces 7 days previously. We also tested whether 7-day old category-contingent opposing aftereffects interfere with the ability to re-adapt to a new condition. In Session 1, undergraduates made attractiveness preference selections before and after adapting to two groups of distorted faces. Participants then returned 7 days later to re-assess the attractiveness of the same faces. Participants were then adapted to the two groups of faces distorted in the opposite direction. Adaptation strength was stronger in Session 1 than in Session 2, although adaptation strength was not related to pre-adaptation selections. Week-old aftereffects interfered with the creation of aftereffects in the opposite direction 7 days later.

Perceptual bias contextualized in visually ambiguous stimuli

The visual appearance of an object is a function of stimulus properties as well as perceptual biases imposed by the observer. The context-specific trade-off between both can be measured accurately in a perceptual judgment task, involving grouping by proximity in ambiguous dot lattices. Such grouping depends lawfully on a stimulus parameter of the dot lattices known as their aspect ratio (AR), whose effect is modulated by a perceptual bias representing the preference for a cardinal orientation. In two experiments, we investigated how preceding context can lead to bias modulation, either in a top-down fashion via visual working memory (VWM) or bottom-up via sensory priming. In Experiment 1, we embedded the perceptual judgment task in a change detection paradigm and studied how the factors of VWM load (complexity of the memory array) and content (congruency in orientation to the ensuing dot lattice) affect the prominence of perceptual bias. A robust vertical orientation bias was observed, which was increased by VWM load and modulated by congruent VWM content. In Experiment 2, dot lattices were preceded by oriented primes. Here, primes regardless of orientation elicited a vertical orientation bias in dot lattices compared to a neutral baseline. Taken together, the two experiments demonstrate that top-down context (VWM load and content) effectively controls orientation bias modulation, while bottom-up context (i.e., priming) merely acts as an undifferentiated trigger to perceptual bias. These findings characterize the temporal context sensitivity of Gestalt perception, shed light on the processes responsible for different perceptual outcomes of ambiguous stimuli, and identify some of the mechanisms controlling perceptual bias.

Opposing aftereffects between a White male face set and a diverse face set

Opposing aftereffects have been observed for faces categorized by gender, race, and age. In order to form opposing aftereffects, it appears that the two face sets must be both physically distinct and differ in terms of social meaning. The current study tests whether (1) a face set that is diverse with respect to sex and race can produce a coherent aftereffect and (2) whether this diversity itself is socially meaningful enough to support opposing aftereffects. Participants adapted to a homogenous face set consisting of only White male Republican congressmen and a diverse face set consisting of White, Asian, Black, and Latino male and female Democratic congress members. Opposing aftereffects were observed: participants adapted simultaneously and in opposite directions to the face sets. These results are the first evidence of adaptation to a face set that varies based on race and sex, and the first evidence of diversity being perceived as a socially meaningful category marker.

Visual adaptation reveals multichannel coding for numerosity

Visual numerosity is represented automatically and rapidly, but much remains unknown about the computations underlying this perceptual experience. For example, it is unclear whether numerosity is represented with an opponent channel or multichannel coding system. Within an opponent channel system, all numerical values are represented via the relative activity of two pools of neurons (i.e., one pool with a preference for small numerical values and one pool with a preference for large numerical values). However, within a multichannel coding system, all numerical values are represented directly, with separate pools of neurons for each (discriminable) numerical value. Using an adaptation paradigm, we assessed whether the visual perception of number is better characterized by an opponent channel or multichannel system. Critically, these systems make distinct predictions regarding the pattern of aftereffects exhibited when an observer is adapted to an intermediate numerical value. Opponent channel coding predicts no aftereffects because both pools of neurons adapt equally. By contrast, multichannel coding predicts repulsive aftereffects, wherein numerical values smaller than the adapter are underestimated and those larger than the adapter are overestimated. Consistent with multichannel coding, visual adaptation to an intermediate value (50 dots) yielded repulsive aftereffects, such that participants underestimated stimuli ranging from 10-50 dots, but overestimated stimuli ranging from 50-250 dots. These findings provide novel evidence that the visual perception of number is supported by a multichannel, not opponent channel, coding system, and raise important questions regarding the contributions of different cortical regions, such as the ventral and lateral intraparietal areas, to the representation of number.

Neural dissociation of the acoustic and cognitive representation of voice identity

Recognising a speaker's identity by the sound of their voice is important for successful interaction. The skill depends on our ability to discriminate minute variations in the acoustics of the vocal signal. Performance on voice identity assessments varies widely across the population. The neural underpinnings of this ability and its individual differences, however, remain poorly understood. Here we provide critical tests of a theoretical framework for the neural processing stages of voice identity and address how individual differences in identity discrimination mediate activation in this neural network. We scanned 40 individuals on an fMRI adaptation task involving voices drawn from morphed continua between two personally familiar identities. Analyses dissociated neuronal effects induced by repetition of acoustically similar morphs from those induced by a switch in perceived identity. Activation in temporal voice-sensitive areas decreased with acoustic similarity between consecutive stimuli. This repetition suppression effect was mediated by the performance on an independent voice assessment and this result highlights an important functional role of adaptive coding in voice expertise. Bilateral anterior insulae and medial frontal gyri responded to a switch in perceived voice identity compared to an acoustically equidistant switch within identity. Our results support a multistep model of voice identity perception.

Magnetoencephalography contrast adaptation reflects perceptual adaptation

Contrast adaptation is a fundamental visual process that has been extensively investigated and used to infer the selectivity of visual cortex. We recently reported an apparent disconnect between the effects of contrast adaptation on perception and functional magnetic resonance imaging BOLD response adaptation, in which adaptation between chromatic and achromatic stimuli measured psychophysically showed greater selectivity than adaptation measured using BOLD signals. Here we used magnetoencephalography (MEG) recordings of neural responses to the same chromatic and achromatic adaptation conditions to characterize the neural effects of contrast adaptation and to determine whether BOLD adaptation or MEG better reflect the measured perceptual effects. Participants viewed achromatic, L-M isolating, or S-cone isolating radial sinusoids before adaptation and after adaptation to each of the three contrast directions. We measured adaptation-related changes in the neural response to a range of stimulus contrast amplitudes using two measures of the MEG response: the overall response amplitude, and a novel time-resolved measure of the contrast response function, derived from a classification analysis combined with multidimensional scaling. Within-stimulus adaptation effects on the contrast response functions in each case showed a pattern of contrast-gain or a combination of contrast-gain and response-gain effects. Cross-stimulus adaptation conditions showed that adaptation effects were highly stimulus selective across early, ventral, and dorsal visual cortical areas, consistent with the perceptual effects.

A systematic PLS-SEM approach on assessment of indigenous knowledge in adapting to floods; A way forward to sustainable agriculture

The present study was conducted in one of the major agriculture areas to check farmers indigenous knowledge about the impacts of floods on their farming lives, food security, sustainable development, and risk assessment. In the current study, primary data was used to analyze the situation. A semi-structured questionnaire was distributed among farmers. We have collected a cross-sectional dataset and applied the PLS-SEM dual-stage hybrid model to test the proposed hypotheses and rank the social, economic, and technological factors according to their normalized importance. Results revealed that farmers' knowledge associated with adaption strategies, food security, risk assessment, and livelihood assets are the most significant predictors. Farmers need to have sufficient knowledge about floods, and it can help them to adopt proper measurements. A PLS-SEM dual-stage hybrid model was used to check the relationship among all variables, which showed a significant relationship among DV, IV, and control variables. PLS-SEM direct path analysis revealed that AS (b = -0.155; p 0.001), FS (b = 0.343; p 0.001), LA (b = 0.273; p 0.001), RA (b = 0.147; p 0.006), and for FKF have statistically significant values of beta, while SD (b = -0.079NS) is not significant. These results offer support to hypotheses H1 through H4 and H5 being rejected. On the other hand, age does not have any relationship with farmers' knowledge of floods. Our study results have important policy suggestions for governments and other stakeholders to consider in order to make useful policies for the ecosystem. The study will aid in the implementation of effective monitoring and public policies to promote integrated and sustainable development, as well as how to minimize the impacts of floods on farmers' lives and save the ecosystem and food.

Robot perceptual adaptation to environment changes for long-term human teammate following

Perception is one of the several fundamental abilities required by robots, and it also poses significant challenges, especially in real-world field applications. Long-term autonomy introduces additional difficulties to robot perception, including short- and long-term changes of the robot operation environment (e.g., lighting changes). In this article, we propose an innovative human-inspired approach named robot perceptual adaptation (ROPA) that is able to calibrate perception according to the environment context, which enables perceptual adaptation in response to environmental variations. ROPA jointly performs feature learning, sensor fusion, and perception calibration under a unified regularized optimization framework. We also implement a new algorithm to solve the formulated optimization problem, which has a theoretical guarantee to converge to the optimal solution. In addition, we collect a large-scale dataset from physical robots in the field, called perceptual adaptation to environment changes (PEAC), with the aim to benchmark methods for robot adaptation to short-term and long-term, and fast and gradual lighting changes for human detection based upon different feature modalities extracted from color and depth sensors. Utilizing the PEAC dataset, we conduct extensive experiments in the application of human recognition and following in various scenarios to evaluate ROPA. Experimental results have validated that the ROPA approach obtains promising performance in terms of accuracy and efficiency, and effectively adapts robot perception to address short-term and long-term lighting changes in human detection and following applications.

Sensitivity to the slope of the amplitude spectrum is dependent on the spectral slopes of recently viewed environments: A visual adaptation study in modified reality

Scenes contain many statistical regularities that could benefit visual processing if accounted for by the visual system. One such statistic is the orientation-averaged slope (α) of the amplitude spectrum of natural scenes. Human observers show different discrimination sensitivity to α: sensitivity is highest for α values between 1.0 and 1.2 and decreases as α is steepened or shallowed. The range of α for peak discrimination sensitivity is concordant with the average α of natural scenes, which may indicate that visual mechanisms are optimized to process information at α values commonly encountered in the environment. Here we explore the association between peak discrimination sensitivity and the most viewed αs in natural environments. Specifically, we verified whether discrimination sensitivity depends on the recently viewed environments. Observers were immersed, using a Head-Mounted Display, in an environment that was either unaltered or had its average α steepened or shallowed by 0.4. Discrimination thresholds were affected by the average shift in α, but this effect was most prominent following adaptation to a shallowed environment. We modeled these data with a Bayesian observer and explored whether a change in the prior or a change in the likelihood best explained the psychophysical effects. Change in discrimination thresholds following adaptation could be explained by a shift in the central tendency of the prior concordant with the shift of the environment, in addition to a change in the likelihood. Our findings suggest that expectations on the occurrence of α that result from a lifetime of exposure remain plastic and able to accommodate for the statistical structure of recently viewed environments.

Annual Research Review: Shifting from 'normal science' to neurodiversity in autism science

Since its initial description, the concept of autism has been firmly rooted within the conventional medical paradigm of child psychiatry. Increasingly, there have been calls from the autistic community and, more recently, nonautistic researchers, to rethink the way in which autism science is framed and conducted. Neurodiversity, where autism is seen as one form of variation within a diversity of minds, has been proposed as a potential alternative paradigm. In this review, we concentrate on three major challenges to the conventional medical paradigm - an overfocus on deficits, an emphasis on the individual as opposed to their broader context and a narrowness of perspective - each of which necessarily constrains what we can know about autism and how we are able to know it. We then outline the ways in which fundamental elements of the neurodiversity paradigm can potentially help researchers respond to the medical model's limitations. We conclude by considering the implications of a shift towards the neurodiversity paradigm for autism science.

The aftereffect of the ensemble average of facial expressions on subsequent facial expression recognition

An ensemble or statistical summary can be extracted from facial expressions presented in different spatial locations simultaneously. However, how such complicated objects are represented in the mind is not clear. It is known that the aftereffect of facial expressions, in which prolonged viewing of facial expressions biases the perception of subsequent facial expressions of the same category, occurs only when a visual representation is formed. Using this methodology, we examined whether an ensemble can be represented with visualized information. Experiment 1 revealed that the presentation of multiple facial expressions biased the perception of subsequent facial expressions to less happy as much as the presentation of a single face did. Experiment 2 compared the presentation of faces comprising strong and weak intensities of emotional expressions with an individual face as the adaptation stimulus. The results indicated that the perceptual biases were found after the presentation of four faces and a strong single face, but not after the weak single face presentation. Experiment 3 employed angry expressions, a distinct category from the test expression used as an adaptation stimulus; no aftereffect was observed. Finally, Experiment 4 clearly demonstrated the perceptual bias with a higher number of faces. Altogether, these results indicate that an ensemble average extracted from multiple faces leads to the perceptual bias, and this effect is similar in terms of its properties to that of a single face. This supports the idea that an ensemble of faces is represented with visualized information as a single face.

Explaining Orientation Adaptation in V1 by Updating the State of a Spatial Model

In this work, we extend an influential statistical model based on the spatial classical receptive field (CRF) and non-classical receptive field (nCRF) interactions (Coen-Cagli et al., 2012) to explain the typical orientation adaptation effects observed in V1. If we assume that the temporal adaptation modifies the “state” of the model, the spatial statistical model can explain all of the orientation adaptation effects in the context of neuronal output using small and large grating observed in neurophysiological experiments in V1. The “state” of the model represents the internal parameters such as the prior and the covariance trained on a mixed dataset that totally determine the response of the model. These two parameters, respectively, reflect the probability of the orientation component and the connectivity among neurons between CRF and nCRF. Specifically, we have two key findings: First, neural adapted results using a small grating that just covers the CRF can be predicted by the change of the prior of our model. Second, the change of the prior can also predict most of the observed results using a large grating that covers both CRF and nCRF of a neuron. However, the prediction of the novel attractive adaptation using large grating covering both CRF and nCRF also necessitates the involvement of a connectivity change of the center-surround RFs. In addition, our paper contributes a new prior-based winner-take-all (WTA) working mechanism derived from the statistical-based model to explain why and how all of these orientation adaptation effects can be predicted by relying on this spatial model without modifying its structure, a novel application of the spatial model. The research results show that adaptation may link time and space by changing the “state” of the neural system according to a specific adaptor. Furthermore, different forms of stimulus used for adaptation can cause various adaptation effects, such as an a priori shift or a connectivity change, depending on the specific stimulus size.

Spectral measurement of daylights and surface properties of natural objects in Japan

We present a spectral dataset of daylights and surface reflectances and transmittances of natural objects measured in Japan. Daylights were measured under the sun and under shadow from dawn to dusk on four different days to capture their temporal spectral transition. We separately measured daylight spectra at five different locations (including an open space and a forest) with minimum time difference to reveal whether a local environment alters daylight spectra reaching the ground. We found that colors of natural objects were spread in a limited area of color space, and data points were absent around saturated green regions. Daylight spectra were found to have a larger variation across time, weather, and local environments than previously thought. Datasets are made freely available, expanding past public datasets mainly collected in Northern America and Europe.

Are adaptation aftereffects for facial emotional expressions affected by prior knowledge about the emotion?

Accurate perception of the emotional signals conveyed by others is crucial for successful social interaction. Such perception is influenced not only by sensory input, but also by knowledge we have about the others' emotions. This study addresses the issue of whether knowing that the other's emotional state is congruent or incongruent with their displayed emotional expression ("genuine" and "fake", respectively) affects the neural mechanisms underpinning the perception of their facial emotional expressions. We used a visual adaptation paradigm to investigate this question in three experiments employing increasing adaptation durations. The adapting stimuli consisted of photographs of emotional facial expressions of joy and anger, purported to reflect (in-)congruency between felt and expressed emotion, displayed by professional actors. A Validity checking procedure ensured participants had the correct knowledge about the (in-)congruency. Significantly smaller adaptation aftereffects were obtained when participants knew that the displayed expression was incongruent with the felt emotion, following all tested adaptation periods. This study shows that knowledge relating to the congruency between felt and expressed emotion modulates face expression aftereffects. We argue that this reflects that the neural substrate responsible for the perception of facial expressions of emotion incorporates the presumed felt emotion underpinning the expression.

Adaptation in face animacy perception: An event-related potential study

A real face differs from an artificial face mainly in the animacy. Nowadays, the perception boundaries between the real and artificial faces are becoming blurred in our life with the ubiquitous use of AI. Therefore, the perception of animacy causes increasing interests. Here, we used an adaptation paradigm to investigate the animacy perception in faces. We morphed a real and an artificial face to generate a continuum of face images, and asked participants to judge the animacy of those face images after they were exposed to a real face or an artificial face. We found that after adaptation to a real face, the subjects were apt to identify a subsequently ambiguous face to be inanimate, whereas after adaptation to an artificial face, the subjects were apt to identify a subsequently ambiguous face to be animate, i.e., the face animacy aftereffect (FAAE). We simultaneously recorded EEG during the task and analyzed the event-related potentials in response to the test faces, and found that adaptation to a face animacy suppressed the amplitude of LPP (late positive potential) and prolonged the latencies of N250r and LPP, in response to subsequent animacy-congruent faces. However, for subsequent animacy-incongruent faces, the amplitude was enhanced in LPP and the latencies were shortened in N250r and LPP. Those modulations of N250r and LPP activity act as a neural correlate of face animacy adaptation.

The emotional adaptation aftereffect discriminates between individuals with high and low levels of depressive symptoms

The adaptation aftereffect plays a critical role in human development and survival. Existing studies have found that, compared with general individuals, individuals with learning disability, autism and dyslexia show a smaller amount of non-affective-based cognitive adaptation aftereffect. Nevertheless, it is unclear whether individuals with depression or depression tendency show similar phenomenon in the adaptation aftereffect, and whether such depression tendency occurs in the non-affective-based cognitive or emotional adaptation aftereffect. To address this question, the present study conducted two experiments. Experiments 1A and 1B used the emotional facial expression adaptation paradigm to examine whether Chinese participants showed the emotional adaptation aftereffect and whether the emotional adaptation aftereffect was influenced by physical features of faces, respectively. Experiment 2 recruited two groups of participants, with high and low depression, respectively, to examine whether they showed differences in the emotional or cognitive adaptation aftereffect. Results showed that Chinese participants showed the typical emotional adaptation aftereffect, which was not influenced by physical features of faces. More importantly, compared to the low-depression group, the high-depression group showed a smaller emotional adaptation aftereffect, but the two groups showed a similar cognitive adaptation aftereffect. These results suggest that level of depressive symptoms is associated with the emotional adaptation aftereffect.

Functional Interactions between Sensory and Memory Networks for Adaptive Behavior

The brain's capacity to adapt to sensory inputs is key for processing sensory information efficiently and interacting in new environments. Following repeated exposure to the same sensory input, brain activity in sensory areas is known to decrease as inputs become familiar, a process known as adaptation. Yet, the brain-wide mechanisms that mediate adaptive processing remain largely unknown. Here, we combine multimodal brain imaging (functional magnetic resonance imaging [fMRI], magnetic resonance spectroscopy) with behavioral measures of orientation-specific adaptation (i.e., tilt aftereffect) to investigate the functional and neurochemical mechanisms that support adaptive processing. Our results reveal two functional brain networks: 1) a sensory-adaptation network including occipital and dorsolateral prefrontal cortex regions that show decreased fMRI responses for repeated stimuli and 2) a perceptual-memory network including regions in the parietal memory network (PMN) and dorsomedial prefrontal cortex that relate to perceptual bias (i.e., tilt aftereffect). We demonstrate that adaptation relates to increased occipito-parietal connectivity, while decreased connectivity between sensory-adaptation and perceptual-memory networks relates to GABAergic inhibition in the PMN. Thus, our findings provide evidence that suppressive interactions between sensory-adaptation (i.e., occipito-parietal) and perceptual-memory (i.e., PMN) networks support adaptive processing and behavior, proposing a key role of memory systems in efficient sensory processing.

Visuo-Acoustic Stimulation's Role in Synaptic Plasticity: A Review of the Literature

Brain plasticity is the capacity of cerebral neurons to change, structurally and functionally, in response to experiences. This is an essential property underlying the maturation of sensory functions, learning and memory processes, and brain repair in response to the occurrence of diseases and trauma. In this field, the visual system emerges as a paradigmatic research model, both for basic research studies and for translational investigations. The auditory system remains capable of reorganizing itself in response to different auditory stimulations or sensory organ modification. Acoustic biofeedback training can be an effective way to train patients with the central scotoma, who have poor fixation stability and poor visual acuity, in order to bring fixation on an eccentrical and healthy area of the retina: a pseudofovea. This review article is focused on the cellular and molecular mechanisms underlying retinal sensitivity changes and visual and auditory system plasticity.

Perceptual Fading of a Stabilized Cortical Image: Replication in the Undergraduate Classroom

Prolonged exposure to a stimulus causes desensitization of cortical neurons and results in perceptual changes. One example of this phenomenon is contrast adaptation, in which perceived differences between light and dark regions of a stimulus decrease. Blakemore, Muncey, and Ridley reported evidence for the “perceptual fading of a stabilized cortical image” in a 1971 Nature paper. Our goal was to replicate their second experiment, in which adaptation was measured across many contrasts, and develop an active learning exercise for undergraduate students. The experiment was coded using an open-source python package and psychophysical data were collected from two observers. On each trial, a sinusoidally modulated luminance grating appeared above fixation, and the task of the observer was to adjust the contrast of a grating below fixation until the two appeared identical. Between trials in the adaptation condition, a high contrast grating was presented in the top location; no such grating appeared between trials in the control condition. Contrast matches showed a clear reduction during the adaptation condition, thus demonstrating perceptual fading and a successful replication of Blakemore et al. (1971). We then simplified the approach and modified the code to create a single, seamless experience for use in the classroom. With instructions and theoretical background provided in a one-page handout, students can perform the experiment on themselves and view their results in an automatically generated figure. This exercise, a primary example of active learning, will help students gain a first-hand understanding of the perceptual effects of adaptation.

Implicit visuospatial attention shapes numerosity adaptation and perception

The perception of numerical quantities is susceptible to adaptation: after inspecting a numerous dot array for a few seconds a subsequent dot array is grossly underestimated. In a recent work we showed that the mere appearance of an additional numerically neutral stimulus significantly reduces the adaptation magnitude. Here we demonstrate that this reduction is likely due to a numerosity underestimation of the adaptor caused by a change of numerosity-related attentional resources deployed on the adapting stimulus. In Experiment 1 we replicated previous findings revealing a robust reduction of numerosity adaptation when an additional adaptor (even if neutral) was displayed. In Experiment 2 we used the method of magnitude estimation to demonstrate that numerosity is underestimated whenever a second task-irrelevant numerical stimulus appears on screen. Furthermore we demonstrated that the same experimental manipulations were not effective in modulating orientation adaptation magnitude as well as orientation estimation accuracy. Our results support the hypothesis of a tight relationship between numerosity perception and implicit visuospatial attention and corroborate the notion that numerosity adaptation depends on perceived rather than physical numerosity. However the lack of an effect of visuospatial attentional deployment for orientation perception suggests that attention might differently shape adaptation aftereffects for different features along the visual hierarchy.

Visual Adaptation to Scattering in Myopes

Myopes exhibit a larger capability of adaptation to defocus. Adaptation produces a boost in visual performance that can be characterized through different metrics. The ability of myopes to adapt to other sources of blur, such as diffusion, has not been studied so far. In this work, a group of 20 myopes with normal vision underwent high-contrast visual acuity (VA) measurements under different viewing conditions, wearing their refractive correction with or without a diffuser (Bangerter filter, BF). VA decreased immediately after wearing the BF of density 0.6, showing a significant relationship with the ocular refraction. After 40 minutes of binocular vision through the BF, a statistically significant increase (p = 0.02) in VA from 0.54 to 0.62 in decimal scale (from 0.3 to 0.2 logMAR) was obtained. No correlation with the refraction was observed. After removing the diffuser, VA returned to baseline. A control group (17 subjects) underwent the same experimental protocol but without diffuser filters. No significant changes in VA were found in this group. We describe a new type of contrast adaptation to blur in myopes caused by scattering, rather than by defocus. The effects of low scattering levels in vision might be relevant in the analysis of early stage of cataract, amblyopia treatments, and myopia understanding.

Working Memory Load Effects on the Tilt Aftereffect

Prolonged exposure to an oriented stimulus causes a subsequent test stimulus to be perceived as tilted in the opposite direction, a phenomenon referred to as the tilt aftereffect (TAE). Previous studies have demonstrated that high-level cognitive functions such as attention can modulate the TAE, which is generally well-known as a low-level perceptual process. However, it is unclear whether working memory load, another high-level cognitive function, could modulate the TAE. To address this issue, here we developed a new paradigm by combining a working memory load task with a TAE task. Participants firstly remembered a stream of digits (Experiment 1) or four color-shape conjunctions (Experiment 2) under high/low load conditions, and then recognized the probe stimuli (digits or a color-shape conjunction), which were presented at the center of an adapting grating. After the recognition task (i.e., the adaptation stage), participants performed an orientation judgment task to measure their TAEs. The result of Experiment 1, where the load stimuli were digits, showed that the magnitude of the TAEs were reduced under the condition of the high working memory load compared to that of the low working memory load. However, we failed to replicate the finding in Experiment 2, where the load stimuli were color-shape conjunctions. Together, our two experiments provided mixed evidence regarding the working memory load effects on the TAE and further replications are needed in future work.

Audiomotor Temporal Recalibration Modulates Decision Criterion of Self-Agency but Not Perceptual Sensitivity

Exposure to delayed sensory feedback changes perceived simultaneity between action and feedback [temporal recalibration (TR)] and even modulates the sense of agency (SoA) over the feedback. To date, however, it is not clear whether the modulation of SoA by TR is caused by a change in perceptual sensitivity or decision criterion of self-agency. This experimental research aimed to tease apart these two by applying the signal detection theory (SDT) to the agency judgment over auditory feedback after voluntary action. Participants heard a short sequence of tone pips with equal inter-onset intervals, and they reproduced it by pressing a computer mouse. The delay of each tone pip after the mouse press was manipulated as 80 (baseline) or 180 ms (delayed). Subsequently, the participants reproduced it, in which the delay was fixed at 80 ms and there was a 50% chance that the computer took over the control of the tone pips from the participants. The participants’ task was to discriminate who controlled the tone pips and to judge synchrony between tone pips and mouse presses. Results showed that the modulation of the SoA by the TR is caused by a shift in the decision criterion but not in the perceptual sensitivity of agency.

Appearance of special colors in deuteranomalous trichromacy

Deuteranomalous color matching behavior is different from normal because the middle-wavelength sensitive cones contain an abnormal L' pigment instead of the M pigment of the normal observer. However, there is growing evidence that deuteranomalous color experience is not very different from that of normal trichromats. Here, normal and deuteranomalous observers chose monochromatic unique yellow lights. They also chose broadband lights, displayed on a computer monitor, that corresponded to eight special colors: the Hering unique hues (red, yellow, green, blue), and binary colors perceptually midway between them (orange, lime, cyan, purple). Deuteranomalous monochromatic unique yellow was shifted towards red, but all the broadband special color selections were physically similar for normal and deuteranomalous observers. Deuteranomalous special colors, including monochromatic unique yellow, were similar to those of normal observers when expressed in a color-opponent chromaticity diagram based on their own visual pigments, but only if (1) color-opponent responses were normalized to white, and (2) the deuteranomalous diagram was expanded along the r - g dimension to compensate for the reduced difference between deuteranomalous L- and L'-cone photopigments. Particularly, deuteranomalous observers did not choose binary colors with extra r - g impact to overcome their insensitivity along the r - g dimension. This result can only be compatible with the known abnormality of the deuteranomalous L' photopigment if deuteranomalous observers adjust their perceptual representation of colors to compensate for their color vision deficiency.

Human color constancy based on the geometry of color distributions

The physical inputs to our visual system are dictated by the interplay between lights and surfaces; thus, for surface color to be stably perceived, the influence of the illuminant must be discounted. To reveal our strategy to infer the illuminant color, we conducted three psychophysical experiments designed to test our optimal color hypothesis that we internalize the physical color gamut under various illuminants and apply the prior to estimate the illuminant color. In each experiment, we presented 61 hexagons arranged without spatial gaps, where the surrounding 60 hexagons were set to have a specific shape in their color distribution. We asked participants to adjust the color of a center test field so that it appeared to be a full-white surface placed under a test illuminant. Results and computational modeling suggested that, although our proposed model is limited in accounting for estimation of illuminant intensity by human observers, it agrees fairly well with the estimates of illuminant chromaticity in most tested conditions. The accuracy of estimation generally outperformed other tested conventional color constancy models. These results support the hypothesis that our visual system can utilize the geometry of scene color distribution to achieve color constancy.

Functional reallocation of sensory processing resources caused by long-term neural adaptation to altered optics

The eye’s optics are a major determinant of visual perception. Elucidating how long-term exposure to optical defects affects visual processing is key to understanding the capacity for, and limits of, sensory plasticity. Here, we show evidence of functional reallocation of sensory processing resources following long-term exposure to poor optical quality. Using adaptive optics to bypass all optical defects, we assessed visual processing in neurotypically-developed adults with healthy eyes and with keratoconus – a corneal disease causing severe optical aberrations. Under fully-corrected optical conditions, keratoconus patients showed altered contrast sensitivity, with impaired sensitivity for fine spatial details and better-than-typical sensitivity for coarse spatial details. Both gains and losses in sensitivity were more pronounced in patients experiencing poorer optical quality in their daily life and mediated by changes in signal enhancement mechanisms. These findings show that adult neural processing adapts to better match the changes in sensory inputs caused by long-term exposure to altered optics.

Individual differences in voice adaptability are specifically linked to voice perception skill

There are remarkable individual differences in the ability to recognise individuals by the sound of their voice. Theoretically, this ability is thought to depend on the coding accuracy of voices in a low-dimensional "voice-space". Here we were interested in how adaptive coding of voice identity relates to this variability in skill. In two adaptation experiments we explored first whether the aftereffect size to two familiar vocal identities can predict voice perception ability and second, whether this effect stems from general auditory skill (e.g. discrimination ability for tuning and tempo). Experiment 1 demonstrated that contrastive aftereffect sizes for voice identity predicted voice perception ability. In Experiment 2, we replicated this finding and further established that this effect is unrelated to general auditory abilities or general adaptability of listeners. Our results highlight the important functional role of adaptive coding in voice expertise and suggest that human voice perception is a highly specialised and distinct auditory ability.

Repeated Contrast Adaptation Does Not Cause Habituation of the Adapter

Adaptation can optimize information processing by allowing the visual system to always adjust to the environment. However, only a few studies have investigated how the visual system makes adjustments to repeatedly occurring changes in the input, still less about the related neural mechanism. Our previous study found that contrast adaptation attenuated after multiple daily sessions of repeated adaptation, which was explained by the habituation of either the adapter's effective strength or the adaptation mechanisms. To examine the former hypothesis, in the present study we used the frequency tagging technique to measure the adapter-elicited steady-state visual evoked potential (SSVEP) amplitudes. Participants repeatedly adapted to the same contrast adapter in a top-up manner for six continuous days, which was called training of adaptation. The behavioral adaptation effect and SSVEP response to the trained adapter and an untrained control adapter were measured before and after training. The psychophysical results showed that the effect of adaptation in the trained condition significantly reduced after training, replicating our previous finding. Contradicting the prediction of the hypothesis that repeated adaptation attenuated the effective strength of the adapter, the SSVEP amplitude was unchanged after training, which was further confirmed by an equivalence test. Taken together, the results challenge the account of habituation of adapter in repeated adaptation, while leaving the account of habituation of adaptation mechanism to be tested.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

A Sensorimotor Numerosity System

Incoming sensory input provides information for the planning and execution of actions, which yield motor outcomes that are themselves sensory inputs. One dimension where action and perception strongly interact is numerosity perception. Many non-human animals can estimate approximately the number of external elements as well as their own actions, and neurons have been identified that respond to both. Recent psychophysical adaptation studies on humans also provide evidence for neural mechanisms responding to both the number of externally generated events and self-produced actions. Here we advance the idea that these strong connections may arise from dedicated sensorimotor mechanisms in the brain, part of a more generalized system interfacing action with the processing of other quantitative magnitudes such as space and time.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

A decision-time account of individual variability in context-dependent orientation estimation

Following exposure to an oriented stimulus, the perceived orientation is slightly shifted, a phenomenon termed the tilt aftereffect (TAE). This estimation bias, as well as other context-dependent biases, is speculated to reflect statistical mechanisms of inference that optimize visual processing. Importantly, although measured biases are extremely robust in the population, the magnitude of individual bias can be extremely variable. For example, measuring different individuals may result in TAE magnitudes that differ by a factor of 5. Such findings appear to challenge the accounts of bias in terms of learned statistics: is inference so different across individuals? Here, we found that a strong correlation exists between reaction time and TAE, with slower individuals having much less TAE. In the tilt illusion, the spatial analogue of the TAE, we found a similar, though weaker, correlation. These findings can be explained by a theory predicting that bias, caused by a change in the initial conditions of evidence accumulation (e.g., priors), decreases with decision time (*Communications Biology 3 (2020) 1-12). We contend that the context-dependence of visual processing is more homogeneous in the population than was previously thought, with the measured variability of perceptual bias explained, at least in part, by the flexibility of decision-making. Homogeneity in processing might reflect the similarity of the learned statistics.

Individual differences in the tendency to see the expected

Prior knowledge has been shown to facilitate the incorporation of visual stimuli into awareness. We adopted an individual differences approach to explore whether a tendency to 'see the expected' is general or method-specific. We administered a binocular rivalry task and manipulated selective attention, as well as induced expectations via predictive context, self-generated imagery, expectancy cues, and perceptual priming. Most prior manipulations led to a facilitated awareness of the biased percept in binocular rivalry, whereas strong signal primes led to a suppressed awareness, i.e., adaptation. Correlations and factor analysis revealed that the facilitatory effect of priors on visual awareness is closely related to attentional control. We also investigated whether expectation-based biases predict perceptual abilities. Adaptation to strong primes predicted improved naturalistic change detection and the facilitatory effect of weak primes predicted the experience of perceptual anomalies. Taken together, our results indicate that the facilitatory effect of priors may be underpinned by an attentional mechanism but the tendency to 'see the expected' is method-specific.

Motor adaptation distorts visual space

It has been suggested that the human visual system exploits an adaptable metric to implement a precise but plastic spatial representation. Indeed, adapting to a dense dot-texture reduces the apparent separation of subsequently presented dots pairs. Whether this metric is purely visual or shared between senses is still unknown. Here we present a new cross-modal after-effect revealing that the metric with which the visual system computes the relative spatial position of objects is shared with the motor system. A few seconds of mid-air self-produced tapping movements (adaptation) yielded a robust compression of the apparent separation of dot pairs subsequently displayed around the tapping region. This visuo-motor spatial metric could reflect an efficient functional architecture to program and execute actions aimed at efficient interaction with the objects in the environment.

Humans adapt their anticipatory eye movements to the volatility of visual motion properties

Animal behavior constantly adapts to changes, for example when the statistical properties of the environment change unexpectedly. For an agent that interacts with this volatile setting, it is important to react accurately and as quickly as possible. It has already been shown that when a random sequence of motion ramps of a visual target is biased to one direction (e.g. right or left), human observers adapt their eye movements to accurately anticipate the target's expected direction. Here, we prove that this ability extends to a volatile environment where the probability bias could change at random switching times. In addition, we also recorded the explicit prediction of the next outcome as reported by observers using a rating scale. Both results were compared to the estimates of a probabilistic agent that is optimal in relation to the assumed generative model. Compared to the classical leaky integrator model, we found a better match between our probabilistic agent and the behavioral responses, both for the anticipatory eye movements and the explicit task. Furthermore, by controlling the level of preference between exploitation and exploration in the model, we were able to fit for each individual's experimental dataset the most likely level of volatility and analyze inter-individual variability across participants. These results prove that in such an unstable environment, human observers can still represent an internal belief about the environmental contingencies, and use this representation both for sensory-motor control and for explicit judgments. This work offers an innovative approach to more generically test the diversity of human cognitive abilities in uncertain and dynamic environments.

Interaction of contexts in context-dependent orientation estimation

The processing of a visual stimulus is known to be influenced by the statistics in recent visual history and by the stimulus' visual surround. Such contextual influences lead to perceptually salient phenomena, such as the tilt aftereffect and the tilt illusion. Despite much research on the influence of an isolated context, it is not clear how multiple, possibly competing sources of contextual influence interact. Here, using psychophysical methods, we compared the combined influence of multiple contexts to the sum of the isolated context influences. The results showed large deviations from linear additivity for adjacent or overlapping contexts, and remarkably, clear additivity when the contexts were sufficiently separated. Specifically, for adjacent or overlapping contexts, the combined effect was often lower than the sum of the isolated component effects (sub-additivity), or was more influenced by one component than another (selection). For contexts that were separated in time (600 ms), the combined effect measured the exact sum of the isolated component effects (in degrees of bias). Overall, the results imply an initial compressive transformation during visual processing, followed by selection between the processed parts.