Moving sensory adaptation beyond suppressive effects in single neurons

Fine-scale computations for adaptive processing in the human brain

Adapting to the environment statistics by reducing brain responses to repetitive sensory information is key for efficient information processing. Yet, the fine-scale computations that support this adaptive processing in the human brain remain largely unknown. Here, we capitalise on the sub-millimetre resolution of ultra-high field imaging to examine functional magnetic resonance imaging signals across cortical depth and discern competing hypotheses about the brain mechanisms (feedforward vs. feedback) that mediate adaptive processing. We demonstrate layer-specific suppressive processing within visual cortex, as indicated by stronger BOLD decrease in superficial and middle than deeper layers for gratings that were repeatedly presented at the same orientation. Further, we show altered functional connectivity for adaptation: enhanced feedforward connectivity from V1 to higher visual areas, short-range feedback connectivity between V1 and V2, and long-range feedback occipito-parietal connectivity. Our findings provide evidence for a circuit of local recurrent and feedback interactions that mediate rapid brain plasticity for adaptive information processing.

Visual mismatch responses index surprise signalling but not expectation suppression

The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.

Differential Short-Term Plasticity of PV and SST Neurons Accounts for Adaptation and Facilitation of Cortical Neurons to Auditory Tones

Cortical responses to sensory stimuli are strongly modulated by temporal context. One of the best studied examples of such modulation is sensory adaptation. We first show that in response to repeated tones pyramidal (Pyr) neurons in male mouse auditory cortex (A1) exhibit facilitating and stable responses, in addition to adapting responses. To examine the potential mechanisms underlying these distinct temporal profiles, we developed a reduced spiking model of sensory cortical circuits that incorporated the signature short-term synaptic plasticity (STP) profiles of the inhibitory parvalbumin (PV) and somatostatin (SST) interneurons. The model accounted for all three temporal response profiles as the result of dynamic changes in excitatory/inhibitory balance produced by STP, primarily through shifts in the relative latency of Pyr and inhibitory neurons. Transition between the three response profiles was possible by changing the strength of the inhibitory PV→Pyr and SST→Pyr synapses. The model predicted that a unit's latency would be related to its temporal profile. Consistent with this prediction, the latency of stable units was significantly shorter than that of adapting and facilitating units. Furthermore, because of the history-dependence of STP the model generated a paradoxical prediction: that inactivation of inhibitory neurons during one tone would decrease the response of A1 neurons to a subsequent tone. Indeed, we observed that optogenetic inactivation of PV neurons during one tone counterintuitively decreased the spiking of Pyr neurons to a subsequent tone 400 ms later. These results provide evidence that STP is critical to temporal context-dependent responses in the sensory cortex.SIGNIFICANCE STATEMENT Our perception of speech and music depends strongly on temporal context, i.e., the significance of a stimulus depends on the preceding stimuli. Complementary neural mechanisms are needed to sometimes ignore repetitive stimuli (e.g., the tic of a clock) or detect meaningful repetition (e.g., consecutive tones in Morse code). We modeled a neural circuit that accounts for diverse experimentally-observed response profiles in auditory cortex (A1) neurons, based on known forms of short-term synaptic plasticity (STP). Whether the simulated circuit reduced, maintained, or enhanced its response to repeated tones depended on the relative dominance of two different types of inhibitory cells. The model made novel predictions that were experimentally validated. Results define an important role for STP in temporal context-dependent perception.

Adaptation aftereffects reveal how categorization training changes the encoding of face identity

Previous research suggests that learning to categorize faces along a novel dimension changes the perceptual representation of such dimension, increasing its discriminability, its invariance, and the information used to identify faces varying along the dimension. A common interpretation of these results is that categorization training promotes the creation of novel dimensions, rather than simply the enhancement of already existing representations. Here, we trained a group of participants to categorize faces that varied along two morphing dimensions, one of them relevant to the categorization task and the other irrelevant to the task. An untrained group did not receive such categorization training. In three experiments, we used face adaptation aftereffects to explore how categorization training changes the encoding of face identities at the extremes of the category-relevant dimension and whether such training produces encoding of the category-relevant dimension as a preferred direction in face space. The pattern of results suggests that categorization training enhances the already existing norm-based coding of face identity, rather than creating novel category-relevant representations. We formalized this conclusion in a model that explains the most important results in our experiments and serves as a working hypothesis for future work in this area.

Incorporating intrinsic suppression in deep neural networks captures dynamics of adaptation in neurophysiology and perception

Adaptation is a fundamental property of sensory systems that can change subjective experiences in the context of recent information. Adaptation has been postulated to arise from recurrent circuit mechanisms or as a consequence of neuronally intrinsic suppression. However, it is unclear whether intrinsic suppression by itself can account for effects beyond reduced responses. Here, we test the hypothesis that complex adaptation phenomena can emerge from intrinsic suppression cascading through a feedforward model of visual processing. A deep convolutional neural network with intrinsic suppression captured neural signatures of adaptation including novelty detection, enhancement, and tuning curve shifts, while producing aftereffects consistent with human perception. When adaptation was trained in a task where repeated input affects recognition performance, an intrinsic mechanism generalized better than a recurrent neural network. Our results demonstrate that feedforward propagation of intrinsic suppression changes the functional state of the network, reproducing key neurophysiological and perceptual properties of adaptation.

Evidence for the intrinsically nonlinear nature of receptive fields in vision

The responses of visual neurons, as well as visual perception phenomena in general, are highly nonlinear functions of the visual input, while most vision models are grounded on the notion of a linear receptive field (RF). The linear RF has a number of inherent problems: it changes with the input, it presupposes a set of basis functions for the visual system, and it conflicts with recent studies on dendritic computations. Here we propose to model the RF in a nonlinear manner, introducing the intrinsically nonlinear receptive field (INRF). Apart from being more physiologically plausible and embodying the efficient representation principle, the INRF has a key property of wide-ranging implications: for several vision science phenomena where a linear RF must vary with the input in order to predict responses, the INRF can remain constant under different stimuli. We also prove that Artificial Neural Networks with INRF modules instead of linear filters have a remarkably improved performance and better emulate basic human perception. Our results suggest a change of paradigm for vision science as well as for artificial intelligence.

Precision multidimensional neural population code recovered from single intracellular recordings

Neurons in sensory cortices are more naturally and deeply integrated than any current neural population recording tools (e.g. electrode arrays, fluorescence imaging). Two concepts facilitate efforts to observe population neural code with single-cell recordings. First, even the highest quality single-cell recording studies find a fraction of the stimulus information in high-dimensional population recordings. Finding any of this missing information provides proof of principle. Second, neurons and neural populations are understood as coupled nonlinear differential equations. Therefore, fitted ordinary differential equations provide a basis for single-trial single-cell stimulus decoding. We obtained intracellular recordings of fluctuating transmembrane current and potential in mouse visual cortex during stimulation with drifting gratings. We use mean deflection from baseline when comparing to prior single-cell studies because action potentials are too sparse and the deflection response to drifting grating stimuli (e.g. tuning curves) are well studied. Equation-based decoders allowed more precise single-trial stimulus discrimination than tuning-curve-base decoders. Performance varied across recorded signal types in a manner consistent with population recording studies and both classification bases evinced distinct stimulus-evoked phases of population dynamics, providing further corroboration. Naturally and deeply integrated observations of population dynamics would be invaluable. We offer proof of principle and a versatile framework.

A decision-time account of individual variability in context-dependent orientation estimation

Following exposure to an oriented stimulus, the perceived orientation is slightly shifted, a phenomenon termed the tilt aftereffect (TAE). This estimation bias, as well as other context-dependent biases, is speculated to reflect statistical mechanisms of inference that optimize visual processing. Importantly, although measured biases are extremely robust in the population, the magnitude of individual bias can be extremely variable. For example, measuring different individuals may result in TAE magnitudes that differ by a factor of 5. Such findings appear to challenge the accounts of bias in terms of learned statistics: is inference so different across individuals? Here, we found that a strong correlation exists between reaction time and TAE, with slower individuals having much less TAE. In the tilt illusion, the spatial analogue of the TAE, we found a similar, though weaker, correlation. These findings can be explained by a theory predicting that bias, caused by a change in the initial conditions of evidence accumulation (e.g., priors), decreases with decision time (*Communications Biology 3 (2020) 1-12). We contend that the context-dependence of visual processing is more homogeneous in the population than was previously thought, with the measured variability of perceptual bias explained, at least in part, by the flexibility of decision-making. Homogeneity in processing might reflect the similarity of the learned statistics.

Altered neuronal habituation to hearing others' pain in adults with autistic traits

This study tested the hypothesis that autistic traits influence the neuronal habituation that underlies the processing of others' pain. Based on their autism-spectrum quotient (AQ), two groups of participants were classified according to their autistic traits: High-AQ and Low-AQ groups. Their event-related potentials in response to trains of three identical audio recordings, exhibiting either painful or neutral feelings of others, were compared during three experimental tasks. (1) In a Pain Judgment Task, participants were instructed to focus on pain-related cues in the presented audio recordings. (2) In a Gender Judgment Task, participants were instructed to focus on non-pain-related cues in the presented audio recordings. (3) In a Passive Listening Task, participants were instructed to passively listen. In the High-AQ group, an altered empathic pattern of habituation, indexed by frontal-central P2 responses of the second repeated painful audio recordings, was found during the Passive Listening Task. Nevertheless, both High-AQ and Low-AQ groups exhibited similar patterns of habituation to hearing others' voices, both neutral and painful, in the Pain Judgment and Gender Judgment Tasks. These results suggest altered empathic neuronal habituation in the passive processing of others' vocal pain by individuals with autistic traits.

Dynamic Contextual Modulation in Superior Colliculus of Awake Mouse

The responses of neurons in the visual pathway depend on the context in which a stimulus is presented. Responses to predictable stimuli are usually suppressed, highlighting responses to unexpected stimuli that might be important for behavior. Here, we established how context modulates the response of neurons in the superior colliculus (SC), a region important in orienting toward or away from visual stimuli. We made extracellular recordings from single units in the superficial layers of SC in awake mice. We found strong suppression of visual response by spatial context (surround suppression) and temporal context (adaptation). Neurons showing stronger surround suppression also showed stronger adaptation effects. In neurons where it was present, surround suppression was dynamic and was reduced by adaptation. Adaptation's effects further revealed two components to surround suppression: one component that was weakly tuned for orientation and adaptable, and another component that was more strongly tuned but less adaptable. The selectivity of the tuned component was flexible, such that suppression was stronger when the stimulus over the surround matched that over the receptive field. Our results therefore reveal strong interactions between spatial and temporal context in regulating the flow of signals through mouse SC, and suggest the presence of a subpopulation of neurons that might signal novelty in either space or time.

Adaptation to feedback representation of illusory orientation produced from flash grab effect

Adaptation is a ubiquitous property of sensory systems. It is typically considered that neurons adapt to dominant energy in the ambient environment to function optimally. However, perceptual representation of the stimulus, often modulated by feedback signals, sometimes do not correspond to the input state of the stimulus, which tends to be more linked with feedforward signals. Here we investigated the relative contributions to cortical adaptation from feedforward and feedback signals, taking advantage of a visual illusion, the Flash-Grab Effect, to disassociate the feedforward and feedback representation of an adaptor. Results reveal that orientation adaptation is exclusively dependent on the perceived rather than the retinal orientation of the adaptor. Combined fMRI and EEG measurements demonstrate that the perceived orientation of the Flash-Grab Effect is indeed supported by feedback signals in the cortex. These findings highlight the important contribution of feedback signals for cortical neurons to recalibrate their sensitivity.

Feedforward-feedback signal interactions are common in the brain during sensory information processing. Here, the authors show that feedback-driven representation of perceived orientation dominates visual adaptation, despite the discrepant feedforward representation of input orientation.

Auditory and tactile frequency representations are co-embedded in modality-defined cortical sensory systems

Sensory information is represented and elaborated in hierarchical cortical systems that are thought to be dedicated to individual sensory modalities. This traditional view of sensory cortex organization has been challenged by recent evidence of multimodal responses in primary and association sensory areas. Although it is indisputable that sensory areas respond to multiple modalities, it remains unclear whether these multimodal responses reflect selective information processing for particular stimulus features. Here, we used fMRI adaptation to identify brain regions that are sensitive to the temporal frequency information contained in auditory, tactile, and audiotactile stimulus sequences. A number of brain regions distributed over the parietal and temporal lobes exhibited frequency-selective temporal response modulation for both auditory and tactile stimulus events, as indexed by repetition suppression effects. A smaller set of regions responded to crossmodal adaptation sequences in a frequency-dependent manner. Despite an extensive overlap of multimodal frequency-selective responses across the parietal and temporal lobes, representational similarity analysis revealed a cortical "regional landscape" that clearly reflected distinct somatosensory and auditory processing systems that converged on modality-invariant areas. These structured relationships between brain regions were also evident in spontaneous signal fluctuation patterns measured at rest. Our results reveal that multimodal processing in human cortex can be feature-specific and that multimodal frequency representations are embedded in the intrinsically hierarchical organization of cortical sensory systems.

The effect of movie-watching on electroencephalographic responses to tactile stimulation

Movie-watching is becoming a popular acquisition method to increase compliance and enable neuroimaging data collection in challenging populations such as children, with potential to facilitate studying the somatosensory system. However, relatively little is known about the possible crossmodal (audiovisual) influence of movies on cortical somatosensory processing. In this study, we examined the impact of dynamic audiovisual movies on concurrent cortical somatosensory processing using electroencephalography (EEG). Forty healthy young adults (18-25 years) received passive tactile fingertip stimulation while watching an "entertaining" movie and a novel "low-demand" movie called 'Inscapes' compared to eyes-open rest. Watching a movie did not modulate properties of early or late somatosensory-evoked potentials (SEPs). Similarly, no crossmodal influence on somatosensory adaptation, denoted by a reduction in SEP amplitude with repetitive tactile stimulation, was found. The prominent oscillatory responses in the alpha and beta frequency bands following tactile stimulation differed as a function of viewing condition, with stronger alpha/beta event-related desynchronization (ERD) during movie-watching compared to rest. These findings highlight that movie-watching is a valid acquisition method during which SEPs can be measured in basic research and clinical studies, but that the attentional demands of movies need to be taken into account when performing oscillatory analyses.

Tactile distance adaptation aftereffects do not transfer to perceptual hand maps

Recent studies have demonstrated that mental representations of the hand dorsum are distorted even for healthy participants. Perceptual hand maps estimated by pointing to specific landmarks (e.g., knuckles and tips of fingers) is stretched and shrunk along the medio-lateral and the proximo-distal axes, respectively. Similarly, tactile distance perception between two touches is longer along the medio-lateral axis than the proximo-distal axis. The congruency of the two types of distortions suggests that common perceptual and neural representations may be involved in these processes. Prolonged stimulation by two simultaneous touches having a particular distance can bias subsequent perception of tactile distances (e.g., adaptation to a long distance induces shorter stimuli to be perceived even shorter). This tactile distance adaptation aftereffect has been suggested to occur based on the modulations of perceptual and neural responses at low somatosensory processing stages. The current study investigated whether tactile distance adaptation aftereffects affect also the pattern of distortions on the perceptual hand maps. Participants localized locations on the hand dorsum cued by tactile stimulations (Experiment 1) or visually presented landmarks on a hand silhouette (Experiment 2). Each trial was preceded by adaptation to either a small (2 cm) or large (4 cm) tactile distance. We found clear tactile distance aftereffects. However, no changes were observed for the distorted pattern of the perceptual hand maps following adaptation to a tactile distance. Our results showed that internal body representations involved in perceptual distortions may be distinct between tactile distance perception and the perceptual hand maps underlying position sense.

Magnitude, time course, and specificity of rapid adaptation across mouse visual areas

Adaptation is a ubiquitous feature of sensory processing whereby recent experience shapes future responses. The mouse primary visual cortex (V1) is particularly sensitive to recent experience, where a brief stimulus can suppress subsequent responses for seconds. This rapid adaptation profoundly impacts perception, suggesting that its effects are propagated along the visual hierarchy. To understand how rapid adaptation influences sensory processing, we measured its effects at key nodes in the visual system: in V1, three higher visual areas (HVAs: lateromedial, anterolateral, and posteromedial), and the superior colliculus (SC) in awake mice of both sexes using single-unit recordings. Consistent with the feed-forward propagation of adaptation along the visual hierarchy, we find that neurons in layer 4 adapt less strongly than those in other layers of V1. Furthermore, neurons in the HVAs adapt more strongly, and recover more slowly, than those in V1. The magnitude and time course of adaptation was comparable in each of the HVAs and in the SC, suggesting that adaptation may not linearly accumulate along the feed-forward visual processing hierarchy. Despite the increase in adaptation in the HVAs compared with V1, the effects were similarly orientation specific across all areas. These data reveal that adaptation profoundly shapes cortical processing, with increasing impact at higher levels in the cortical hierarchy, and also strongly influencing computations in the SC. Thus, we find robust, brain-wide effects of rapid adaptation on sensory processing.NEW & NOTEWORTHY Rapid adaptation dynamically alters sensory signals to account for recent experience. To understand how adaptation affects sensory processing and perception, we must determine how it impacts the diverse set of cortical and subcortical areas along the hierarchy of the mouse visual system. We find that rapid adaptation strongly impacts neurons in primary visual cortex, the higher visual areas, and the colliculus, consistent with its profound effects on behavior.

A Bayesian and efficient observer model explains concurrent attractive and repulsive history biases in visual perception

Human perceptual decisions can be repelled away from (repulsive adaptation) or attracted towards recent visual experience (attractive serial dependence). It is currently unclear whether and how these repulsive and attractive biases interact during visual processing and what computational principles underlie these history dependencies. Here we disentangle repulsive and attractive biases by exploring their respective timescales. We find that perceptual decisions are concurrently attracted towards the short-term perceptual history and repelled from stimuli experienced up to minutes into the past. The temporal pattern of short-term attraction and long-term repulsion cannot be captured by an ideal Bayesian observer model alone. Instead, it is well captured by an ideal observer model with efficient encoding and Bayesian decoding of visual information in a slowly changing environment. Concurrent attractive and repulsive history biases in perceptual decisions may thus be the consequence of the need for visual processing to simultaneously satisfy constraints of efficiency and stability.

Attention amplifies neural representations of changes in sensory input at the expense of perceptual accuracy

Attention enhances the neural representations of behaviorally relevant stimuli, typically by a push-pull increase of the neuronal response gain to attended vs. unattended stimuli. This selectively improves perception and consequently behavioral performance. However, to enhance the detectability of stimulus changes, attention might also distort neural representations, compromising accurate stimulus representation. We test this hypothesis by recording neural responses in the visual cortex of rhesus monkeys during a motion direction change detection task. We find that attention indeed amplifies the neural representation of direction changes, beyond a similar effect of adaptation. We further show that humans overestimate such direction changes, providing a perceptual correlate of our neurophysiological observations. Our results demonstrate that attention distorts the neural representations of abrupt sensory changes and consequently perceptual accuracy. This likely represents an evolutionary adaptive mechanism that allows sensory systems to flexibly forgo accurate representation of stimulus features to improve the encoding of stimulus change.

Cortical Microcircuit Mechanisms of Mismatch Negativity and Its Underlying Subcomponents

In the neocortex, neuronal processing of sensory events is significantly influenced by context. For instance, responses in sensory cortices are suppressed to repetitive or redundant stimuli, a phenomenon termed “stimulus-specific adaptation” (SSA). However, in a context in which that same stimulus is novel, or deviates from expectations, neuronal responses are augmented. This augmentation is termed “deviance detection” (DD). This contextual modulation of neural responses is fundamental for how the brain efficiently processes the sensory world to guide immediate and future behaviors. Notably, context modulation is deficient in some neuropsychiatric disorders such as schizophrenia (SZ), as quantified by reduced “mismatch negativity” (MMN), an electroencephalography waveform reflecting a combination of SSA and DD in sensory cortex. Although the role of NMDA-receptor function and other neuromodulatory systems on MMN is established, the precise microcircuit mechanisms of MMN and its underlying components, SSA and DD, remain unknown. When coupled with animal models, the development of powerful precision neurotechnologies over the past decade carries significant promise for making new progress into understanding the neurobiology of MMN with previously unreachable spatial resolution. Currently, rodent models represent the best tool for mechanistic study due to the vast genetic tools available. While quantifying human-like MMN waveforms in rodents is not straightforward, the “oddball” paradigms used to study it in humans and its underlying subcomponents (SSA/DD) are highly translatable across species. Here we summarize efforts published so far, with a focus on cortically measured SSA and DD in animals to maintain relevance to the classically measured MMN, which has cortical origins. While mechanistic studies that measure and contrast both components are sparse, we synthesize a potential set of microcircuit mechanisms from the existing rodent, primate, and human literature. While MMN and its subcomponents likely reflect several mechanisms across multiple brain regions, understanding fundamental microcircuit mechanisms is an important step to understand MMN as a whole. We hypothesize that SSA reflects adaptations occurring at synapses along the sensory-thalamocortical pathways, while DD depends on both SSA inherited from afferent inputs and resulting disinhibition of non-adapted neurons arising from the distinct physiology and wiring properties of local interneuronal subpopulations and NMDA-receptor function.

Interaction of contexts in context-dependent orientation estimation

The processing of a visual stimulus is known to be influenced by the statistics in recent visual history and by the stimulus' visual surround. Such contextual influences lead to perceptually salient phenomena, such as the tilt aftereffect and the tilt illusion. Despite much research on the influence of an isolated context, it is not clear how multiple, possibly competing sources of contextual influence interact. Here, using psychophysical methods, we compared the combined influence of multiple contexts to the sum of the isolated context influences. The results showed large deviations from linear additivity for adjacent or overlapping contexts, and remarkably, clear additivity when the contexts were sufficiently separated. Specifically, for adjacent or overlapping contexts, the combined effect was often lower than the sum of the isolated component effects (sub-additivity), or was more influenced by one component than another (selection). For contexts that were separated in time (600 ms), the combined effect measured the exact sum of the isolated component effects (in degrees of bias). Overall, the results imply an initial compressive transformation during visual processing, followed by selection between the processed parts.

The release from refractoriness hypothesis of N1 of event-related potentials needs reassessment

N1 of event-related potentials (ERPs) is augmented in amplitude in ∼50-150 ms by occasional changes (deviants) in the physical features of a sound repeated at intervals of from ∼400 ms to seconds (standard). The release-from-refractoriness hypothesis links the N1 augmentation to a deviant-feature-specific neural population that is fresh to fully respond as opposed to a standard-feature-specific neural population that is unresponsive due to its post-response refractoriness. The present work explored this hypothesis in the context of ERP studies, behavioral habituation studies and studies on stimulus-specific adaptation (SSA). The idea of hundreds of milliseconds neural population-level refractoriness was observed to be founded upon negative N1 evidence (no observable effect of dishabituating stimuli on N1 to standards - the null hypothesis retained) and merely supported by positive N1 evidence (null hypotheses rejected). This idea was also found to be directly challenged by positive N1 evidence. No conclusive network- or single-neuron-level evidence was found for the refractoriness. Therefore, the validity of the release-from-refractoriness hypothesis of N1 to guide psychophysiological research needs reassessment.

Contingent adaptation in masking and surround suppression

Adaptation is the process that changes a neuron's response based on recent inputs. In the traditional model, a neuron's state of adaptation depends on the recent input to that neuron alone, whereas in a recently introduced model (Hebbian normalization), adaptation depends on the structure of neural correlated firing. In particular, increased response products between pairs of neurons leads to increased mutual suppression. We test a psychophysical prediction of this model: adaptation should depend on 2nd-order statistics of input stimuli. That is, if two stimuli excite two distinct sub-populations of neurons, then presenting those stimuli simultaneously during adaptation should strengthen mutual suppression between those subpopulations. We confirm this prediction in two experiments. In the first, pairing two gratings synchronously during adaptation (i.e., a plaid) rather than asynchronously (interleaving the two gratings in time) leads to increased effectiveness of one pattern for masking the other. In the second, pairing the gratings in a center-surround configuration results in reduced apparent contrast for the central grating when paired with the same surround (as compared with a condition in which the central grating appears with a different surround at test than during adaptation). These results are consistent with the prediction that an increase in response covariance leads to greater mutual suppression between neurons. This effect is detectable both at threshold (masking) and well above threshold (apparent contrast).

Short-Term Attractive Tilt Aftereffects Predicted by a Recurrent Network Model of Primary Visual Cortex

Adaptation is a multi-faceted phenomenon that is of interest in terms of both its function and its potential to reveal underlying neural processing. Many behavioral studies have shown that after exposure to an oriented adapter the perceived orientation of a subsequent test is repulsed away from the orientation of the adapter. This is the well-known Tilt Aftereffect (TAE). Recently, we showed that the dynamics of recurrently connected networks may contribute substantially to the neural changes induced by adaptation, especially on short time scales. Here we extended the network model and made the novel behavioral prediction that the TAE should be attractive, not repulsive, on a time scale of a few 100 ms. Our experiments, using a novel adaptation protocol that specifically targeted adaptation on a short time scale, confirmed this prediction. These results support our hypothesis that recurrent network dynamics may contribute to short-term adaptation. More broadly, they show that understanding the neural processing of visual inputs that change on the time scale of a typical fixation requires a detailed analysis of not only the intrinsic properties of neurons, but also the slow and complex dynamics that emerge from their recurrent connectivity. We argue that this is but one example of how even simple recurrent networks can underlie surprisingly complex information processing, and are involved in rudimentary forms of memory, spatio-temporal integration, and signal amplification.

Population adaptation in efficient balanced networks

Adaptation is a key component of efficient coding in sensory neurons. However, it remains unclear how neurons can provide a stable representation of external stimuli given their history-dependent responses. Here we show that a stable representation is maintained if efficiency is optimized by a population of neurons rather than by neurons individually. We show that spike-frequency adaptation and E/I balanced recurrent connectivity emerge as solutions to a global cost-accuracy tradeoff. The network will redistribute sensory responses from highly excitable neurons to less excitable neurons as the cost of neural activity increases. This does not change the representation at the population level despite causing dynamic changes in individual neurons. By applying this framework to an orientation coding network, we reconcile neural and behavioral findings. Our approach underscores the common mechanisms behind the diversity of neural adaptation and its role in producing a reliable representation of the stimulus while minimizing metabolic cost.

Humans see, hear, feel, taste and smell the world as spiking electrical signals in the brain encoded by sensory neurons. Sensory neurons learn from experience to adjust their activity when exposed repeatedly to the same stimuli. A loud noise or that strange taste in your mouth might be alarming at first but soon sensory neurons dial down their response as the sensations become familiar, saving energy.

This neural adaptation has been observed experimentally in individual cells, but it raises questions about how the brain deciphers signals from sensory neurons. How do downstream neurons learn whether the reduced activity from sensory neurons is a result of getting used to a feeling, or a signal encoding a weaker stimulus? The energy saved through neural adaptation cannot come at the expense of sensing the world less accurately. Neural networks in our brain have evidently evolved to code information in a way that is both efficient and accurate, and computational neuroscientists want to know how. There has been great interest in reproducing neural networks for machine learning, but computer models have not yet captured the mechanisms of neural coding with the same eloquence as the brain.

Gutierrez and Denève used computational models to test how networks of sensory neurons encode a sensible signal whilst adapting to new or repeated stimuli. The experiments showed that optimal neural networks are highly cooperative and share the load when encoding information. Individual neurons are more sensitive to certain stimuli but the information is encoded across the network so that if one neuron becomes fatigued, others receptive to the same stimuli can respond. In this way, the network is both responsive and reliable, producing a steady output which can be readily interpreted by downstream neurons.

Exploring how stimuli are encoded in the brain, Gutierrez and Denève have shown that the activity of one neuron does not represent the whole picture of neural adaptation. The brain has evolved to adapt to continuous stimuli for efficiency at both the level of individual neurons and across balanced networks of interconnected neurons. It takes many neurons to accurately represent the world, but only as a network can the brain sustain a steady picture.

Relating Divisive Normalization to Neuronal Response Variability

Cortical responses to repeated presentations of a sensory stimulus are variable. This variability is sensitive to several stimulus dimensions, suggesting that it may carry useful information beyond the average firing rate. Many experimental manipulations that affect response variability are also known to engage divisive normalization, a widespread operation that describes neuronal activity as the ratio of a numerator (representing the excitatory stimulus drive) and denominator (the normalization signal). Although it has been suggested that normalization affects response variability, we lack a quantitative framework to determine the relation between the two. Here we extend the standard normalization model, by treating the numerator and the normalization signal as variable quantities. The resulting model predicts a general stabilizing effect of normalization on neuronal responses, and allows us to infer the single-trial normalization strength, a quantity that cannot be measured directly. We test the model on neuronal responses to stimuli of varying contrast, recorded in primary visual cortex of male macaques. We find that neurons that are more strongly normalized fire more reliably, and response variability and pairwise noise correlations are reduced during trials in which normalization is inferred to be strong. Our results thus suggest a novel functional role for normalization, namely, modulating response variability. Our framework could enable a direct quantification of the impact of single-trial normalization strength on the accuracy of perceptual judgments, and can be readily applied to other sensory and nonsensory factors.SIGNIFICANCE STATEMENT Divisive normalization is a widespread neural operation across sensory and nonsensory brain areas, which describes neuronal responses as the ratio between the excitatory drive to the neuron and a normalization signal. Normalization plays a key role in several important computations, including adjusting the neuron's dynamic range, reducing redundancy, and facilitating probabilistic inference. However, the relation between normalization and neuronal response variability (a fundamental aspect of neural coding) remains unclear. Here we develop a new model and test it on primary visual cortex responses. We show that normalization has a stabilizing effect on neuronal activity, beyond the known suppression of firing rate. This modulation of variability suggests a new functional role for normalization in neural coding and perception.

Coding Principles in Adaptation

Adaptation is a common principle that recurs throughout the nervous system at all stages of processing. This principle manifests in a variety of phenomena, from spike frequency adaptation, to apparent changes in receptive fields with changes in stimulus statistics, to enhanced responses to unexpected stimuli. The ubiquity of adaptation leads naturally to the question: What purpose do these different types of adaptation serve? A diverse set of theories, often highly overlapping, has been proposed to explain the functional role of adaptive phenomena. In this review, we discuss several of these theoretical frameworks, highlighting relationships among them and clarifying distinctions. We summarize observations of the varied manifestations of adaptation, particularly as they relate to these theoretical frameworks, focusing throughout on the visual system and making connections to other sensory systems.

Feature-specific prediction errors for visual mismatch

Predictive coding (PC) theory posits that our brain employs a predictive model of the environment to infer the causes of its sensory inputs. A fundamental but untested prediction of this theory is that the same stimulus should elicit distinct precision weighted prediction errors (pwPEs) when different (feature-specific) predictions are violated, even in the absence of attention. Here, we tested this hypothesis using functional magnetic resonance imaging (fMRI) and a multi-feature roving visual mismatch paradigm where rare changes in either color (red, green), or emotional expression (happy, fearful) of faces elicited pwPE responses in human participants. Using a computational model of learning and inference, we simulated pwPE and prediction trajectories of a Bayes-optimal observer and used these to analyze changes in blood oxygen level dependent (BOLD) responses to changes in color and emotional expression of faces while participants engaged in a distractor task. Controlling for visual attention by eye-tracking, we found pwPE responses to unexpected color changes in the fusiform gyrus. Conversely, unexpected changes of facial emotions elicited pwPE responses in cortico-thalamo-cerebellar structures associated with emotion and theory of mind processing. Predictions pertaining to emotions activated fusiform, occipital and temporal areas. Our results are consistent with a general role of PC across perception, from low-level to complex and socially relevant object features, and suggest that monitoring of the social environment occurs continuously and automatically, even in the absence of attention.

Does fMRI repetition suppression reveal mirror neuron activity in the human brain? Insights from univariate and multivariate analysis

Mirror neurons (MN) have been proposed as the neural substrate for a wide range of clinical, social and cognitive phenomena. Over the last decade, a commonly used tool for investigating MN activity in the human brain has been functional magnetic resonance (fMRI) repetition suppression (RS) paradigms. However, the available evidence is mixed, largely owing to inconsistent application of the methodological criteria necessary to infer MN properties. This raises concerns about the degree to which one can infer the presence (or absence) of MN activity from earlier accounts that adopted RS paradigms. We aimed to clarify this issue using a well-validated fMRI RS paradigm and tested for mirror properties by rigorously applying the widely accepted criteria necessary to demonstrate MN activity using traditional univariate techniques and Multivariate Pattern Analysis (MVPA). While univariate whole brain analysis in healthy adults showed uni-modal RS effects within the supplementary motor area, no evidence for cross-modal RS effects consistent with mirror neuron activity was found. MVPA on the other hand revealed a region along the anterior intraparietal sulcus that met the criteria for MN activity. Taken together, these results clarify disparate evidence from earlier RS studies, highlighting that traditional univariate analysis of RS data may not be sensitive for detecting MN activity when rigorously applying the requisite criteria. In light of these findings, we recommend that short of increasing sample sizes substantially, future studies using RS paradigms to investigate MNs across the human brain consider the use of MVPA.

Stimulus- and goal-oriented frameworks for understanding natural vision

Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.

Developmental exposure to environmentally relevant concentrations of bifenthrin alters transcription of mTOR and ryanodine receptor-dependent signaling molecules and impairs predator avoidance behavior across early life stages in inland silversides (Menidia beryllina)

Altered transcription of calcium-dependent signaling cascades involving the ryanodine receptor (RyR) and mechanistic target of rapamycin (mTOR) in response to environmental exposures have been described in model vertebrates, including zebrafish, while the relevance for wild fishes remains unknown. To address this knowledge gap, we exposed the euryhaline model species Menidia beryllina (inland silversides) to the insecticide bifenthrin, a known modulator of calcium signaling. The main objectives of this study were to determine: (1) whether exposure of developing silversides to environmentally relevant concentrations of bifenthrin alters their behavior; and (2) whether behavioral changes correlate with altered expression of genes involved in RyR and mTOR-dependent signaling pathways. At six hours post fertilization (hpf), inland silversides were exposed to bifenthrin at 3, 27 and 122 ng/L until 7 days post fertilization (dpf, larvae hatched at 6dpf), followed by a 14-day recovery period in uncontaminated water. Transcriptional responses were measured at 5, 7 and 21 dpf; locomotor behavior following external stimuli and response to an olfactory predator cue were assessed at 7 and 21 dpf. Bifenthrin elicited significant non-monotonic transcriptional responses in the majority of genes examined at 5 dpf and at 21 dpf. Bifenthrin also significantly altered predator avoidance behavior via olfactory mechanisms with main effects identified for animals exposed to 3 and 27 ng/L. Behavioral effects were not detected in response to visual stimuli during acute exposure, but were significant in the predator-cue assessment following the recovery period, suggesting delayed and long-term effects of early developmental exposures to bifenthrin. Our findings demonstrate that at picomolar (pM) concentrations, which are often not represented in ecotoxicological studies, bifenthrin perturbs early development of inland silversides. These developmental impacts are manifested behaviorally at later life stages, specifically as altered patterns of predator avoidance behavior, which have been correlated with population decline. Collectively, these data suggest that bifenthrin may be negatively impacting wild fish populations.

fMRI evidence of aberrant neural adaptation for objects in schizophrenia and bipolar disorder

Functional magnetic resonance imaging (fMRI) adaptation (also known as fMRI repetition suppression) has been widely used to characterize stimulus selectivity in vivo, a fundamental feature of neuronal processing in the brain. We investigated whether SZ patients and BD patients show aberrant fMRI adaptation for object perception. About 52 SZ patients, 55 BD patients, and 53 community controls completed an object discrimination task with three conditions: the same object presented twice, two exemplars from the same category, and two exemplars from different categories. We also administered two functional localizer tasks. A region of interest analysis was employed to evaluate a priori hypotheses about the lateral occipital complex (LOC) and early visual cortex (EVC). An exploratory whole brain analysis was also conducted. In the LOC and EVC, controls showed the expected reduced fMRI responses to repeated presentation of the same objects compared with different objects (i.e., fMRI adaptation for objects, p < .001). SZ patients showed an adaptation effect that was significantly smaller compared with controls. BD patients showed a lack of fMRI adaptation. The whole brain analyses showed enhanced fMRI responses to repeated presentation of the same objects only in BD patients in several brain regions including anterior cingulate cortex. This study was the first to employ fMRI adaptation for objects in SZ and BD. The current findings provide empirical evidence of aberrant fMRI adaptation in the visual cortex in SZ and BD, but in distinctly different ways.

Adaptive sensory coding of gaze direction in schizophrenia

Schizophrenia has been associated with differences in how the visual system processes sensory input. A fundamental mechanism that regulates sensory processing in the brain is gain control, whereby the responses of sensory neurons to a given stimulus are modulated in accordance with the spatial and temporal context. Some studies indicate an impairment of certain cortical gain control mechanisms in schizophrenia in low-level vision, reflected, for instance, in how the visual appearance of a stimulus is affected by the presence of other stimuli around it. In the present study, we investigated higher-level, social vision in schizophrenia, namely the perception of other people's direction of gaze (i.e. a type of face processing). Recent computational modelling work indicates that perceptual aftereffects-changes in perception that occur following repeated exposure to faces that display a specific direction of gaze-are indicative of two distinct forms of gain control involved in the coding of gaze direction across sensory neurons. We find that individuals with schizophrenia display strong perceptual aftereffects following repeated exposure to faces with averted gaze, and a modelling analysis indicates similarly robust gain control in the form of (i) short-term adjustment of channel sensitivities in response to the recent sensory history and (ii) divisive normalization of the encoded gaze direction. Together, this speaks to the typical coding of other people's direction of gaze in the visual system in schizophrenia, including flexible gain control, despite the social-cognitive impairments that can occur in this condition.

Temporal Contingencies Determine Whether Adaptation Strengthens or Weakens Normalization

A fundamental and nearly ubiquitous feature of sensory encoding is that neuronal responses are strongly influenced by recent experience, or adaptation. Theoretical and computational studies have proposed that many adaptation effects may result in part from changes in the strength of normalization signals. Normalization is a "canonical" computation in which a neuron's response is modulated (normalized) by the pooled activity of other neurons. Here, we test whether adaptation can alter the strength of cross-orientation suppression, or masking, a paradigmatic form of normalization evident in primary visual cortex (V1). We made extracellular recordings of V1 neurons in anesthetized male macaques and measured responses to plaid stimuli composed of two overlapping, orthogonal gratings before and after prolonged exposure to two distinct adapters. The first adapter was a plaid consisting of orthogonal gratings and led to stronger masking. The second adapter presented the same orthogonal gratings in an interleaved manner and led to weaker masking. The strength of adaptation's effects on masking depended on the orientation of the test stimuli relative to the orientation of the adapters, but was independent of neuronal orientation preference. Changes in masking could not be explained by altered neuronal responsivity. Our results suggest that normalization signals can be strengthened or weakened by adaptation depending on the temporal contingencies of the adapting stimuli. Our findings reveal an interplay between two widespread computations in cortical circuits, adaptation and normalization, that enables flexible adjustments to the structure of the environment, including the temporal relationships among sensory stimuli.SIGNIFICANCE STATEMENT Two fundamental features of sensory responses are that they are influenced by adaptation and that they are modulated by the activity of other nearby neurons via normalization. Our findings reveal a strong interaction between these two aspects of cortical computation. Specifically, we show that cross-orientation masking, a form of normalization, can be strengthened or weakened by adaptation depending on the temporal contingencies between sensory inputs. Our findings support theoretical proposals that some adaptation effects may involve altered normalization and offer a network-based explanation for how cortex adjusts to current sensory demands.

Adaptation to the Direction of Others' Gaze: A Review

The direction of another person’s gaze provides us with a strong cue to their intentions and future actions, and, correspondingly, the human visual system has evolved to extract information about others’ gaze from the sensory stream. The perception of gaze is a remarkably plastic process: adaptation to a particular direction of gaze over a matter of seconds or minutes can cause marked aftereffects in our sense of where other people are looking. In this review, we first discuss the measurement, specificity, and neural correlates of gaze aftereffects. We then examine how studies that have explored the perceptual and neural determinants of gaze aftereffects have provided key insights into the nature of how other people’s gaze direction is represented within the visual hierarchy. This includes the level of perceptual representation of gaze direction (e.g., relating to integrated vs. local facial features) and the interaction of this system with higher-level social-cognitive functions, such as theory of mind. Moreover, computational modeling of data from behavioral studies of gaze adaptation allows us to make inferences about the functional principles that govern the neural encoding of gaze direction. This in turn provides a foundation for testing computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism.

Reduced auditory cortical adaptation in autism spectrum disorder

Adaptation is a fundamental property of cortical neurons and has been suggested to be altered in individuals with autism spectrum disorder (ASD). We used fMRI to measure adaptation induced by repeated audio-visual stimulation in early sensory cortical areas in individuals with ASD and neurotypical (NT) controls. The initial transient responses were equivalent between groups in both visual and auditory cortices and when stimulation occurred with fixed-interval and randomized-interval timing. However, in auditory but not visual cortex, the post-transient sustained response was greater in individuals with ASD than NT controls in the fixed-interval timing condition, reflecting reduced adaptation. Further, individual differences in the sustained response in auditory cortex correlated with ASD symptom severity. These findings are consistent with hypotheses that ASD is associated with increased neural responsiveness but that responsiveness differences only manifest after repeated stimulation, are specific to the temporal pattern of stimulation, and are confined to specific cortical regions.

GABAergic and cholinergic modulation of repetition suppression in inferior temporal cortex

Neurons in many brain areas of different species reduce their response when a stimulus is repeated. Such adaptation or repetition suppression is prevalent in inferior temporal (IT) cortex. The mechanisms underlying repetition suppression in IT are still poorly understood. Studies in rodents and in-vitro experiments suggest that acetylcholine and GABA can contribute to repetition suppression by interacting with fatigue-related or local adaptation mechanisms. Here, we examined the contribution of cholinergic and GABAergic mechanisms to repetition suppression in macaque IT, using an adaptation paradigm in which familiar images were presented successively with a short interstimulus interval. We found that intracortical local injections of acetylcholine and of the GABA_A receptor antagonist Gabazine both increased repetition suppression in awake macaque IT. The increased repetition suppression was observed for both spiking activity and local field potential power. The latter was present mainly for frequencies below 50 Hz, spectral bands that typically do not show consistent repetition suppression in IT. Although increased with drug application, repetition suppression remained stimulus selective. These findings agree with the hypothesis that repetition suppression of IT neurons mainly results from suppressed input from upstream and other IT neurons but depend less on intrinsic neuronal fatigue.

Multiple timescales of normalized value coding underlie adaptive choice behavior

Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.

Distracter suppression dominates attentional modulation of responses to multiple stimuli inside the receptive fields of middle temporal neurons

Single-cell studies in macaques have shown that attending to one of two stimuli, positioned inside a visual neuron's receptive field (RF), modulates the neuron's response to reflect the features of the attended stimulus. Such a modulation has been described as a 'push-pull' effect relative to a reference response: a neuron's response increases when attention is directed to a preferred stimulus, and decreases when attention is directed to a non-preferred stimulus. It has been further suggested that the response increase when attending to a preferred stimulus is the predominant effect. Here, we show that the observed attentional modulation depends on the reference response. We recorded neuronal responses in motion processing area middle temporal (MT) of macaques to two moving random dot patterns positioned inside neurons' RF. One pattern always moved in the neuron's antipreferred direction (null pattern), while the other moved in one of 12 directions (tuning pattern). At the beginning of a trial, a cue indicated the location and direction of the target. The animal was required to release a lever when a change in the target direction occurred, and to ignore changes in the distracter. Relative to neurons' initial responses to the dual stimuli (when attention was less likely to modulate responses), attending to the tuning pattern did not significantly modulate responses over time. However, attending to the null pattern progressively decreased responses over time. These results were quantitatively described by filter and input gain models, characterising a predominant response suppression relative to a reference response, rather than response enhancement.

Psychophysical evidence for the number sense

It is now clear that most animals, including humans, possess an ability to rapidly estimate number. Some have questioned whether this ability arises from dedicated numerosity mechanisms, or is derived indirectly from judgements of density or other attributes. We describe a series of psychophysical experiments, largely using adaptation techniques, which demonstrate clearly the existence of a number sense in humans. The number sense is truly general, extending over space, time and sensory modality, and is closely linked with action. We further show that when multiple cues are present, numerosity emerges as the natural dimension for discrimination. However, when element density increases past a certain level, the elements become too crowded to parse, and the scene is perceived as a texture rather than array of elements. The two different regimes are psychophysically discriminable in that they follow distinct psychophysical laws, and show different dependencies on eccentricity, luminance levels and effects of perceptual grouping. The distinction is important, as the ability to discriminate numerosity, but not texture, correlates with formal maths skills.

This article is part of the discussion meeting issue ‘The origins of numerical abilities’.

Evidence for distinct levels of neural adaptation to both coherent and incoherently moving visual surfaces in visual area hMT

Visual adaptation describes the processes by which the visual system alters its operating properties in response to changes in the environment. It is one of the mechanisms controlling visual perceptual bistability - when two perceptual solutions are available - by controlling the duration of each percept. Moving plaids are an example of such ambiguity. They can be perceived as two surfaces sliding incoherently over each other or as a single coherent surface. Here, we investigated, using fMRI, whether activity in the human motion complex (hMT+), a region tightly related to the perceptual integration of visual motion, is modulated by distinct forms of visual adaptation to coherent or incoherent perception of moving plaids. Our hypothesis is that exposure to global coherent or incoherent moving stimuli leads to different levels of measurable adaptation, reflected in hMT+ activity. We found that the strength of the measured visual adaptation effect depended on whether subjects integrated (coherent percept) or segregated (incoherent percept) surface motion signals. Visual motion adaptation was significant both for coherent motion and globally incoherent surface motion. Although not as strong as to the coherent percept, visual adaptation due to the incoherent percept also affects hMT+. This shows that adaptation can contribute to regulate percept duration during visual bistability, with distinct weights, depending on the type of percept. Our findings suggest a link between bistability and adaptation mechanisms, both due to coherent and incoherent motion percepts, but in an asymmetric manner. These asymmetric adaptation weights have strong implications in models of perceptual decision and may explain asymmetry of perceptual interpretation periods.

Cortical Interneurons Differentially Shape Frequency Tuning following Adaptation

Neuronal stimulus selectivity is shaped by feedforward and recurrent excitatory-inhibitory interactions. In the auditory cortex (AC), parvalbumin- (PV) and somatostatin-positive (SOM) inhibitory interneurons differentially modulate frequency-dependent responses of excitatory neurons. Responsiveness of neurons in the AC to sound is also dependent on stimulus history. We found that the inhibitory effects of SOMs and PVs diverged as a function of adaptation to temporal repetition of tones. Prior to adaptation, suppressing either SOM or PV inhibition drove both increases and decreases in excitatory spiking activity. After adaptation, suppressing SOM activity caused predominantly disinhibitory effects, whereas suppressing PV activity still evoked bi-directional changes. SOM, but not PV-driven inhibition, dynamically modulated frequency tuning with adaptation. Unlike PV-driven inhibition, SOM-driven inhibition elicited gain-like increases in frequency tuning reflective of adaptation. Our findings suggest that distinct cortical interneurons differentially shape tuning to sensory stimuli across the neuronal receptive field, altering frequency selectivity of excitatory neurons during adaptation.

Experimentally derived model shows that adaptation acts as a powerful spatiotemporal filter of visual responses in the rat collicular neurons

Adaptation of visual responses enhances visual information processing mainly by preserving the full dynamic range of neuronal responses during changing light conditions and is found throughout the whole visual system. Although adaptation in the primate superior colliculus neurons has received much attention little is known about quantitative properties of such adaptation in rodents, an increasingly important model in vision research. By employing single unit recordings, we demonstrate that in the rat collicular neurons visual responses are shaped by at least two forms of adaptation. When visual stimuli were repeatedly presented in the same location, visual responses were reduced in the majority of single units. However, when the adaptor stimulus was outside a small diameter receptive field (RF), responses to stimulus onset but not offset were enhanced in the majority of units. Responses to stimulus offset were reduced less and recovered faster than responses to stimulus onset and the effect was limited to a fraction of RF area. Simulations showed that such adaptation acted as a powerful spatiotemporal filter and could explain several tuning properties of collicular neurons. These results demonstrate that in rodents the adaption of visual responses has a complex spatiotemporal structure and can profoundly shape visual information processing.

Is the straddle effect in contrast perception limited to second-order spatial vision?

Previous work on the straddle effect in contrast perception (Foley, 2011; Graham & Wolfson, 2007; Wolfson & Graham, 2007, 2009) has used visual patterns and observer tasks of the type known as spatially second-order. After adaptation of about 1 s to a grid of Gabor patches all at one contrast, a second-order test pattern composed of two different test contrasts can be easy or difficult to perceive correctly. When the two test contrasts are both a bit less (or both a bit greater) than the adapt contrast, observers perform very well. However, when the two test contrasts straddle the adapt contrast (i.e., one of the test contrasts is greater than the adapt contrast and the other is less), performance drops dramatically. To explain this drop in performance-the straddle effect-we have suggested a contrast-comparison process. We began to wonder: Are second-order patterns necessary for the straddle effect? Here we show that the answer is "no". We demonstrate the straddle effect using spatially first-order visual patterns and several different observer tasks. We also see the effect of contrast normalization using first-order visual patterns here, analogous to our prior findings with second-order visual patterns. We did find one difference between first- and second-order tasks: Performance in the first-order tasks was slightly lower. This slightly lower performance may be due to slightly greater memory load. For many visual scenes, the important quantity in human contrast processing may not be monotonic with physical contrast but may be something more like the unsigned difference between current contrast and recent average contrast.