The effect of neural adaptation on population coding accuracy

Adaptation of the inferior temporal neurons and efficient visual processing

Numerous studies examining the responses of individual neurons in the inferior temporal (IT) cortex have revealed their characteristics such as two-dimensional or three-dimensional shape tuning, objects, or category selectivity. While these basic selectivities have been studied assuming that their response to stimuli is relatively stable, physiological experiments have revealed that the responsiveness of IT neurons also depends on visual experience. The activity changes of IT neurons occur over various time ranges; among these, repetition suppression (RS), in particular, is robustly observed in IT neurons without any behavioral or task constraints. I observed a similar phenomenon in the ventral visual neurons in macaque monkeys while they engaged in free viewing and actively fixated on one consistent object multiple times. This observation indicates that the phenomenon also occurs in natural situations during which the subject actively views stimuli without forced fixation, suggesting that this phenomenon is an everyday occurrence and widespread across regions of the visual system, making it a default process for visual neurons. Such short-term activity modulation may be a key to understanding the visual system; however, the circuit mechanism and the biological significance of RS remain unclear. Thus, in this review, I summarize the observed modulation types in IT neurons and the known properties of RS. Subsequently, I discuss adaptation in vision, including concepts such as efficient and predictive coding, as well as the relationship between adaptation and psychophysical aftereffects. Finally, I discuss some conceptual implications of this phenomenon as well as the circuit mechanisms and the models that may explain adaptation as a fundamental aspect of visual processing.

Calibrating Bayesian Decoders of Neural Spiking Activity

Accurately decoding external variables from observations of neural activity is a major challenge in systems neuroscience. Bayesian decoders, which provide probabilistic estimates, are some of the most widely used. Here we show how, in many common settings, the probabilistic predictions made by traditional Bayesian decoders are overconfident. That is, the estimates for the decoded stimulus or movement variables are more certain than they should be. We then show how Bayesian decoding with latent variables, taking account of low-dimensional shared variability in the observations, can improve calibration, although additional correction for overconfidence is still needed. Using data from males, we examine (1) decoding the direction of grating stimuli from spike recordings in the primary visual cortex in monkeys, (2) decoding movement direction from recordings in the primary motor cortex in monkeys, (3) decoding natural images from multiregion recordings in mice, and (4) decoding position from hippocampal recordings in rats. For each setting, we characterize the overconfidence, and we describe a possible method to correct miscalibration post hoc. Properly calibrated Bayesian decoders may alter theoretical results on probabilistic population coding and lead to brain-machine interfaces that more accurately reflect confidence levels when identifying external variables.

Neuronal Population Activity in Macaque Visual Cortices Dynamically Changes through Repeated Fixations in Active Free Viewing

During free viewing, we move our eyes and fixate on objects to recognize the visual scene of our surroundings. To investigate the neural representation of objects in this process, we studied individual and population neuronal activity in three different visual regions of the brains of macaque monkeys (Macaca fuscata): the primary and secondary visual cortices (V1, V2) and the inferotemporal cortex (IT). We designed a task where the animal freely selected objects in a stimulus image to fixate on while we examined the relationship between spiking activity, the order of fixations, and the fixated objects. We found that activity changed across repeated fixations on the same object in all three recorded areas, with observed reductions in firing rates. Furthermore, the responses of individual neurons became sparser and more selective with individual objects. The population activity for individual objects also became distinct. These results suggest that visual neurons respond dynamically to repeated input stimuli through a smaller number of spikes, thereby allowing for discrimination between individual objects with smaller energy.

The broad edge of synchronization: Griffiths effects and collective phenomena in brain networks

Many of the amazing functional capabilities of the brain are collective properties stemming from the interactions of large sets of individual neurons. In particular, the most salient collective phenomena in brain activity are oscillations, which require the synchronous activation of many neurons. Here, we analyse parsimonious dynamical models of neural synchronization running on top of synthetic networks that capture essential aspects of the actual brain anatomical connectivity such as a hierarchical-modular and core-periphery structure. These models reveal the emergence of complex collective states with intermediate and flexible levels of synchronization, halfway in the synchronous-asynchronous spectrum. These states are best described as broad Griffiths-like phases, i.e. an extension of standard critical points that emerge in structurally heterogeneous systems. We analyse different routes (bifurcations) to synchronization and stress the relevance of 'hybrid-type transitions' to generate rich dynamical patterns. Overall, our results illustrate the complex interplay between structure and dynamics, underlining key aspects leading to rich collective states needed to sustain brain functionality. This article is part of the theme issue 'Emergent phenomena in complex physical and socio-technical systems: from cells to societies'.

Efficient and adaptive sensory codes

The ability to adapt to changes in stimulus statistics is a hallmark of sensory systems. Here, we developed a theoretical framework that can account for the dynamics of adaptation from an information processing perspective. We use this framework to optimize and analyze adaptive sensory codes, and we show that codes optimized for stationary environments can suffer from prolonged periods of poor performance when the environment changes. To mitigate the adversarial effects of these environmental changes, sensory systems must navigate tradeoffs between the ability to accurately encode incoming stimuli and the ability to rapidly detect and adapt to changes in the distribution of these stimuli. We derive families of codes that balance these objectives, and we demonstrate their close match to experimentally observed neural dynamics during mean and variance adaptation. Our results provide a unifying perspective on adaptation across a range of sensory systems, environments, and sensory tasks.

Cholinergic Modulation Promotes Attentional Modulation in Primary Visual Cortex- A Modeling Study

Attention greatly influences sensory neural processing by enhancing firing rates of neurons that represent the attended stimuli and by modulating their tuning properties. The cholinergic system is believed to partly mediate the attention contingent improvement of cortical processing by influencing neuronal excitability, synaptic transmission and neural network characteristics. Here, we used a biophysically based model to investigate the mechanisms by which cholinergic system influences sensory information processing in the primary visual cortex (V1) layer 4C. The physiological properties and architectures of our model were inspired by experimental data and include feed-forward input from dorsal lateral geniculate nucleus that sets up orientation preference in V1 neural responses. When including a cholinergic drive, we found significant sharpening in orientation selectivity, desynchronization of LFP gamma power and spike-field coherence, decreased response variability and correlation reduction mostly by influencing intracortical interactions and by increasing inhibitory drive. Our results indicated that these effects emerged due to changes specific to the behavior of the inhibitory neurons. The behavior of our model closely resembles the effects of attention on neural activities in monkey V1. Our model suggests precise mechanisms through which cholinergic modulation may mediate the effects of attention in the visual cortex.

Coding Principles in Adaptation

Adaptation is a common principle that recurs throughout the nervous system at all stages of processing. This principle manifests in a variety of phenomena, from spike frequency adaptation, to apparent changes in receptive fields with changes in stimulus statistics, to enhanced responses to unexpected stimuli. The ubiquity of adaptation leads naturally to the question: What purpose do these different types of adaptation serve? A diverse set of theories, often highly overlapping, has been proposed to explain the functional role of adaptive phenomena. In this review, we discuss several of these theoretical frameworks, highlighting relationships among them and clarifying distinctions. We summarize observations of the varied manifestations of adaptation, particularly as they relate to these theoretical frameworks, focusing throughout on the visual system and making connections to other sensory systems.

Selective attenuation of Ether-a-go-go related K+ currents by endogenous acetylcholine reduces spike-frequency adaptation and network correlation

Most neurons do not simply convert inputs into firing rates. Instead, moment-to-moment firing rates reflect interactions between synaptic inputs and intrinsic currents. Few studies investigated how intrinsic currents function together to modulate output discharges and which of the currents attenuated by synthetic cholinergic ligands are actually modulated by endogenous acetylcholine (ACh). In this study we optogenetically stimulated cholinergic fibers in rat neocortex and find that ACh enhances excitability by reducing Ether-à-go-go Related Gene (ERG) K+ current. We find ERG mediates the late phase of spike-frequency adaptation in pyramidal cells and is recruited later than both SK and M currents. Attenuation of ERG during coincident depolarization and ACh release leads to reduced late phase spike-frequency adaptation and persistent firing. In neuronal ensembles, attenuating ERG enhanced signal-to-noise ratios and reduced signal correlation, suggesting that these two hallmarks of cholinergic function in vivo may result from modulation of intrinsic properties.

Adaptation decorrelates shape representations

Perception and neural responses are modulated by sensory history. Visual adaptation, an example of such an effect, has been hypothesized to improve stimulus discrimination by decorrelating responses across a set of neural units. While a central theoretical model, behavioral and neural evidence for this theory is limited and inconclusive. Here, we use a parametric 3D shape-space to test whether adaptation decorrelates shape representations in humans. In a behavioral experiment with 20 subjects, we find that adaptation to a shape class improves discrimination of subsequently presented stimuli with similar features. In a BOLD fMRI experiment with 10 subjects, we observe that adaptation to a shape class decorrelates the multivariate representations of subsequently presented stimuli with similar features in object-selective cortex. These results support the long-standing proposal that adaptation improves perceptual discrimination and decorrelates neural representations, offering insights into potential underlying mechanisms.

Adaptation is thought to improve discrimination by pulling neural representations of similar stimuli farther apart. Here, the authors separately show that adaptation to a 3D shape class leads to better discrimination performance on similar shapes, and activity patterns diverge in object selective cortical areas.

Unconscious Biases in Neural Populations Coding Multiple Stimuli

Throughout the nervous system, information is commonly coded in activity distributed over populations of neurons. In idealized situations where a single, continuous stimulus is encoded in a homogeneous population code, the value of the encoded stimulus can be read out without bias. However, in many situations, multiple stimuli are simultaneously present; for example, multiple motion patterns might overlap. Here we find that when multiple stimuli that overlap in their neural representation are simultaneously encoded in the population, biases in the read-out emerge. Although the bias disappears in the absence of noise, the bias is remarkably persistent at low noise levels. The bias can be reduced by competitive encoding schemes or by employing complex decoders. To study the origin of the bias, we develop a novel general framework based on gaussian processes that allows an accurate calculation of the estimate distributions of maximum likelihood decoders, and reveals that the distribution of estimates is bimodal for overlapping stimuli. The results have implications for neural coding and behavioral experiments on, for instance, overlapping motion patterns.

Effects of V1 surround modulation tuning on visual saliency and the tilt illusion

Neurons in the primary visual cortex respond to oriented stimuli placed in the center of their receptive field, yet their response is modulated by stimuli outside the receptive field (the surround). Classically, this surround modulation is assumed to be strongest if the orientation of the surround stimulus aligns with the neuron's preferred orientation, irrespective of the actual center stimulus. This neuron-dependent surround modulation has been used to explain a wide range of psychophysical phenomena, such as biased tilt perception and saliency of stimuli with contrasting orientation. However, several neurophysiological studies have shown that for most neurons surround modulation is instead center dependent: it is strongest if the surround orientation aligns with the center stimulus. As the impact of such center-dependent modulation on the population level is unknown, we examine this using computational models. We find that with neuron-dependent modulation the biases in orientation coding, commonly used to explain the tilt illusion, are larger than psychophysically reported, but disappear with center-dependent modulation. Therefore we suggest that a mixture of the two modulation types is necessary to quantitatively explain the psychophysically observed biases. Next, we find that under center-dependent modulation average population responses are more sensitive to orientation differences between stimuli, which in theory could improve saliency detection. However, this effect depends on the specific saliency model. Overall, our results thus show that center-dependent modulation reduces coding bias, while possibly increasing the sensitivity to salient features. NEW & NOTEWORTHY Neural responses in the primary visual cortex are modulated by stimuli surrounding the receptive field. Most earlier studies assume this modulation depends on the neuron's tuning properties, but experiments have shown that instead it depends mostly on the stimulus characteristics. We show that this simple change leads to neural coding that is less biased and under some conditions more sensitive to salient features.

Patient-specific computational modeling of cortical spreading depression via diffusion tensor imaging

Cortical spreading depression, a depolarization wave originating in the visual cortex and traveling towards the frontal lobe, is commonly accepted as a correlate of migraine visual aura. As of today, little is known about the mechanisms that can trigger or stop such phenomenon. However, the complex and highly individual characteristics of the brain cortex suggest that the geometry might have a significant impact in supporting or contrasting the propagation of cortical spreading depression. Accurate patient-specific computational models are fundamental to cope with the high variability in cortical geometries among individuals, but also with the conduction anisotropy induced in a given cortex by the complex neuronal organisation in the grey matter. In this paper, we integrate a distributed model for extracellular potassium concentration with patient-specific diffusivity tensors derived locally from diffusion tensor imaging data.

Adaptation towards scale-free dynamics improves cortical stimulus discrimination at the cost of reduced detection

Fundamental to the function of nervous systems is the ability to reorganize to cope with changing sensory input. Although well-studied in single neurons, how such adaptive versatility manifests in the collective population dynamics and function of cerebral cortex remains unknown. Here we measured population neural activity with microelectrode arrays in turtle visual cortex while visually stimulating the retina. First, we found that, following the onset of stimulation, adaptation tunes the collective population dynamics towards a special regime with scale-free spatiotemporal activity, after an initial large-scale transient response. Concurrently, we observed an adaptive tradeoff between two important aspects of population coding-sensory detection and discrimination. As adaptation tuned the cortex toward scale-free dynamics, stimulus discrimination was enhanced, while stimulus detection was reduced. Finally, we used a network-level computational model to show that short-term synaptic depression was sufficient to mechanistically explain our experimental results. In the model, scale-free dynamics emerge only when the model operates near a special regime called criticality. Together our model and experimental results suggest unanticipated functional benefits and costs of adaptation near criticality in visual cortex.

Information Rate Analysis of a Synaptic Release Site Using a Two-State Model of Short-Term Depression

Synapses are the communication channels for information transfer between neurons; these are the points at which pulse-like signals are converted into the stochastic release of quantized amounts of chemical neurotransmitter. At many synapses, prior neuronal activity depletes synaptic resources, depressing subsequent responses of both spontaneous and spike-evoked releases. We analytically compute the information transmission rate of a synaptic release site, which we model as a binary asymmetric channel. Short-term depression is incorporated by assigning the channel a memory of depth one. A successful release, whether spike evoked or spontaneous, decreases the probability of a subsequent release; if no release occurs on the following time step, the release probabilities recover back to their default values. We prove that synaptic depression can increase the release site's information rate if spontaneous release is more strongly depressed than spike-evoked release. When depression affects spontaneous and evoked release equally, the information rate must invariably decrease, even when the rate is normalized by the resources used for synaptic transmission. For identical depression levels, we analytically disprove the hypothesis, at least in this simplified model, that synaptic depression serves energy- and information-efficient encoding.

Specificity and timescales of cortical adaptation as inferences about natural movie statistics

Adaptation is a phenomenological umbrella term under which a variety of temporal contextual effects are grouped. Previous models have shown that some aspects of visual adaptation reflect optimal processing of dynamic visual inputs, suggesting that adaptation should be tuned to the properties of natural visual inputs. However, the link between natural dynamic inputs and adaptation is poorly understood. Here, we extend a previously developed Bayesian modeling framework for spatial contextual effects to the temporal domain. The model learns temporal statistical regularities of natural movies and links these statistics to adaptation in primary visual cortex via divisive normalization, a ubiquitous neural computation. In particular, the model divisively normalizes the present visual input by the past visual inputs only to the degree that these are inferred to be statistically dependent. We show that this flexible form of normalization reproduces classical findings on how brief adaptation affects neuronal selectivity. Furthermore, prior knowledge acquired by the Bayesian model from natural movies can be modified by prolonged exposure to novel visual stimuli. We show that this updating can explain classical results on contrast adaptation. We also simulate the recent finding that adaptation maintains population homeostasis, namely, a balanced level of activity across a population of neurons with different orientation preferences. Consistent with previous disparate observations, our work further clarifies the influence of stimulus-specific and neuronal-specific normalization signals in adaptation.

Efficiency turns the table on neural encoding, decoding and noise

Sensory neurons are usually described with an encoding model, for example, a function that predicts their response from the sensory stimulus using a receptive field (RF) or a tuning curve. However, central to theories of sensory processing is the notion of 'efficient coding'. We argue here that efficient coding implies a completely different neural coding strategy. Instead of a fixed encoding model, neural populations would be described by a fixed decoding model (i.e. a model reconstructing the stimulus from the neural responses). Because the population solves a global optimization problem, individual neurons are variable, but not noisy, and have no truly invariant tuning curve or receptive field. We review recent experimental evidence and implications for neural noise correlations, robustness and adaptation.

Geometry Shapes Propagation: Assessing the Presence and Absence of Cortical Symmetries through a Computational Model of Cortical Spreading Depression

Cortical spreading depression (CSD), a depolarization wave which originates in the visual cortex and travels toward the frontal lobe, has been suggested to be one neural correlate of aura migraine. To the date, little is known about the mechanisms which can trigger or stop aura migraine. Here, to shed some light on this problem and, under the hypothesis that CSD might mediate aura migraine, we aim to study different aspects favoring or disfavoring the propagation of CSD. In particular, by using a computational neuronal model distributed throughout a realistic cortical mesh, we study the role that the geometry has in shaping CSD. Our results are two-fold: first, we found significant differences in the propagation traveling patterns of CSD, both intra and inter-hemispherically, revealing important asymmetries in the propagation profile. Second, we developed methods able to identify brain regions featuring a peculiar behavior during CSD propagation. Our study reveals dynamical aspects of CSD, which, if applied to subject-specific cortical geometry, might shed some light on how to differentiate between healthy subjects and those suffering migraine.

Aversive learning shapes neuronal orientation tuning in human visual cortex

The responses of sensory cortical neurons are shaped by experience. As a result perceptual biases evolve, selectively facilitating the detection and identification of sensory events that are relevant for adaptive behaviour. Here we examine the involvement of human visual cortex in the formation of learned perceptual biases. We use classical aversive conditioning to associate one out of a series of oriented gratings with a noxious sound stimulus. After as few as two grating-sound pairings, visual cortical responses to the sound-paired grating show selective amplification. Furthermore, as learning progresses, responses to the orientations with greatest similarity to the sound-paired grating are increasingly suppressed, suggesting inhibitory interactions between orientation-selective neuronal populations. Changes in cortical connectivity between occipital and fronto-temporal regions mirror the changes in visuo-cortical response amplitudes. These findings suggest that short-term behaviourally driven retuning of human visual cortical neurons involves distal top–down projections as well as local inhibitory interactions.

Sensory cortical tuning is shaped by experience to facilitate coding of features that are predictive of behaviourally relevant outcomes. Here the authors demonstrate that rapid behaviourally driven retuning of human visual cortex involves top–down projections as well as local inhibitory interactions.

ADAPTATION-DEPENDENT SYNCHRONIZATION TRANSITIONS AND BURST GENERATIONS IN ELECTRICALLY COUPLED NEURAL NETWORKS

A typical feature of neurons is their ability to encode neural information dynamically through spike frequency adaptation (SFA). Previous studies of SFA on neuronal synchronization were mainly concentrated on the correlated firing between neuron pairs, while the synchronization of neuron populations in the presence of SFA is still unclear. In this study, the influence of SFA on the population synchronization of neurons was numerically explored in electrically coupled networks, with regular, small-world, and random connectivity, respectively. The simulation results indicate that cross-correlation indices decrease significantly when the neurons have adaptation compared with those of nonadapting neurons, similar to previous experimental observations. However, the synchronous activity of population neurons exhibits a rather complex adaptation-dependent manner. Specifically, synchronization strength of neuron populations changes nonmonotonically, depending on the degree of adaptation. In addition, single neurons in the networks can switch from regular spiking to bursting with the increase of adaptation degree. Furthermore, the connection probability among neurons exhibits significant influence on the population synchronous activity, but has little effect on the burst generation of single neurons. Accordingly, the results may suggest that synchronous activity and burst firing of population neurons are both adaptation-dependent.

Moving sensory adaptation beyond suppressive effects in single neurons

How an object is perceived depends on the temporal context in which it is encountered. Sensory signals in the brain also depend on temporal context, a phenomenon often referred to as adaptation. Traditional descriptions of adaptation effects emphasize various forms of response fatigue in single neurons, which grow in strength with exposure to a stimulus. Recent work on vision, and other sensory modalities, has shown that this description has substantial shortcomings. Here we review our emerging understanding of how adaptation alters the balance between excitatory and suppressive signals, how effects depend on adaptation duration, and how adaptation influences representations that are distributed within and across multiple brain structures. This work points to a sophisticated set of mechanisms for adjusting to recent sensory experience, and suggests new avenues for understanding their function.

Neuronal adaptation translates stimulus gaps into a population code

Neurons in sensory pathways exhibit a vast multitude of adaptation behaviors, which are assumed to aid the encoding of temporal stimulus features and provide the basis for a population code in higher brain areas. Here we study the transition to a population code for auditory gap stimuli both in neurophysiological recordings and in a computational network model. Independent component analysis (ICA) of experimental data from the inferior colliculus of Mongolian gerbils reveals that the network encodes different gap sizes primarily with its population firing rate within 30 ms after the presentation of the gap, where longer gap size evokes higher network activity. We then developed a computational model to investigate possible mechanisms of how to generate the population code for gaps. Phenomenological (ICA) and functional (discrimination performance) analyses of our simulated networks show that the experimentally observed patterns may result from heterogeneous adaptation, where adaptation provides gap detection at the single neuron level and neuronal heterogeneity ensures discriminable population codes for the whole range of gap sizes in the input. Furthermore, our work suggests that network recurrence additionally enhances the network's ability to provide discriminable population patterns.

Emerging principles of population coding: in search for the neural code

Population coding theory aims to provide quantitative tests for hypotheses concerning the neural code. Over the last two decades theory has focused on analyzing the ways in which various parameters that characterize neuronal responses to external stimuli affect the information content of these responses. This article reviews and provides an intuitive explanation for the major effects of noise correlations and neuronal heterogeneity, and discusses their implications for our ability to investigate the neural code. It is argued that to test neural code hypotheses further, additional constraints are required, including relating trial-to-trial variation in neuronal population responses to behavioral decisions and specifying how information is decoded by downstream networks.

Short-term synaptic plasticity in the deterministic Tsodyks-Markram model leads to unpredictable network dynamics

Short-term synaptic plasticity strongly affects the neural dynamics of cortical networks. The Tsodyks and Markram (TM) model for short-term synaptic plasticity accurately accounts for a wide range of physiological responses at different types of cortical synapses. Here, we report a route to chaotic behavior via a Shilnikov homoclinic bifurcation that dynamically organizes some of the responses in the TM model. In particular, the presence of such a homoclinic bifurcation strongly affects the shape of the trajectories in the phase space and induces highly irregular transient dynamics; indeed, in the vicinity of the Shilnikov homoclinic bifurcation, the number of population spikes and their precise timing are unpredictable and highly sensitive to the initial conditions. Such an irregular deterministic dynamics has its counterpart in stochastic/network versions of the TM model: The existence of the Shilnikov homoclinic bifurcation generates complex and irregular spiking patterns and--acting as a sort of springboard--facilitates transitions between the down-state and unstable periodic orbits. The interplay between the (deterministic) homoclinic bifurcation and stochastic effects may give rise to some of the complex dynamics observed in neural systems.

Adaptation of cerebral oxygen metabolism and blood flow and modulation of neurovascular coupling with prolonged stimulation in human visual cortex

Prolonged visual stimulation results in neurophysiologic and hemodynamic adaptation. However, the hemodynamic adaptation appears to be small compared to neural adaptation. It is not clear how the cerebral metabolic rate of oxygen (CMRO2) is affected by adaptation. We measured cerebral blood flow (CBF) and CMRO2 change in responses to peripheral stimulation either continuously, or intermittently (on/off cycles). A linear system's response to the continuous input should be equal to the sum of the original response to the intermittent input and a version of that response shifted by half a cycle. The CMRO2 response showed a large non-linearity consistent with adaptation, the CBF response adapted to a lesser degree, and the blood oxygenation level dependent (BOLD) response was nearly linear. The metabolic response was coupled with a larger flow in the continuous condition than in the intermittent condition. Our results suggest that contrast adaptation improves energy economy of visual processing. However BOLD modulations may not accurately represent the underlying metabolic nonlinearity due to modulation of the coupling of blood flow and oxygen metabolism changes.