A model of order-selectivity based on dynamic changes in the balance of excitation and inhibition produced by short-term synaptic plasticity

A computational view of short-term plasticity and its implications for E-I balance

Short-term plasticity (STP) and excitatory-inhibitory balance (EI balance) are both ubiquitous building blocks of brain circuits across the animal kingdom. The synapses involved in EI are also subject to short-term plasticity, and several experimental studies have shown that their effects overlap. Recent computational and theoretical work has begun to highlight the functional implications of the intersection of these motifs. The findings are nuanced: while there are general computational themes, such as pattern tuning, normalization, and gating, much of the richness of these interactions comes from region- and modality specific tuning of STP properties. Together these findings point towards the STP-EI balance combination as being a versatile and highly efficient neural building block for a wide range of pattern-specific responses.

The Adaptation Model Offers a Challenge for the Predictive Coding Account of Mismatch Negativity

An unpredictable stimulus elicits a stronger event-related response than a high-probability stimulus. This differential in response magnitude is termed the mismatch negativity (MMN). Over the past decade, it has become increasingly popular to explain the MMN terms of predictive coding, a proposed general principle for the way the brain realizes Bayesian inference when it interprets sensory information. This perspective article is a reminder that the issue of MMN generation is far from settled, and that an alternative model in terms of adaptation continues to lurk in the wings. The adaptation model has been discounted because of the unrealistic and simplistic fashion in which it tends to be set up. Here, simulations of auditory cortex incorporating a modern version of the adaptation model are presented. These show that locally operating short-term synaptic depression accounts both for adaptation due to stimulus repetition and for MMN responses. This happens even in cases where adaptation has been ruled out as an explanation of the MMN (e.g., in the stimulus omission paradigm and the multi-standard control paradigm). Simulation models that would demonstrate the viability of predictive coding in a similarly multifaceted way are currently missing from the literature, and the reason for this is discussed in light of the current results.

Perception of Happening: How the Brain Deals with the No-History Problem

In physics, the temporal dimension has units of infinitesimally brief duration. Given this, how is it possible to perceive things, such as motion, music, and vibrotactile stimulation, that involve extension across many units of time? To address this problem, it is proposed that there is what is termed an "information construct of happening" (ICOH), a simultaneous representation of recent, temporally differentiated perceptual information on the millisecond time scale. The main features of the ICOH are (i) time marking, semantic labeling of all information in the ICOH with ordinal temporal information and distance from what is informationally identified as the present moment, (ii) vector informational features that specify kind, direction, and rate of change for every feature in a percept, and (iii) connectives, information relating vector informational features at adjacent temporal locations in the ICOH. The ICOH integrates products of perceptual processing with recent historical information in sensory memory on the subsecond time scale. Perceptual information about happening in informational sensory memory is encoded in semantic form that preserves connected semantic trails of vector and timing information. The basic properties of the ICOH must be supported by a general and widespread timing mechanism that generates ordinal and interval timing information and it is suggested that state-dependent networks may suffice for that purpose. Happening, therefore, is perceived at a moment and is constituted by an information structure of connected recent historical information.

The extended present: an informational context for perception

Several previous authors have proposed a kind of specious or subjective present moment that covers a few seconds of recent information. This article proposes a new hypothesis about the subjective present, renamed the extended present, defined not in terms of time covered but as a thematically connected information structure held in working memory and in transiently accessible form in long-term memory. The three key features of the extended present are that information in it is thematically connected, both internally and to current attended perceptual input, it is organised in a hierarchical structure, and all information in it is marked with temporal information, specifically ordinal and duration information. Temporal boundaries to the information structure are determined by hierarchical structure processing and by limits on processing and storage capacity. Supporting evidence for the importance of hierarchical structure analysis is found in the domains of music perception, speech and language processing, perception and production of goal-directed action, and exact arithmetical calculation. Temporal information marking is also discussed and a possible mechanism for representing ordinal and duration information on the time scale of the extended present is proposed. It is hypothesised that the extended present functions primarily as an informational context for making sense of current perceptual input, and as an enabler for perception and generation of complex structures and operations in language, action, music, exact calculation, and other domains.

Differential Short-Term Plasticity of PV and SST Neurons Accounts for Adaptation and Facilitation of Cortical Neurons to Auditory Tones

Cortical responses to sensory stimuli are strongly modulated by temporal context. One of the best studied examples of such modulation is sensory adaptation. We first show that in response to repeated tones pyramidal (Pyr) neurons in male mouse auditory cortex (A1) exhibit facilitating and stable responses, in addition to adapting responses. To examine the potential mechanisms underlying these distinct temporal profiles, we developed a reduced spiking model of sensory cortical circuits that incorporated the signature short-term synaptic plasticity (STP) profiles of the inhibitory parvalbumin (PV) and somatostatin (SST) interneurons. The model accounted for all three temporal response profiles as the result of dynamic changes in excitatory/inhibitory balance produced by STP, primarily through shifts in the relative latency of Pyr and inhibitory neurons. Transition between the three response profiles was possible by changing the strength of the inhibitory PV→Pyr and SST→Pyr synapses. The model predicted that a unit's latency would be related to its temporal profile. Consistent with this prediction, the latency of stable units was significantly shorter than that of adapting and facilitating units. Furthermore, because of the history-dependence of STP the model generated a paradoxical prediction: that inactivation of inhibitory neurons during one tone would decrease the response of A1 neurons to a subsequent tone. Indeed, we observed that optogenetic inactivation of PV neurons during one tone counterintuitively decreased the spiking of Pyr neurons to a subsequent tone 400 ms later. These results provide evidence that STP is critical to temporal context-dependent responses in the sensory cortex.SIGNIFICANCE STATEMENT Our perception of speech and music depends strongly on temporal context, i.e., the significance of a stimulus depends on the preceding stimuli. Complementary neural mechanisms are needed to sometimes ignore repetitive stimuli (e.g., the tic of a clock) or detect meaningful repetition (e.g., consecutive tones in Morse code). We modeled a neural circuit that accounts for diverse experimentally-observed response profiles in auditory cortex (A1) neurons, based on known forms of short-term synaptic plasticity (STP). Whether the simulated circuit reduced, maintained, or enhanced its response to repeated tones depended on the relative dominance of two different types of inhibitory cells. The model made novel predictions that were experimentally validated. Results define an important role for STP in temporal context-dependent perception.

Attractor-state itinerancy in neural circuits with synaptic depression

Neural populations with strong excitatory recurrent connections can support bistable states in their mean firing rates. Multiple fixed points in a network of such bistable units can be used to model memory retrieval and pattern separation. The stability of fixed points may change on a slower timescale than that of the dynamics due to short-term synaptic depression, leading to transitions between quasi-stable point attractor states in a sequence that depends on the history of stimuli. To better understand these behaviors, we study a minimal model, which characterizes multiple fixed points and transitions between them in response to stimuli with diverse time- and amplitude-dependencies. The interplay between the fast dynamics of firing rate and synaptic responses and the slower timescale of synaptic depression makes the neural activity sensitive to the amplitude and duration of square-pulse stimuli in a nontrivial, history-dependent manner. Weak cross-couplings further deform the basins of attraction for different fixed points into intricate shapes. We find that while short-term synaptic depression can reduce the total number of stable fixed points in a network, it tends to strongly increase the number of fixed points visited upon repetitions of fixed stimuli. Our analysis provides a natural explanation for the system's rich responses to stimuli of different durations and amplitudes while demonstrating the encoding capability of bistable neural populations for dynamical features of incoming stimuli.

Induction and propagation of transient synchronous activity in neural networks endowed with short-term plasticity

Transient, task related synchronous activity within neural populations has been recognized as the substrate of temporal coding in the brain. The mechanisms underlying inducing and propagation of transient synchronous activity are still unknown, and we propose that short-term plasticity (STP) of neural circuits may serve as a supplemental mechanism therein. By computational modeling, we showed that short-term facilitation greatly increases the reactivation rate of population spikes and decreases the latency of response to reactivation stimuli in local recurrent neural networks. Meanwhile, the timing of population spike reactivation is controlled by the memory effect of STP, and it is mediated primarily by the facilitation time constant. Furthermore, we demonstrated that synaptic facilitation dramatically enhances synchrony propagation in feedforward neural networks and that response timing mediated by synaptic facilitation offers a scheme for information routing. In addition, we verified that synaptic strengthening of intralayer or interlayer coupling enhances synchrony propagation, and we verified that other factors such as the delay of synaptic transmission and the mode of synaptic connectivity are also involved in regulating synchronous activity propagation. Overall, our results highlight the functional role of STP in regulating the inducing and propagation of transient synchronous activity, and they may inspire testable hypotheses for future experimental studies.

Sensory Stream Adaptation in Chaotic Networks

Implicit expectations induced by predictable stimuli sequences affect neuronal response to upcoming stimuli at both single cell and neural population levels. Temporally regular sensory streams also phase entrain ongoing low frequency brain oscillations but how and why this happens is unknown. Here we investigate how random recurrent neural networks without plasticity respond to stimuli streams containing oddballs. We found the neuronal correlates of sensory stream adaptation emerge if networks generate chaotic oscillations which can be phase entrained by stimulus streams. The resultant activity patterns are close to critical and support history dependent response on long timescales. Because critical network entrainment is a slow process stimulus response adapts gradually over multiple repetitions. Repeated stimuli generate suppressed responses but oddball responses are large and distinct. Oscillatory mismatch responses persist in population activity for long periods after stimulus offset while individual cell mismatch responses are strongly phasic. These effects are weakened in temporally irregular sensory streams. Thus we show that network phase entrainment provides a biologically plausible mechanism for neural oddball detection. Our results do not depend on specific network characteristics, are consistent with experimental studies and may be relevant for multiple pathologies demonstrating altered mismatch processing such as schizophrenia and depression.

Dendrites, deep learning, and sequences in the hippocampus

The hippocampus places us both in time and space. It does so over remarkably large spans: milliseconds to years, and centimeters to kilometers. This works for sensory representations, for memory, and for behavioral context. How does it fit in such wide ranges of time and space scales, and keep order among the many dimensions of stimulus context? A key organizing principle for a wide sweep of scales and stimulus dimensions is that of order in time, or sequences. Sequences of neuronal activity are ubiquitous in sensory processing, in motor control, in planning actions, and in memory. Against this strong evidence for the phenomenon, there are currently more models than definite experiments about how the brain generates ordered activity. The flip side of sequence generation is discrimination. Discrimination of sequences has been extensively studied at the behavioral, systems, and modeling level, but again physiological mechanisms are fewer. It is against this backdrop that I discuss two recent developments in neural sequence computation, that at face value share little beyond the label "neural." These are dendritic sequence discrimination, and deep learning. One derives from channel physiology and molecular signaling, the other from applied neural network theory - apparently extreme ends of the spectrum of neural circuit detail. I suggest that each of these topics has deep lessons about the possible mechanisms, scales, and capabilities of hippocampal sequence computation.

Diverse effects of stimulus history in waking mouse auditory cortex

Responses to auditory stimuli are often strongly influenced by recent stimulus history. For example, in a paradigm called forward suppression, brief sounds can suppress the perception of, and the neural responses to, a subsequent sound, with the magnitude of this suppression depending on both the spectral and temporal distances between the sounds. As a step towards understanding the mechanisms that generate these adaptive representations in awake animals, we quantitatively characterize responses to two-tone sequences in the auditory cortex of waking mice. We find that cortical responses in a forward suppression paradigm are more diverse in waking mice than previously appreciated, that these responses vary between cells with different firing characteristics and waveform shapes, but that the variability in these responses is not substantially related to cortical depth or columnar location. Moreover, responses to the first tone in the sequence are often not linearly related to the suppression of the second tone response, suggesting that spike-frequency adaptation of cortical cells is not a large contributor to forward suppression or its variability. Instead, we use a simple multilayered model to show that cell-to-cell differences in the balance of intracortical inhibition and excitation will naturally produce such a diversity of forward interactions. We propose that diverse inhibitory connectivity allows the cortex to encode spectro-temporally fluctuating stimuli in multiple parallel ways.NEW & NOTEWORTHY Behavioral and neural responses to auditory stimuli are profoundly influenced by recent sounds, yet how this occurs is not known. Here, the authors show in the auditory cortex of awake mice that the quality of history-dependent effects is diverse and related to cell type, response latency, firing rates, and receptive field bandwidth. In a cortical model, differences in excitatory-inhibitory balance can produce this diversity, providing the cortex with multiple ways of representing temporally complex information.

Synaptic input sequence discrimination on behavioral timescales mediated by reaction-diffusion chemistry in dendrites

Sequences of events are ubiquitous in sensory, motor, and cognitive function. Key computational operations, including pattern recognition, event prediction, and plasticity, involve neural discrimination of spatio-temporal sequences. Here, we show that synaptically-driven reaction-diffusion pathways on dendrites can perform sequence discrimination on behaviorally relevant time-scales. We used abstract signaling models to show that selectivity arises when inputs at successive locations are aligned with, and amplified by, propagating chemical waves triggered by previous inputs. We incorporated biological detail using sequential synaptic input onto spines in morphologically, electrically, and chemically detailed pyramidal neuronal models based on rat data. Again, sequences were recognized, and local channel modulation downstream of putative sequence-triggered signaling could elicit changes in neuronal firing. We predict that dendritic sequence-recognition zones occupy 5 to 30 microns and recognize time-intervals of 0.2 to 5 s. We suggest that this mechanism provides highly parallel and selective neural computation in a functionally important time range.

Dynamic balance of excitation and inhibition rapidly modulates spike probability and precision in feed-forward hippocampal circuits

Feed-forward inhibitory (FFI) circuits are important for many information-processing functions. FFI circuit operations critically depend on the balance and timing between the excitatory and inhibitory components, which undergo rapid dynamic changes during neural activity due to short-term plasticity (STP) of both components. How dynamic changes in excitation/inhibition (E/I) balance during spike trains influence FFI circuit operations remains poorly understood. In the current study we examined the role of STP in the FFI circuit functions in the mouse hippocampus. Using a coincidence detection paradigm with simultaneous activation of two Schaffer collateral inputs, we found that the spiking probability in the target CA1 neuron was increased while spike precision concomitantly decreased during high-frequency bursts compared with a single spike. Blocking inhibitory synaptic transmission revealed that dynamics of inhibition predominately modulates the spike precision but not the changes in spiking probability, whereas the latter is modulated by the dynamics of excitation. Further analyses combining whole cell recordings and simulations of the FFI circuit suggested that dynamics of the inhibitory circuit component may influence spiking behavior during bursts by broadening the width of excitatory postsynaptic responses and that the strength of this modulation depends on the basal E/I ratio. We verified these predictions using a mouse model of fragile X syndrome, which has an elevated E/I ratio, and found a strongly reduced modulation of postsynaptic response width during bursts. Our results suggest that changes in the dynamics of excitatory and inhibitory circuit components due to STP play important yet distinct roles in modulating the properties of FFI circuits.

Memory Stacking in Hierarchical Networks

Robust representations of sounds with a complex spectrotemporal structure are thought to emerge in hierarchically organized auditory cortex, but the computational advantage of this hierarchy remains unknown. Here, we used computational models to study how such hierarchical structures affect temporal binding in neural networks. We equipped individual units in different types of feedforward networks with local memory mechanisms storing recent inputs and observed how this affected the ability of the networks to process stimuli context dependently. Our findings illustrate that these local memories stack up in hierarchical structures and hence allow network units to exhibit selectivity to spectral sequences longer than the time spans of the local memories. We also illustrate that short-term synaptic plasticity is a potential local memory mechanism within the auditory cortex, and we show that it can bring robustness to context dependence against variation in the temporal rate of stimuli, while introducing nonlinearities to response profiles that are not well captured by standard linear spectrotemporal receptive field models. The results therefore indicate that short-term synaptic plasticity might provide hierarchically structured auditory cortex with computational capabilities important for robust representations of spectrotemporal patterns.

Short-term plasticity regulates the excitation/inhibition ratio and the temporal window for spike integration in CA1 pyramidal cells

Many neurodevelopmental and neuropsychiatric disorders involve an imbalance between excitation and inhibition caused by synaptic alterations. The proper excitation/inhibition (E/I) balance is especially critical in CA1 pyramidal cells, because they control hippocampal output. Activation of Schaffer collateral axons causes direct excitation of CA1 pyramidal cells, quickly followed by disynaptic feedforward inhibition, stemming from synaptically induced firing of GABAergic interneurons. Both excitatory and inhibitory synapses are modulated by short-term plasticity, potentially causing dynamic tuning of the E/I ratio. However, the effects of short-term plasticity on the E/I ratio in CA1 pyramidal cells are not yet known. To determine this, we recorded disynaptic inhibitory postsynaptic currents and the E/I ratio in CA1 pyramidal cells in acute hippocampal slices from juvenile mice. We found that, whereas inhibitory synapses had paired-pulse depression, disynaptic inhibition instead had paired-pulse facilitation (≤ 200-ms intervals), caused by increased recruitment of feedforward interneurons. Although enhanced disynaptic inhibition helped to constrain paired-pulse facilitation of excitation, the E/I ratio was still larger on the second pulse, increasing pyramidal cell spiking. Surprisingly, this occurred without compromising the precision of spike timing. The E/I balance regulates the temporal spike integration window from multiple inputs; here, we showed that paired-pulse stimulation can broaden the spike integration window. Together, our findings show that the combined effects of short-term plasticity of disynaptic inhibition and monosynaptic excitation alter the E/I balance in CA1 pyramidal cells, leading to dynamic modulation of spike probability and the spike integration window. Short-term plasticity is therefore an important mechanism for modulating signal processing of hippocampal output.