Onset of negative interspike interval correlations in adapting neurons

An integrate-and-fire approach to Ca2+ signaling. Part II: Cumulative refractoriness

Inositol 1,4,5-trisphosphate-induced Ca2+ signaling is a second messenger system used by almost all eukaryotic cells. The agonist concentration stimulating Ca2+ signals is encoded in the frequency of a Ca2+ concentration spike sequence. When a cell is stimulated, the interspike intervals (ISIs) often show a distinct transient during which they gradually increase, a system property we refer to as cumulative refractoriness. We extend a previously published stochastic model to include the Ca2+ concentration in the intracellular Ca2+ store as a slow adaptation variable. This model can reproduce both stationary and transient statistics of experimentally observed ISI sequences. We derive approximate expressions for the mean and coefficient of variation of the stationary ISIs. We also consider the response to the onset of a constant stimulus and estimate the length of the transient and the strength of the adaptation of the ISI. We show that the adaptation sets the coefficient of variation in agreement with current ideas derived from experiments. Moreover, we explain why, despite a pronounced transient behavior, ISI correlations can be weak, as often observed in experiments. Finally, we fit our model to reproduce the transient statistics of experimentally observed ISI sequences in stimulated HEK cells. The fitted model is able to qualitatively reproduce the relationship between the stationary interval correlations and the number of transient intervals, as well as the strength of the ISI adaptation. We also find positive correlations in the experimental sequence that cannot be explained by our model.

A dynamic spike threshold with correlated noise predicts observed patterns of negative interval correlations in neuronal spike trains

Negative correlations in the sequential evolution of interspike intervals (ISIs) are a signature of memory in neuronal spike-trains. They provide coding benefits including firing-rate stabilization, improved detectability of weak sensory signals, and enhanced transmission of information by improving signal-to-noise ratio. Primary electrosensory afferent spike-trains in weakly electric fish fall into two categories based on the pattern of ISI correlations: non-bursting units have negative correlations which remain negative but decay to zero with increasing lags (Type I ISI correlations), and bursting units have oscillatory (alternating sign) correlation which damp to zero with increasing lags (Type II ISI correlations). Here, we predict and match observed ISI correlations in these afferents using a stochastic dynamic threshold model. We determine the ISI correlation function as a function of an arbitrary discrete noise correlation function [Formula: see text], where k is a multiple of the mean ISI. The function permits forward and inverse calculations of the correlation function. Both types of correlation functions can be generated by adding colored noise to the spike threshold with Type I correlations generated with slow noise and Type II correlations generated with fast noise. A first-order autoregressive (AR) process with a single parameter is sufficient to predict and accurately match both types of afferent ISI correlation functions, with the type being determined by the sign of the AR parameter. The predicted and experimentally observed correlations are in geometric progression. The theory predicts that the limiting sum of ISI correlations is [Formula: see text] yielding a perfect DC-block in the power spectrum of the spike train. Observed ISI correlations from afferents have a limiting sum that is slightly larger at [Formula: see text] ([Formula: see text]). We conclude that the underlying process for generating ISIs may be a simple combination of low-order AR and moving average processes and discuss the results from the perspective of optimal coding.

Interspike interval correlations in neuron models with adaptation and correlated noise

The generation of neural action potentials (spikes) is random but nevertheless may result in a rich statistical structure of the spike sequence. In particular, contrary to the popular renewal assumption of theoreticians, the intervals between adjacent spikes are often correlated. Experimentally, different patterns of interspike-interval correlations have been observed and computational studies have identified spike-frequency adaptation and correlated noise as the two main mechanisms that can lead to such correlations. Analytical studies have focused on the single cases of either correlated (colored) noise or adaptation currents in combination with uncorrelated (white) noise. For low-pass filtered noise or adaptation, the serial correlation coefficient can be approximated as a single geometric sequence of the lag between the intervals, providing an explanation for some of the experimentally observed patterns. Here we address the problem of interval correlations for a widely used class of models, multidimensional integrate-and-fire neurons subject to a combination of colored and white noise sources and a spike-triggered adaptation current. Assuming weak noise, we derive a simple formula for the serial correlation coefficient, a sum of two geometric sequences, which accounts for a large class of correlation patterns. The theory is confirmed by means of numerical simulations in a number of special cases including the leaky, quadratic, and generalized integrate-and-fire models with colored noise and spike-frequency adaptation. Furthermore we study the case in which the adaptation current and the colored noise share the same time scale, corresponding to a slow stochastic population of adaptation channels; we demonstrate that our theory can account for a nonmonotonic dependence of the correlation coefficient on the channel's time scale. Another application of the theory is a neuron driven by network-noise-like fluctuations (green noise). We also discuss the range of validity of our weak-noise theory and show that by changing the relative strength of white and colored noise sources, we can change the sign of the correlation coefficient. Finally, we apply our theory to a conductance-based model which demonstrates its broad applicability.

Emergent Inference of Hidden Markov Models in Spiking Neural Networks Through Winner-Take-All

Hidden Markov models (HMMs) underpin the solution to many problems in computational neuroscience. However, it is still unclear how to implement inference of HMMs with a network of neurons in the brain. The existing methods suffer from the problem of being nonspiking and inaccurate. Here, we build a precise equivalence between the inference equation of HMMs with time-invariant hidden variables and the dynamics of spiking winner-take-all (WTA) neural networks. We show that the membrane potential of each spiking neuron in the WTA circuit encodes the logarithm of the posterior probability of the hidden variable in each state, and the firing rate of each neuron is proportional to the posterior probability of the HMMs. We prove that the time course of the neural firing rate can implement posterior inference of HMMs. Theoretical analysis and experimental results show that the proposed WTA circuit can get accurate inference results of HMMs.

Interspike interval correlations in networks of inhibitory integrate-and-fire neurons

We study temporal correlations of interspike intervals, quantified by the network-averaged serial correlation coefficient (SCC), in networks of both current- and conductance-based purely inhibitory integrate-and-fire neurons. Numerical simulations reveal transitions to negative SCCs at intermediate values of bias current drive and network size. As bias drive and network size are increased past these values, the SCC returns to zero. The SCC is maximally negative at an intermediate value of the network oscillation strength. The dependence of the SCC on two canonical schemes for synaptic connectivity is studied, and it is shown that the results occur robustly in both schemes. For conductance-based synapses, the SCC becomes negative at the onset of both a fast and slow coherent network oscillation. We then show by means of offline simulations using prerecorded network activity that a neuron's SCC is highly sensitive to its number of presynaptic inputs. Finally, we devise a noise-reduced diffusion approximation for current-based networks that accounts for the observed temporal correlation transitions.

Evolution of moments and correlations in nonrenewal escape-time processes

The theoretical description of nonrenewal stochastic systems is a challenge. Analytical results are often not available or can be obtained only under strong conditions, limiting their applicability. Also, numerical results have mostly been obtained by ad hoc Monte Carlo simulations, which are usually computationally expensive when a high degree of accuracy is needed. To gain quantitative insight into these systems under general conditions, we here introduce a numerical iterated first-passage time approach based on solving the time-dependent Fokker-Planck equation (FPE) to describe the statistics of nonrenewal stochastic systems. We illustrate the approach using spike-triggered neuronal adaptation in the leaky and perfect integrate-and-fire model, respectively. The transition to stationarity of first-passage time moments and their sequential correlations occur on a nontrivial time scale that depends on all system parameters. Surprisingly this is so for both single exponential and scale-free power-law adaptation. The method works beyond the small noise and time-scale separation approximations. It shows excellent agreement with direct Monte Carlo simulations, which allow for the computation of transient and stationary distributions. We compare different methods to compute the evolution of the moments and serial correlation coefficients (SCCs) and discuss the challenge of reliably computing the SCCs, which we find to be very sensitive to numerical inaccuracies for both the leaky and perfect integrate-and-fire models. In conclusion, our methods provide a general picture of nonrenewal dynamics in a wide range of stochastic systems exhibiting short- and long-range correlations.

Response to a periodic stimulus in a perfect integrate-and-fire neuron model driven by colored noise

The output interspike interval statistics of a stochastic perfect integrate-and-fire neuron model driven by an additive exogenous periodic stimulus is considered. The effect of temporally correlated random activity of synaptic inputs is modeled by an additive symmetric dichotomous noise. Using a first-passage-time formulation, exact expressions for the output interspike interval density and for the serial correlation coefficient are derived in the nonsteady regime, and their dependence on input parameters (e.g., the noise correlation time and amplitude as well as the frequency of an input current) is analyzed. It is shown that an interplay of a periodic forcing and colored noise can cause a variety of nonequilibrium cooperation effects, such as sign reversals of the interspike interval correlations versus noise-switching rate as well as versus the frequency of periodic forcing, a power-law-like decay of oscillations of the serial correlation coefficients in the long-lag limit, amplification of the output signal modulation in the instantaneous firing rate of the neural response, etc. The features of spike statistics in the limits of slow and fast noises are also discussed.

Thermally induced passage and current of particles in a highly unstable optical potential

We discuss the statistics of first-passage times of a Brownian particle moving in a highly unstable nonlinear potential proportional to an odd power of position. We observe temperature-induced shortening of the mean first-passage time and its dependence on the power of nonlinearity. We propose a passage-time fraction as both a simple and experimentally detectable witness of the nonlinearity. It is advantageously independent of all other parameters of the experiment and observable for a small number of trajectories. To better characterize the stochastic passage in the unstable potential, we introduce an analogy of the signal-to-noise ratio for the statistical distribution of the first-passage times. Interestingly, the upper bound for the signal-to-noise ratio is temperature independent in the unstable potential. Finally, we describe the nonequilibrium steady state of the particle cyclically passing through unstable odd nonlinearity. The maximum of the steady-state probability distribution shifts against the directions of the current and this counterintuitive effect increases with temperature. All these thermally induced effects are very promising targets for experimental tests of highly nonlinear stochastic dynamics of particles placed into optical potential landscapes of shaped optical tweezers.

Analytical approach to an integrate-and-fire model with spike-triggered adaptation

The calculation of the steady-state probability density for multidimensional stochastic systems that do not obey detailed balance is a difficult problem. Here we present the analytical derivation of the stationary joint and various marginal probability densities for a stochastic neuron model with adaptation current. Our approach assumes weak noise but is valid for arbitrary adaptation strength and time scale. The theory predicts several effects of adaptation on the statistics of the membrane potential of a tonically firing neuron: (i) a membrane potential distribution with a convex shape, (ii) a strongly increased probability of hyperpolarized membrane potentials induced by strong and fast adaptation, and (iii) a maximized variability associated with the adaptation current at a finite adaptation time scale.

Effects of spike-triggered negative feedback on receptive-field properties

Sensory neurons are often described in terms of a receptive field, that is, a linear kernel through which stimuli are filtered before they are further processed. If information transmission is assumed to proceed in a feedforward cascade, the receptive field may be interpreted as the external stimulus' profile maximizing neuronal output. The nervous system, however, contains many feedback loops, and sensory neurons filter more currents than the ones representing the transduced external stimulus. Some of the additional currents are generated by the output activity of the neuron itself, and therefore constitute feedback signals. By means of a time-frequency analysis of the input/output transformation, here we show how feedback modifies the receptive field. The model is applicable to various types of feedback processes, from spike-triggered intrinsic conductances to inhibitory synaptic inputs from nearby neurons. We distinguish between the intrinsic receptive field (filtering all input currents) and the effective receptive field (filtering only external stimuli). Whereas the intrinsic receptive field summarizes the biophysical properties of the neuron associated to subthreshold integration and spike generation, only the effective receptive field can be interpreted as the external stimulus' profile maximizing neuronal output. We demonstrate that spike-triggered feedback shifts low-pass filtering towards band-pass processing, transforming integrator neurons into resonators. For strong feedback, a sharp resonance in the spectral neuronal selectivity may appear. Our results provide a unified framework to interpret a collection of previous experimental studies where specific feedback mechanisms were shown to modify the filtering properties of neurons.

A model of synaptic vesicle-pool depletion and replenishment can account for the interspike interval distributions and nonrenewal properties of spontaneous spike trains of auditory-nerve fibers

In mammalian auditory systems, the spiking characteristics of each primary afferent (type I auditory-nerve fiber; ANF) are mainly determined by a single ribbon synapse in a single receptor cell (inner hair cell; IHC). ANF spike trains therefore provide a window into the operation of these synapses and cells. It was demonstrated previously (Heil et al., 2007) that the distribution of interspike intervals (ISIs) of cat ANFs during spontaneous activity can be modeled as resulting from refractoriness operating on a non-Poisson stochastic point process of excitation (transmitter release events from the IHC). Here, we investigate nonrenewal properties of these cat-ANF spontaneous spike trains, manifest as negative serial ISI correlations and reduced spike-count variability over short timescales. A previously discussed excitatory process, the constrained failure of events from a homogeneous Poisson point process, can account for these properties, but does not offer a parsimonious explanation for certain trends in the data. We then investigate a three-parameter model of vesicle-pool depletion and replenishment and find that it accounts for all experimental observations, including the ISI distributions, with only the release probability varying between spike trains. The maximum number of units (single vesicles or groups of simultaneously released vesicles) in the readily releasable pool and their replenishment time constant can be assumed to be constant (∼4 and 13.5 ms, respectively). We suggest that the organization of the IHC ribbon synapses not only enables sustained release of neurotransmitter but also imposes temporal regularity on the release process, particularly when operating at high rates.

Event-triggered feedback in noise-driven phase oscillators

Using a stochastic nonlinear phase oscillator model, we study the effect of event-triggered feedback on the statistics of interevent intervals. Events are associated with the entering of a new cycle. The feedback is modeled by an instantaneous increase (positive feedback) or decrease (negative feedback) of the oscillator frequency whenever an event occurs followed by an exponential decay on a slow time scale. In addition to the known excitable and oscillatory regimes, which are separated by a saddle node on invariant circle bifurcation, positive feedback can lead to bistable dynamics and a change of the system's excitability. The feedback has also a strong effect on noise-induced phenomena like coherence resonance or anticoherence resonance. Both positive and negative feedback can lead to more regular output for particular noise strengths. Finally, we investigate serial correlations in the sequence of interevent intervals that occur due to the additional slow dynamics. We derive approximations for the serial correlation coefficient and show that positive feedback results in extended positive interval correlations, whereas negative feedback yields short-ranging negative correlations. Investigating the interplay of feedback and the nonlinear phase dynamics close to the bifurcation, we find that correlations are most pronounced for optimal feedback strengths.

Patterns of interval correlations in neural oscillators with adaptation

Neural firing is often subject to negative feedback by adaptation currents. These currents can induce strong correlations among the time intervals between spikes. Here we study analytically the interval correlations of a broad class of noisy neural oscillators with spike-triggered adaptation of arbitrary strength and time scale. Our weak-noise theory provides a general relation between the correlations and the phase-response curve (PRC) of the oscillator, proves anti-correlations between neighboring intervals for adapting neurons with type I PRC and identifies a single order parameter that determines the qualitative pattern of correlations. Monotonically decaying or oscillating correlation structures can be related to qualitatively different voltage traces after spiking, which can be explained by the phase plane geometry. At high firing rates, the long-term variability of the spike train associated with the cumulative interval correlations becomes small, independent of model details. Our results are verified by comparison with stochastic simulations of the exponential, leaky, and generalized integrate-and-fire models with adaptation.