Nonrenewal spike train statistics: causes and functional consequences on neural coding

An integrate-and-fire approach to Ca2+ signaling. Part II: Cumulative refractoriness

Inositol 1,4,5-trisphosphate-induced Ca2+ signaling is a second messenger system used by almost all eukaryotic cells. The agonist concentration stimulating Ca2+ signals is encoded in the frequency of a Ca2+ concentration spike sequence. When a cell is stimulated, the interspike intervals (ISIs) often show a distinct transient during which they gradually increase, a system property we refer to as cumulative refractoriness. We extend a previously published stochastic model to include the Ca2+ concentration in the intracellular Ca2+ store as a slow adaptation variable. This model can reproduce both stationary and transient statistics of experimentally observed ISI sequences. We derive approximate expressions for the mean and coefficient of variation of the stationary ISIs. We also consider the response to the onset of a constant stimulus and estimate the length of the transient and the strength of the adaptation of the ISI. We show that the adaptation sets the coefficient of variation in agreement with current ideas derived from experiments. Moreover, we explain why, despite a pronounced transient behavior, ISI correlations can be weak, as often observed in experiments. Finally, we fit our model to reproduce the transient statistics of experimentally observed ISI sequences in stimulated HEK cells. The fitted model is able to qualitatively reproduce the relationship between the stationary interval correlations and the number of transient intervals, as well as the strength of the ISI adaptation. We also find positive correlations in the experimental sequence that cannot be explained by our model.

A dynamic spike threshold with correlated noise predicts observed patterns of negative interval correlations in neuronal spike trains

Negative correlations in the sequential evolution of interspike intervals (ISIs) are a signature of memory in neuronal spike-trains. They provide coding benefits including firing-rate stabilization, improved detectability of weak sensory signals, and enhanced transmission of information by improving signal-to-noise ratio. Primary electrosensory afferent spike-trains in weakly electric fish fall into two categories based on the pattern of ISI correlations: non-bursting units have negative correlations which remain negative but decay to zero with increasing lags (Type I ISI correlations), and bursting units have oscillatory (alternating sign) correlation which damp to zero with increasing lags (Type II ISI correlations). Here, we predict and match observed ISI correlations in these afferents using a stochastic dynamic threshold model. We determine the ISI correlation function as a function of an arbitrary discrete noise correlation function [Formula: see text], where k is a multiple of the mean ISI. The function permits forward and inverse calculations of the correlation function. Both types of correlation functions can be generated by adding colored noise to the spike threshold with Type I correlations generated with slow noise and Type II correlations generated with fast noise. A first-order autoregressive (AR) process with a single parameter is sufficient to predict and accurately match both types of afferent ISI correlation functions, with the type being determined by the sign of the AR parameter. The predicted and experimentally observed correlations are in geometric progression. The theory predicts that the limiting sum of ISI correlations is [Formula: see text] yielding a perfect DC-block in the power spectrum of the spike train. Observed ISI correlations from afferents have a limiting sum that is slightly larger at [Formula: see text] ([Formula: see text]). We conclude that the underlying process for generating ISIs may be a simple combination of low-order AR and moving average processes and discuss the results from the perspective of optimal coding.

Mean-return-time phase of a stochastic oscillator provides an approximate renewal description for the associated point process

Stochastic oscillations can be characterized by a corresponding point process; this is a common practice in computational neuroscience, where oscillations of the membrane voltage under the influence of noise are often analyzed in terms of the interspike interval statistics, specifically the distribution and correlation of intervals between subsequent threshold-crossing times. More generally, crossing times and the corresponding interval sequences can be introduced for different kinds of stochastic oscillators that have been used to model variability of rhythmic activity in biological systems. In this paper we show that if we use the so-called mean-return-time (MRT) phase isochrons (introduced by Schwabedal and Pikovsky) to count the cycles of a stochastic oscillator with Markovian dynamics, the interphase interval sequence does not show any linear correlations, i.e., the corresponding sequence of passage times forms approximately a renewal point process. We first outline the general mathematical argument for this finding and illustrate it numerically for three models of increasing complexity: (i) the isotropic Guckenheimer-Schwabedal-Pikovsky oscillator that displays positive interspike interval (ISI) correlations if rotations are counted by passing the spoke of a wheel; (ii) the adaptive leaky integrate-and-fire model with white Gaussian noise that shows negative interspike interval correlations when spikes are counted in the usual way by the passage of a voltage threshold; (iii) a Hodgkin-Huxley model with channel noise (in the diffusion approximation represented by Gaussian noise) that exhibits weak but statistically significant interspike interval correlations, again for spikes counted when passing a voltage threshold. For all these models, linear correlations between intervals vanish when we count rotations by the passage of an MRT isochron. We finally discuss that the removal of interval correlations does not change the long-term variability and its effect on information transmission, especially in the neural context.

Interspike interval correlations in neuron models with adaptation and correlated noise

The generation of neural action potentials (spikes) is random but nevertheless may result in a rich statistical structure of the spike sequence. In particular, contrary to the popular renewal assumption of theoreticians, the intervals between adjacent spikes are often correlated. Experimentally, different patterns of interspike-interval correlations have been observed and computational studies have identified spike-frequency adaptation and correlated noise as the two main mechanisms that can lead to such correlations. Analytical studies have focused on the single cases of either correlated (colored) noise or adaptation currents in combination with uncorrelated (white) noise. For low-pass filtered noise or adaptation, the serial correlation coefficient can be approximated as a single geometric sequence of the lag between the intervals, providing an explanation for some of the experimentally observed patterns. Here we address the problem of interval correlations for a widely used class of models, multidimensional integrate-and-fire neurons subject to a combination of colored and white noise sources and a spike-triggered adaptation current. Assuming weak noise, we derive a simple formula for the serial correlation coefficient, a sum of two geometric sequences, which accounts for a large class of correlation patterns. The theory is confirmed by means of numerical simulations in a number of special cases including the leaky, quadratic, and generalized integrate-and-fire models with colored noise and spike-frequency adaptation. Furthermore we study the case in which the adaptation current and the colored noise share the same time scale, corresponding to a slow stochastic population of adaptation channels; we demonstrate that our theory can account for a nonmonotonic dependence of the correlation coefficient on the channel's time scale. Another application of the theory is a neuron driven by network-noise-like fluctuations (green noise). We also discuss the range of validity of our weak-noise theory and show that by changing the relative strength of white and colored noise sources, we can change the sign of the correlation coefficient. Finally, we apply our theory to a conductance-based model which demonstrates its broad applicability.

Fano Factor: A Potentially Useful Information

The Fano factor, defined as the variance-to-mean ratio of spike counts in a time window, is often used to measure the variability of neuronal spike trains. However, despite its transparent definition, careless use of the Fano factor can easily lead to distorted or even wrong results. One of the problems is the unclear dependence of the Fano factor on the spiking rate, which is often neglected or handled insufficiently. In this paper we aim to explore this problem in more detail and to study the possible solution, which is to evaluate the Fano factor in the operational time. We use equilibrium renewal and Markov renewal processes as spike train models to describe the method in detail, and we provide an illustration on experimental data.

Enhanced Signal Detection by Adaptive Decorrelation of Interspike Intervals

Spike trains with negative interspike interval (ISI) correlations, in which long/short ISIs are more likely followed by short/long ISIs, are common in many neurons. They can be described by stochastic models with a spike-triggered adaptation variable. We analyze a phenomenon in these models where such statistically dependent ISI sequences arise in tandem with quasi-statistically independent and identically distributed (quasi-IID) adaptation variable sequences. The sequences of adaptation states and resulting ISIs are linked by a nonlinear decorrelating transformation. We establish general conditions on a family of stochastic spiking models that guarantee this quasi-IID property and establish bounds on the resulting baseline ISI correlations. Inputs that elicit weak firing rate changes in samples with many spikes are known to be more detectible when negative ISI correlations are present because they reduce spike count variance; this defines a variance-reduced firing rate coding benchmark. We performed a Fisher information analysis on these adapting models exhibiting ISI correlations to show that a spike pattern code based on the quasi-IID property achieves the upper bound of detection performance, surpassing rate codes with the same mean rate-including the variance-reduced rate code benchmark-by 20% to 30%. The information loss in rate codes arises because the benefits of reduced spike count variance cannot compensate for the lower firing rate gain due to adaptation. Since adaptation states have similar dynamics to synaptic responses, the quasi-IID decorrelation transformation of the spike train is plausibly implemented by downstream neurons through matched postsynaptic kinetics. This provides an explanation for observed coding performance in sensory systems that cannot be accounted for by rate coding, for example, at the detection threshold where rate changes can be insignificant.

Information filtering by coincidence detection of synchronous population output: analytical approaches to the coherence function of a two-stage neural system

Information about time-dependent sensory stimuli is encoded in the activity of neural populations; distinct aspects of the stimulus are read out by different types of neurons: while overall information is perceived by integrator cells, so-called coincidence detector cells are driven mainly by the synchronous activity in the population that encodes predominantly high-frequency content of the input signal (high-pass information filtering). Previously, an analytically accessible statistic called the partial synchronous output was introduced as a proxy for the coincidence detector cell's output in order to approximate its information transmission. In the first part of the current paper, we compare the information filtering properties (specifically, the coherence function) of this proxy to those of a simple coincidence detector neuron. We show that the latter's coherence function can indeed be well-approximated by the partial synchronous output with a time scale and threshold criterion that are related approximately linearly to the membrane time constant and firing threshold of the coincidence detector cell. In the second part of the paper, we propose an alternative theory for the spectral measures (including the coherence) of the coincidence detector cell that combines linear-response theory for shot-noise driven integrate-and-fire neurons with a novel perturbation ansatz for the spectra of spike-trains driven by colored noise. We demonstrate how the variability of the synaptic weights for connections from the population to the coincidence detector can shape the information transmission of the entire two-stage system.

Interspike interval correlations in networks of inhibitory integrate-and-fire neurons

We study temporal correlations of interspike intervals, quantified by the network-averaged serial correlation coefficient (SCC), in networks of both current- and conductance-based purely inhibitory integrate-and-fire neurons. Numerical simulations reveal transitions to negative SCCs at intermediate values of bias current drive and network size. As bias drive and network size are increased past these values, the SCC returns to zero. The SCC is maximally negative at an intermediate value of the network oscillation strength. The dependence of the SCC on two canonical schemes for synaptic connectivity is studied, and it is shown that the results occur robustly in both schemes. For conductance-based synapses, the SCC becomes negative at the onset of both a fast and slow coherent network oscillation. We then show by means of offline simulations using prerecorded network activity that a neuron's SCC is highly sensitive to its number of presynaptic inputs. Finally, we devise a noise-reduced diffusion approximation for current-based networks that accounts for the observed temporal correlation transitions.

Distinctions among electroconvulsion- and proconvulsant-induced seizure discharges and native motor patterns during flight and grooming: quantitative spike pattern analysis in Drosophila flight muscles

In Drosophila, high-frequency electrical stimulation across the brain triggers a highly stereotypic repertoire of spasms. These electroconvulsive seizures (ECS) manifest as distinctive spiking discharges across the nervous system and can be stably assessed throughout the seizure repertoire in the large indirect flight muscles dorsal longitudinal muscles (DLMs) to characterize modifications in seizure-prone mutants. However, the relationships between ECS-spike patterns and native motor programs, including flight and grooming, are not known and their similarities and distinctions remain to be characterized. We employed quantitative spike pattern analyses for the three motor patterns including: (1) overall firing frequency, (2) spike timing between contralateral fibers, and (3) short-term variability in spike interval regularity (CV₂) and instantaneous firing frequency (ISI^-1). This base-line information from wild-type (WT) flies facilitated quantitative characterization of mutational effects of major neurotransmitter systems: excitatory cholinergic (Cha), inhibitory GABAergic (Rdl) and electrical (ShakB) synaptic transmission. The results provide an initial glimpse on the vulnerability of individual motor patterns to different perturbations. We found marked alterations of ECS discharge spike patterns in terms of either seizure threshold, spike frequency or spiking regularity. In contrast, no gross alterations during grooming and a small but noticeable reduction of firing frequency during Rdl mutant flight were found, suggesting a role for GABAergic modulation of flight motor programs. Picrotoxin (PTX), a known pro-convulsant that inhibits GABA_A receptors, induced DLM spike patterns that displayed some features, e.g. left-right coordination and ISI^-1 range, that could be found in flight or grooming, but distinct from ECS discharges. These quantitative techniques may be employed to reveal overlooked relationships among aberrant motor patterns as well as their links to native motor programs.

Surrogate Data Methods Based on a Shuffling of the Trials for Synchrony Detection: The Centering Issue

We investigate several distribution-free dependence detection procedures, all based on a shuffling of the trials, from a statistical point of view. The mathematical justification of such procedures lies in the bootstrap principle and its approximation properties. In particular, we show that such a shuffling has mainly to be done on centered quantities-that is, quantities with zero mean under independence-to construct correct p-values, meaning that the corresponding tests control their false positive (FP) rate. Thanks to this study, we introduce a method, named permutation UE, which consists of a multiple testing procedure based on permutation of experimental trials and delayed coincidence count. Each involved single test of this procedure achieves the prescribed level, so that the corresponding multiple testing procedure controls the false discovery rate (FDR), and this with as few assumptions as possible on the underneath distribution, except independence and identical distribution across trials. The mathematical meaning of this assumption is discussed, and it is in particular argued that it does not mean what is commonly referred in neuroscience to as cross-trials stationarity. Some simulations show, moreover, that permutation UE outperforms the trial-shuffling of Pipa and Grün ( 2003 ) and the MTGAUE method of Tuleau-Malot et al. ( 2014 ) in terms of single levels and FDR, for a comparable amount of false negatives. Application to real data is also provided.

Mathematical Modeling and Analyses of Interspike-Intervals of Spontaneous Activity in Afferent Neurons of the Zebrafish Lateral Line

Without stimuli, hair cells spontaneously release neurotransmitter leading to spontaneous generation of action potentials (spikes) in innervating afferent neurons. We analyzed spontaneous spike patterns recorded from the lateral line of zebrafish and found that distributions of interspike intervals (ISIs) either have an exponential shape or an "L" shape that is characterized by a sharp decay but wide tail. ISI data were fitted to renewal-process models that accounted for the neuron refractory periods and hair-cell synaptic release. Modeling the timing of synaptic release using a mixture of two exponential distributions yielded the best fit for our ISI data. Additionally, lateral line ISIs displayed positive serial correlation and appeared to exhibit switching between faster and slower modes of spike generation. This pattern contrasts with previous findings from the auditory system where ISIs tended to have negative serial correlation due to synaptic depletion. We propose that afferent neuron innervation with multiple and heterogenous hair-cells synapses, each influenced by changes in calcium domains, can serve as a mechanism for the random switching behavior. Overall, our analyses provide evidence of how physiological similarities and differences between synapses and innervation patterns in the auditory, vestibular, and lateral line systems can lead to variations in spontaneous activity.

First-passage times in renewal and nonrenewal systems

Fluctuations in stochastic systems are usually characterized by full counting statistics, which analyzes the distribution of the number of events taking place in the fixed time interval. In an alternative approach, the distribution of the first-passage times, i.e., the time delays after which the counting variable reaches a certain threshold value, is studied. This paper presents the approach to calculate the first-passage time distribution in systems in which the analyzed current is associated with an arbitrary set of transitions within the Markovian network. Using this approach, it is shown that when the subsequent first-passage times are uncorrelated, there exist strict relations between the cumulants of the full counting statistics and the first-passage time distribution. On the other hand, when the correlations of the first-passage times are present, their distribution may provide additional information about the internal dynamics of the system in comparison to the full counting statistics; for example, it may reveal the switching between different dynamical states of the system. Additionally, I show that breaking of the fluctuation theorem for first-passage times may reveal the multicyclic nature of the Markovian network.

Background firing in the auditory midbrain of the frog

Statistical characteristics of background firing in the midbrain auditory units of grass frog (Rana t. temporaria) located in torus semicircular (TS) were investigated. Only about 5% of the cells demonstrated prominent spontaneous firing. For such units the following characteristics were obtained: the distribution of interpulse intervals, the autocorrelation functions (ACF) for the real firing process and for the process with shuffled intervals, the hazard function (HF) and the joint distribution of adjacent interpulse intervals. The burstiness of firing was also estimated. In the absolute majority of the cells, the background firing demonstrated considerable deviation from the renewal process. There was weak but significant positive correlation between adjacent interpulse intervals. The burstiness of firing in the midbrain auditory units was moderate but higher than reported for medullary auditory neurons. The value of burstiness did not decrease after interval shuffling. Along with the reduction in excitability (generalized refractoriness) in many neurons observed post-spike facilitation effects were observed. Comparing background activity in medullary and midbrain nucleus suggests that there is an increase in complexity of the information processing along the auditory pathway.

SK channel subtypes enable parallel optimized coding of behaviorally relevant stimulus attributes: A review

Ion channels play essential roles toward determining how neurons respond to sensory input to mediate perception and behavior. Small conductance calcium-activated potassium (SK) channels are found ubiquitously throughout the brain and have been extensively characterized both molecularly and physiologically in terms of structure and function. It is clear that SK channels are key determinants of neural excitability as they mediate important neuronal response properties such as spike frequency adaptation. However, the functional roles of the different known SK channel subtypes are not well understood. Here we review recent evidence from the electrosensory system of weakly electric fish suggesting that the function of different SK channel subtypes is to optimize the processing of independent but behaviorally relevant stimulus attributes. Indeed, natural sensory stimuli frequently consist of a fast time-varying waveform (i.e., the carrier) whose amplitude (i.e., the envelope) varies slowly and independently. We first review evidence showing how somatic SK2 channels mediate tuning and responses to carrier waveforms. We then review evidence showing how dendritic SK1 channels instead determine tuning and optimize responses to envelope waveforms based on their statistics as found in the organism's natural environment in an independent fashion. The high degree of functional homology between SK channels in electric fish and their mammalian orthologs, as well as the many important parallels between the electrosensory system and the mammalian visual, auditory, and vestibular systems, suggest that these functional roles are conserved across systems and species.

Multi-scale detection of rate changes in spike trains with weak dependencies

The statistical analysis of neuronal spike trains by models of point processes often relies on the assumption of constant process parameters. However, it is a well-known problem that the parameters of empirical spike trains can be highly variable, such as for example the firing rate. In order to test the null hypothesis of a constant rate and to estimate the change points, a Multiple Filter Test (MFT) and a corresponding algorithm (MFA) have been proposed that can be applied under the assumption of independent inter spike intervals (ISIs). As empirical spike trains often show weak dependencies in the correlation structure of ISIs, we extend the MFT here to point processes associated with short range dependencies. By specifically estimating serial dependencies in the test statistic, we show that the new MFT can be applied to a variety of empirical firing patterns, including positive and negative serial correlations as well as tonic and bursty firing. The new MFT is applied to a data set of empirical spike trains with serial correlations, and simulations show improved performance against methods that assume independence. In case of positive correlations, our new MFT is necessary to reduce the number of false positives, which can be highly enhanced when falsely assuming independence. For the frequent case of negative correlations, the new MFT shows an improved detection probability of change points and thus, also a higher potential of signal extraction from noisy spike trains.

Social context differentially modulates activity of two interneuron populations in an avian basal ganglia nucleus

Basal ganglia circuits are critical for the modulation of motor performance across behavioral states. In zebra finches, a cortical-basal ganglia circuit dedicated to singing is necessary for males to adjust their song performance and transition between spontaneous singing, when they are alone ("undirected" song), and a performance state, when they sing to a female ("female-directed" song). However, we know little about the role of different basal ganglia cell types in this behavioral transition or the degree to which behavioral context modulates the activity of different neuron classes. To investigate whether interneurons in the songbird basal ganglia encode information about behavioral state, I recorded from two interneuron types, fast-spiking interneurons (FSI) and external pallidal (GPe) neurons, in the songbird basal ganglia nucleus area X during both female-directed and undirected singing. Both cell types exhibited higher firing rates, more frequent bursting, and greater trial-by-trial variability in firing when male zebra finches produced undirected songs compared with when they produced female-directed songs. However, the magnitude and direction of changes to the firing rate, bursting, and variability of spiking between when birds sat silently and when they sang undirected and female-directed song varied between FSI and GPe neurons. These data indicate that social modulation of activity important for eliciting changes in behavioral state is present in multiple cell types within area X and suggests that social interactions may adjust circuit dynamics during singing at multiple points within the circuit.

Cardiac Arrest-Induced Global Brain Hypoxia-Ischemia during Development Affects Spontaneous Activity Organization in Rat Sensory and Motor Thalamocortical Circuits during Adulthood

Normal maturation of sensory information processing in the cortex requires patterned synaptic activity during developmentally regulated critical periods. During early development, spontaneous synaptic activity establishes required patterns of synaptic input, and during later development it influences patterns of sensory experience-dependent neuronal firing. Thalamocortical neurons occupy a critical position in regulating the flow of patterned sensory information from the periphery to the cortex. Abnormal thalamocortical inputs may permanently affect the organization and function of cortical neuronal circuits, especially if they occur during a critical developmental window. We examined the effect of cardiac arrest (CA)-associated global brain hypoxia-ischemia in developing rats on spontaneous and evoked firing of somatosensory thalamocortical neurons and on large-scale correlations in the motor thalamocortical circuit. The mean spontaneous and sensory-evoked firing rate activity and variability were higher in CA injured rats. Furthermore, spontaneous and sensory-evoked activity and variability were correlated in uninjured rats, but not correlated in neurons from CA rats. Abnormal activity patterns of ventroposterior medial nucleus (VPm) neurons persisted into adulthood. Additionally, we found that neurons in the entopeduncular nucleus (EPN) in the basal ganglia had lower firing rates yet had higher variability and higher levels of burst firing after injury. Correlated levels of power in local field potentials (LFPs) between the EPN and the motor cortex (MCx) were also disrupted by injury. Our findings indicate that hypoxic-ischemic injury during development leads to abnormal spontaneous and sensory stimulus-evoked input patterns from thalamus to cortex. Abnormal thalamic inputs likely permanently and detrimentally affect the organization of cortical circuitry and processing of sensory information. Hypoxic-ischemic injury also leads to abnormal single neuron and population level activity in the basal ganglia that may contribute to motor dysfunction after injury. Combination of deficits in sensory and motor thalamocortical circuit function may negatively impact sensorimotor integration in CA survivors. Modulation of abnormal activity patterns post-injury may represent a novel therapeutic target to improve neurologic function in survivors.

Burst Firing in the Electrosensory System of Gymnotiform Weakly Electric Fish: Mechanisms and Functional Roles

Neurons across sensory systems and organisms often display complex patterns of action potentials in response to sensory input. One example of such a pattern is the tendency of neurons to fire packets of action potentials (i.e., a burst) followed by quiescence. While it is well known that multiple mechanisms can generate bursts of action potentials at both the single-neuron and the network level, the functional role of burst firing in sensory processing is not so well understood to date. Here we provide a comprehensive review of the known mechanisms and functions of burst firing in processing of electrosensory stimuli in gymnotiform weakly electric fish. We also present new evidence from existing data showing that bursts and isolated spikes provide distinct information about stimulus variance. It is likely that these functional roles will be generally applicable to other systems and species.

A Model for Single Neuron Activity With Refractory Effects and Spike Rate Estimation Techniques

The use of random point processes as models for neural spike trains allows the derivation of powerful statistical estimation techniques for time varying firing rates. Frequently, however, such estimators are based on the assumption that spike sequences follow a Poisson point process. Because of the bio-physical properties of neuronal action potentials, spike trains are affected by the refractory phenomenon that induces history dependency, and hence contradicts the Poisson assumption. In this work we present a neural spiking model, and a Maximum Likelihood (ML) estimation framework for time varying firing rates, that account for history dependencies in spike trains. Our framework is based on an exponential of polynomial model for the excitation function (stimulus), that generates a self exciting point process representing spike trains with absolute as well as relative refractory effects. Using this framework we employ techniques based on non-convex optimization and model order selection to derive ML estimators for neuronal firing rates. Results on simulated data with a refractory period show an improvement in accuracy when our estimation technique, that accounts for the complete refractory phenomenon, is used. Employing this estimation method for measured neuronal data shows an improvement in goodness of fit over estimators that do not account for the refractory effect, and also over other commonly used techniques.

The Gamma renewal process as an output of the diffusion leaky integrate-and-fire neuronal model

Statistical properties of spike trains as well as other neurophysiological data suggest a number of mathematical models of neurons. These models range from entirely descriptive ones to those deduced from the properties of the real neurons. One of them, the diffusion leaky integrate-and-fire neuronal model, which is based on the Ornstein-Uhlenbeck (OU) stochastic process that is restricted by an absorbing barrier, can describe a wide range of neuronal activity in terms of its parameters. These parameters are readily associated with known physiological mechanisms. The other model is descriptive, Gamma renewal process, and its parameters only reflect the observed experimental data or assumed theoretical properties. Both of these commonly used models are related here. We show under which conditions the Gamma model is an output from the diffusion OU model. In some cases, we can see that the Gamma distribution is unrealistic to be achieved for the employed parameters of the OU process.

Stein's neuronal model with pooled renewal input

The input of Stein's model of a single neuron is usually described by using a Poisson process, which is assumed to represent the behaviour of spikes pooled from a large number of presynaptic spike trains. However, such a description of the input is not always appropriate as the variability cannot be separated from the intensity. Therefore, we create and study Stein's model with a more general input, a sum of equilibrium renewal processes. The mean and variance of the membrane potential are derived for this model. Using these formulas and numerical simulations, the model is analyzed to study the influence of the input variability on the properties of the membrane potential and the output spike trains. The generalized Stein's model is compared with the original Stein's model with Poissonian input using the relative difference of variances of membrane potential at steady state and the integral square error of output interspike intervals. Both of the criteria show large differences between the models for input with high variability.

First-passage times in integrate-and-fire neurons with stochastic thresholds

We consider a leaky integrate-and-fire neuron with deterministic subthreshold dynamics and a firing threshold that evolves as an Ornstein-Uhlenbeck process. The formulation of this minimal model is motivated by the experimentally observed widespread variation of neural firing thresholds. We show numerically that the mean first-passage time can depend nonmonotonically on the noise amplitude. For sufficiently large values of the correlation time of the stochastic threshold the mean first-passage time is maximal for nonvanishing noise. We provide an explanation for this effect by analytically transforming the original model into a first-passage-time problem for Brownian motion. This transformation also allows for a perturbative calculation of the first-passage-time histograms. In turn this provides quantitative insights into the mechanisms that lead to the nonmonotonic behavior of the mean first-passage time. The perturbation expansion is in excellent agreement with direct numerical simulations. The approach developed here can be applied to any deterministic subthreshold dynamics and any Gauss-Markov processes for the firing threshold. This opens up the possibility to incorporate biophysically detailed components into the subthreshold dynamics, rendering our approach a powerful framework that sits between traditional integrate-and-fire models and complex mechanistic descriptions of neural dynamics.

Basic response properties of auditory nerve fibers: a review

All acoustic information from the periphery is encoded in the timing and rates of spikes in the population of spiral ganglion neurons projecting to the central auditory system. Considerable progress has been made in characterizing the physiological properties of type-I and type-II primary auditory afferents and understanding the basic properties of type-I afferents in response to sounds. Here, we review some of these properties, with emphasis placed on issues such as the stochastic nature of spike timing during spontaneous and driven activity, frequency tuning curves, spike-rate-versus-level functions, dynamic-range and spike-rate adaptation, and phase locking to stimulus fine structure and temporal envelope. We also review effects of acoustic trauma on some of these response properties.

Coding stimulus amplitude by correlated neural activity

While correlated activity is observed ubiquitously in the brain, its role in neural coding has remained controversial. Recent experimental results have demonstrated that correlated but not single-neuron activity can encode the detailed time course of the instantaneous amplitude (i.e., envelope) of a stimulus. These have furthermore demonstrated that such coding required and was optimal for a nonzero level of neural variability. However, a theoretical understanding of these results is still lacking. Here we provide a comprehensive theoretical framework explaining these experimental findings. Specifically, we use linear response theory to derive an expression relating the correlation coefficient to the instantaneous stimulus amplitude, which takes into account key single-neuron properties such as firing rate and variability as quantified by the coefficient of variation. The theoretical prediction was in excellent agreement with numerical simulations of various integrate-and-fire type neuron models for various parameter values. Further, we demonstrate a form of stochastic resonance as optimal coding of stimulus variance by correlated activity occurs for a nonzero value of noise intensity. Thus, our results provide a theoretical explanation of the phenomenon by which correlated but not single-neuron activity can code for stimulus amplitude and how key single-neuron properties such as firing rate and variability influence such coding. Correlation coding by correlated but not single-neuron activity is thus predicted to be a ubiquitous feature of sensory processing for neurons responding to weak input.

A model of synaptic vesicle-pool depletion and replenishment can account for the interspike interval distributions and nonrenewal properties of spontaneous spike trains of auditory-nerve fibers

In mammalian auditory systems, the spiking characteristics of each primary afferent (type I auditory-nerve fiber; ANF) are mainly determined by a single ribbon synapse in a single receptor cell (inner hair cell; IHC). ANF spike trains therefore provide a window into the operation of these synapses and cells. It was demonstrated previously (Heil et al., 2007) that the distribution of interspike intervals (ISIs) of cat ANFs during spontaneous activity can be modeled as resulting from refractoriness operating on a non-Poisson stochastic point process of excitation (transmitter release events from the IHC). Here, we investigate nonrenewal properties of these cat-ANF spontaneous spike trains, manifest as negative serial ISI correlations and reduced spike-count variability over short timescales. A previously discussed excitatory process, the constrained failure of events from a homogeneous Poisson point process, can account for these properties, but does not offer a parsimonious explanation for certain trends in the data. We then investigate a three-parameter model of vesicle-pool depletion and replenishment and find that it accounts for all experimental observations, including the ISI distributions, with only the release probability varying between spike trains. The maximum number of units (single vesicles or groups of simultaneously released vesicles) in the readily releasable pool and their replenishment time constant can be assumed to be constant (∼4 and 13.5 ms, respectively). We suggest that the organization of the IHC ribbon synapses not only enables sustained release of neurotransmitter but also imposes temporal regularity on the release process, particularly when operating at high rates.

Response to best-frequency tone bursts in the ventral cochlear nucleus is governed by ordered inter-spike interval statistics

The spike trains generated by short constant-amplitude constant-frequency tone bursts in the ventral cochlear nucleus of the anaesthetised guinea pig are examined. Spikes are grouped according to the order in which they occur following the onset of the stimulus. It is found that successive inter-spike intervals have low statistical dependence according to information-theoretic measures. This is in contrast to previous observations with long-duration tone bursts in the cat dorsal and posteroventral cochlear nuclei and lateral superior olive, where it was found that long intervals tended to be followed by shorter ones and vice versa. The interval distributions can also be reasonably modelled by a shifted Gamma distribution parameterised by the dead-time and the mean and coefficient of variation of the dead-time corrected ISI distribution. Knowledge of those three parameters for each interval is sufficient to determine the peri-stimulus time histogram and the regularity measures used to classify these neurons.

Event-triggered feedback in noise-driven phase oscillators

Using a stochastic nonlinear phase oscillator model, we study the effect of event-triggered feedback on the statistics of interevent intervals. Events are associated with the entering of a new cycle. The feedback is modeled by an instantaneous increase (positive feedback) or decrease (negative feedback) of the oscillator frequency whenever an event occurs followed by an exponential decay on a slow time scale. In addition to the known excitable and oscillatory regimes, which are separated by a saddle node on invariant circle bifurcation, positive feedback can lead to bistable dynamics and a change of the system's excitability. The feedback has also a strong effect on noise-induced phenomena like coherence resonance or anticoherence resonance. Both positive and negative feedback can lead to more regular output for particular noise strengths. Finally, we investigate serial correlations in the sequence of interevent intervals that occur due to the additional slow dynamics. We derive approximations for the serial correlation coefficient and show that positive feedback results in extended positive interval correlations, whereas negative feedback yields short-ranging negative correlations. Investigating the interplay of feedback and the nonlinear phase dynamics close to the bifurcation, we find that correlations are most pronounced for optimal feedback strengths.

Estimating nonstationary inputs from a single spike train based on a neuron model with adaptation

Because every spike of a neuron is determined by input signals, a train of spikes may contain information about the dynamics of unobserved neurons. A state-space method based on the leaky integrate-and-fire model, describing neuronal transformation from input signals to a spike train has been proposed for tracking input parameters represented by their mean and fluctuation [11]. In the present paper, we propose to make the estimation more realistic by adopting an LIF model augmented with an adaptive moving threshold. Moreover, because the direct state-space method is computationally infeasible for a data set comprising thousands of spikes, we further develop a practical method for transforming instantaneous firing characteristics back to input parameters. The instantaneous firing characteristics, represented by the firing rate and non-Poisson irregularity, can be estimated using a computationally feasible algorithm. We applied our proposed methods to synthetic data to clarify that they perform well.

Fano factor estimation

Fano factor is one of the most widely used measures of variability of spike trains. Its standard estimator is the ratio of sample variance to sample mean of spike counts observed in a time window and the quality of the estimator strongly depends on the length of the window. We investigate this dependence under the assumption that the spike train behaves as an equilibrium renewal process. It is shown what characteristics of the spike train have large effect on the estimator bias. Namely, the effect of refractory period is analytically evaluated. Next, we create an approximate asymptotic formula for the mean square error of the estimator, which can also be used to find minimum of the error in estimation from single spike trains. The accuracy of the Fano factor estimator is compared with the accuracy of the estimator based on the squared coefficient of variation. All the results are illustrated for spike trains with gamma and inverse Gaussian probability distributions of interspike intervals. Finally, we discuss possibilities of how to select a suitable observation window for the Fano factor estimation.

Patterns of interval correlations in neural oscillators with adaptation

Neural firing is often subject to negative feedback by adaptation currents. These currents can induce strong correlations among the time intervals between spikes. Here we study analytically the interval correlations of a broad class of noisy neural oscillators with spike-triggered adaptation of arbitrary strength and time scale. Our weak-noise theory provides a general relation between the correlations and the phase-response curve (PRC) of the oscillator, proves anti-correlations between neighboring intervals for adapting neurons with type I PRC and identifies a single order parameter that determines the qualitative pattern of correlations. Monotonically decaying or oscillating correlation structures can be related to qualitatively different voltage traces after spiking, which can be explained by the phase plane geometry. At high firing rates, the long-term variability of the spike train associated with the cumulative interval correlations becomes small, independent of model details. Our results are verified by comparison with stochastic simulations of the exponential, leaky, and generalized integrate-and-fire models with adaptation.

Temporal whitening by power-law adaptation in neocortical neurons

Spike-frequency adaptation (SFA) is widespread in the CNS, but its function remains unclear. In neocortical pyramidal neurons, adaptation manifests itself by an increase in the firing threshold and by adaptation currents triggered after each spike. Combining electrophysiological recordings in mice with modeling, we found that these adaptation processes lasted for more than 20 s and decayed over multiple timescales according to a power law. The power-law decay associated with adaptation mirrored and canceled the temporal correlations of input current received in vivo at the somata of layer 2/3 somatosensory pyramidal neurons. These findings suggest that, in the cortex, SFA causes temporal decorrelation of output spikes (temporal whitening), an energy-efficient coding procedure that, at high signal-to-noise ratio, improves the information transfer.

Channel noise from both slow adaptation currents and fast currents is required to explain spike-response variability in a sensory neuron

Spike-timing variability has a large effect on neural information processing. However, for many systems little is known about the noise sources causing the spike-response variability. Here we investigate potential sources of spike-response variability in auditory receptor neurons of locusts, a classic insect model system. At low-spike frequencies, our data show negative interspike-interval (ISI) correlations and ISI distributions that match the inverse Gaussian distribution. These findings can be explained by a white-noise source that interacts with an adaptation current. At higher spike frequencies, more strongly peaked distributions and positive ISI correlations appear, as expected from a canonical model of suprathreshold firing driven by temporally correlated (i.e., colored) noise. Simulations of a minimal conductance-based model of the auditory receptor neuron with stochastic ion channels exclude the delayed rectifier as a possible noise source. Our analysis suggests channel noise from an adaptation current and the receptor or sodium current as main sources for the colored and white noise, respectively. By comparing the ISI statistics with generic models, we find strong evidence for two distinct noise sources. Our approach does not involve any dendritic or somatic recordings that may harm the delicate workings of many sensory systems. It could be applied to various other types of neurons, in which channel noise dominates the fluctuations that shape the neuron's spike statistics.

Efficient associative memory storage in cortical circuits of inhibitory and excitatory neurons

Many features of synaptic connectivity are ubiquitous among cortical systems. Cortical networks are dominated by excitatory neurons and synapses, are sparsely connected, and function with stereotypically distributed connection weights. We show that these basic structural and functional features of synaptic connectivity arise readily from the requirement of efficient associative memory storage. Our theory makes two fundamental predictions. First, we predict that, despite a large number of neuron classes, functional connections between potentially connected cells must be realized with <50% probability if the presynaptic cell is excitatory and >50% probability if the presynaptic cell is inhibitory. Second, we establish a unique relation between probability of connection and coefficient of variation in connection weights. These predictions are consistent with a dataset of 74 published experiments reporting connection probabilities and distributions of postsynaptic potential amplitudes in various cortical systems. What is more, our theory explains the shapes of the distributions obtained in these experiments.

Estimating individual firing frequencies in a multiple spike train record

Neuronal activity of several neurons is commonly recorded by a single electrode and then the individual spike trains are separated. If the separation is difficult or fails, then as a minimal result of the experiment, the individual firing rates are of interest. The proposed method solves the problem of their identification. This is possible under the condition that the recorded neurons are independent in their activities. The number of the neurons in the multi-unit record needs to be given (known or assumed) prior the calculation. The proposed method is based on the presence of the refractory period in neuronal firing, however, its precise value is not required. In addition to the determination of the individual firing rates the method can be used for an inference about the refractory period itself.

Bursts and isolated spikes code for opposite movement directions in midbrain electrosensory neurons

Directional selectivity, in which neurons respond strongly to an object moving in a given direction but weakly or not at all to the same object moving in the opposite direction, is a crucial computation that is thought to provide a neural correlate of motion perception. However, directional selectivity has been traditionally quantified by using the full spike train, which does not take into account particular action potential patterns. We investigated how different action potential patterns, namely bursts (i.e. packets of action potentials followed by quiescence) and isolated spikes, contribute to movement direction coding in a mathematical model of midbrain electrosensory neurons. We found that bursts and isolated spikes could be selectively elicited when the same object moved in opposite directions. In particular, it was possible to find parameter values for which our model neuron did not display directional selectivity when the full spike train was considered but displayed strong directional selectivity when bursts or isolated spikes were instead considered. Further analysis of our model revealed that an intrinsic burst mechanism based on subthreshold T-type calcium channels was not required to observe parameter regimes for which bursts and isolated spikes code for opposite movement directions. However, this burst mechanism enhanced the range of parameter values for which such regimes were observed. Experimental recordings from midbrain neurons confirmed our modeling prediction that bursts and isolated spikes can indeed code for opposite movement directions. Finally, we quantified the performance of a plausible neural circuit and found that it could respond more or less selectively to isolated spikes for a wide range of parameter values when compared with an interspike interval threshold. Our results thus show for the first time that different action potential patterns can differentially encode movement and that traditional measures of directional selectivity need to be revised in such cases.

Spike-interval triggered averaging reveals a quasi-periodic spiking alternative for stochastic resonance in catfish electroreceptors

Catfish detect and identify invisible prey by sensing their ultra-weak electric fields with electroreceptors. Any neuron that deals with small-amplitude input has to overcome sensitivity limitations arising from inherent threshold non-linearities in spike-generation mechanisms. Many sensory cells solve this issue with stochastic resonance, in which a moderate amount of intrinsic noise causes irregular spontaneous spiking activity with a probability that is modulated by the input signal. Here we show that catfish electroreceptors have adopted a fundamentally different strategy. Using a reverse correlation technique in which we take spike interval durations into account, we show that the electroreceptors generate a supra-threshold bias current that results in quasi-periodically produced spikes. In this regime stimuli modulate the interval between successive spikes rather than the instantaneous probability for a spike. This alternative for stochastic resonance combines threshold-free sensitivity for weak stimuli with similar sensitivity for excitations and inhibitions based on single interspike intervals.

Identifying temporal codes in spontaneously active sensory neurons

The manner in which information is encoded in neural signals is a major issue in Neuroscience. A common distinction is between rate codes, where information in neural responses is encoded as the number of spikes within a specified time frame (encoding window), and temporal codes, where the position of spikes within the encoding window carries some or all of the information about the stimulus. One test for the existence of a temporal code in neural responses is to add artificial time jitter to each spike in the response, and then assess whether or not information in the response has been degraded. If so, temporal encoding might be inferred, on the assumption that the jitter is small enough to alter the position, but not the number, of spikes within the encoding window. Here, the effects of artificial jitter on various spike train and information metrics were derived analytically, and this theory was validated using data from afferent neurons of the turtle vestibular and paddlefish electrosensory systems, and from model neurons. We demonstrate that the jitter procedure will degrade information content even when coding is known to be entirely by rate. For this and additional reasons, we conclude that the jitter procedure by itself is not sufficient to establish the presence of a temporal code.

Onset of negative interspike interval correlations in adapting neurons

Negative serial correlations in single spike trains are an effective method to reduce the variability of spike counts. One of the factors contributing to the development of negative correlations between successive interspike intervals is the presence of adaptation currents. In this work, based on a hidden Markov model and a proper statistical description of conditional responses, we obtain analytically these correlations in an adequate dynamical neuron model resembling adaptation. We derive the serial correlation coefficients for arbitrary lags, under a small adaptation scenario. In this case, the behavior of correlations is universal and depends on the first-order statistical description of an exponentially driven time-inhomogeneous stochastic process.

Language organization and temporal correlations in the spiking activity of an excitable laser: experiments and model comparison

We introduce a method, based on symbolic analysis, to characterize the temporal correlations of the spiking activity exhibited by excitable systems. The technique is applied to the experimentally observed dynamics of a semiconductor laser with optical feedback operating in the low-frequency fluctuations regime, where the laser intensity displays irregular trains of sudden dropouts that can be interpreted as excitable pulses. Symbolic analysis transforms the series of interdropout time intervals into sequences of words, which represent the local ordering of a certain (small) number of those intervals. We then focus on the transition probabilities between pairs of words, showing that certain transitions are overrepresented (resulting in others being underrepresented) with respect to the surrogate series, provided the laser injection current is above a critical value. These experimental observations are in very good agreement with numerical simulations of the delay-differential Lang-Kobayashi model that is commonly used to describe this laser system, which supports the fact that the language organization reported here is generic and not a particular feature of the specific laser employed or the experimental time series analyzed. We also present results of simulations of the phenomenological nondelayed Eguia-Mindlin-Giudici(EMG) model and find that in this model the agreement between the experiments and the simulations is good at a qualitative, but not at a quantitative, level.

Efficient computation via sparse coding in electrosensory neural networks

The electric sense combines spatial aspects of vision and touch with temporal features of audition. Its accessible neural architecture shares similarities with mammalian sensory systems and allows for recordings from successive brain areas to test hypotheses about neural coding. Further, electrosensory stimuli encountered during prey capture, navigation, and communication, can be readily synthesized in the laboratory. These features enable analyses of the neural circuitry that reveal general principles of encoding and decoding, such as segregation of information into separate streams and neural response sparsification. A systems level understanding arises via linkage between cellular differentiation and network architecture, revealed by in vitro and in vivo analyses, while computational modeling reveals how single cell dynamics and connectivity shape the sparsification process.