Cooperative behavior in periodically driven noisy integrate-fire models of neuronal dynamics

Uncovering hidden network architecture from spiking activities using an exact statistical input-output relation of neurons

Identifying network architecture from observed neural activities is crucial in neuroscience studies. A key requirement is knowledge of the statistical input-output relation of single neurons in vivo. By utilizing an exact analytical solution of the spike-timing for leaky integrate-and-fire neurons under noisy inputs balanced near the threshold, we construct a framework that links synaptic type, strength, and spiking nonlinearity with the statistics of neuronal population activity. The framework explains structured pairwise and higher-order interactions of neurons receiving common inputs under different architectures. We compared the theoretical predictions with the activity of monkey and mouse V1 neurons and found that excitatory inputs given to pairs explained the observed sparse activity characterized by strong negative triple-wise interactions, thereby ruling out the alternative explanation by shared inhibition. Moreover, we showed that the strong interactions are a signature of excitatory rather than inhibitory inputs whenever the spontaneous rate is low. We present a guide map of neural interactions that help researchers to specify the hidden neuronal motifs underlying observed interactions found in empirical data.

Mapping input noise to escape noise in integrate-and-fire neurons: a level-crossing approach

Noise in spiking neurons is commonly modeled by a noisy input current or by generating output spikes stochastically with a voltage-dependent hazard rate ("escape noise"). While input noise lends itself to modeling biophysical noise processes, the phenomenological escape noise is mathematically more tractable. Using the level-crossing theory for differentiable Gaussian processes, we derive an approximate mapping between colored input noise and escape noise in leaky integrate-and-fire neurons. This mapping requires the first-passage-time (FPT) density of an overdamped Brownian particle driven by colored noise with respect to an arbitrarily moving boundary. Starting from the Wiener-Rice series for the FPT density, we apply the second-order decoupling approximation of Stratonovich to the case of moving boundaries and derive a simplified hazard-rate representation that is local in time and numerically efficient. This simplification requires the calculation of the non-stationary auto-correlation function of the level-crossing process: For exponentially correlated input noise (Ornstein-Uhlenbeck process), we obtain an exact formula for the zero-lag auto-correlation as a function of noise parameters, mean membrane potential and its speed, as well as an exponential approximation of the full auto-correlation function. The theory well predicts the FPT and interspike interval densities as well as the population activities obtained from simulations with colored input noise and time-dependent stimulus or boundary. The agreement with simulations is strongly enhanced across the sub- and suprathreshold firing regime compared to a first-order decoupling approximation that neglects correlations between level crossings. The second-order approximation also improves upon a previously proposed theory in the subthreshold regime. Depending on a simplicity-accuracy trade-off, all considered approximations represent useful mappings from colored input noise to escape noise, enabling progress in the theory of neuronal population dynamics.

Visibility-graphlet approach to the output series of a Hodgkin-Huxley neuron

The output signals of neurons that are exposed to external stimuli are of great importance for brain functionality. Traditional time-series analysis methods have provided encouraging results; however, the associated patterns and their correlations in the output signals of neurons are masked by statistical procedures. Here, graphlets are employed to extract the local temporal patterns and the transitions between them from the output signals when neurons are exposed to external stimuli with selected stimulating periods. A transition network is defined where the node is the graphlet and the direct link is the transition between two successive graphlets. The transition-network structure is affected by the simulating periods. When the stimulating period moves close to an integer multiple of the neuronal intrinsic period, only the backbone or core survives, while the other linkages disappear. Interestingly, the size of the backbone (number of nodes) equals the multiple. The transition-network structure is conservative within each stimulating region, which is defined as the range between two successive integer multiples. Nevertheless, the backbone or detailed structure is significantly altered between different stimulating regions. This alternation is induced primarily from a total of 12 active linkages. Hence, the transition network shows the structure of cross correlations in the output time-series for a single neuron.

DNA breathing dynamics under periodic forcing: Study of several distribution functions of relevant Brownian functionals

In this paper, we study DNA breathing dynamics in the presence of an external periodic force by proposing and inspecting several probability distribution functions (PDFs) of relevant Brownian functionals which specify the bubble lifetime, reactivity, and average size. We model the bubble dynamics process by an overdamped Langevin equation of broken base pairs on the Poland-Scheraga free energy landscape. Introducing an effective time-independent description for timescales larger than T[over ̃]=2π/ω (where ω is the frequency of external periodic force) and using an elegant backward Fokker-Planck method we derive closed form expressions of several PDFs associated with such stochastic processes. For instance, with an initial bubble size of x_{0}, we derive the following analytical expressions: (i) the PDF P(t_{f}|x_{0}) of the first passage time t_{f} which specifies the lifetime of the DNA breathing process, (ii) the PDF P(A|x_{0}) of the area A until the first passage time, and it provides much valuable information about the average bubble size and reactivity of the process, and (iii) the PDF P(M) associated with the maximum bubble size M of the breathing process before complete denaturation. Our analysis is limited to two limits: (a) large bubble size and (b) small bubble size. We further confirm our analytical predictions by computing the same PDFs with direct numerical simulations of the corresponding Langevin equations. We obtain very good agreement of our theoretical predictions with the numerically simulated results. Finally, several nontrivial scaling behaviors in the asymptotic limits for the above-mentioned PDFs are predicted, which can be verified further from experimental observation. Our main conclusion is that the large bubble dynamics is unaffected by the rapidly oscillating force, but the small bubble dynamics is significantly affected by the same periodic force.

New Type of Spectral Nonlinear Resonance Enhances Identification of Weak Signals

Some nonlinear systems possess innate capabilities of enhancing weak signal transmissions through a unique process called Stochastic Resonance (SR). However, existing SR mechanism suffers limited signal enhancement from inappropriate entraining signals. Here we propose a new and effective implementation, resulting in a new type of spectral resonance similar to SR but capable of achieving orders of magnitude higher signal enhancement than previously reported. By employing entraining frequency in the range of the weak signal, strong spectral resonances can be induced to facilitate nonlinear modulations and intermodulations, thereby strengthening the weak signal. The underlying physical mechanism governing the behavior of spectral resonances is examined, revealing the inherent advantages of the proposed spectral resonances over the existing implementation of SR. Wide range of parameters have been found for the optimal enhancement of any given weak signal and an analytical method is established to estimate these required parameters. A reliable algorithm is also developed for the identifications of weak signals using signal processing techniques. The present work can significantly improve existing SR performances and can have profound practical applications where SR is currently employed for its inherent technological advantages.

Multiplicative noise is beneficial for the transmission of sensory signals in simple neuron models

We study simple integrate-and-fire type models with multiplicative noise and consider the transmission of a weak and slow signal, i.e. a signal that evokes a small modulation of the instantaneous firing rate on time scales that are much larger than the membrane time scale and the mean interspike interval. The specific question of interest is whether and how the state-dependence of the noise can be optimized with respect to information transmission. First, in a simple model in which the noise intensity varies linearly with the state variable, we show analytically that multiplicative fluctuations may benefit the signal transfer and we elucidate the mechanism for this improvement. In a conductance-based integrate-and-fire model with synaptically filtered shot-noise input, we show by means of extended numerical simulations that also in a biophysically more relevant situation, multiplicative noise can enhance the signal-to-noise ratio. Our results shed light on a so far unexplored aspect of stochastic signal transmission in neural systems.

How does transient signaling input affect the spike timing of postsynaptic neuron near the threshold regime: an analytical study

The noisy threshold regime, where even a small set of presynaptic neurons can significantly affect postsynaptic spike-timing, is suggested as a key requisite for computation in neurons with high variability. It also has been proposed that signals under the noisy conditions are successfully transferred by a few strong synapses and/or by an assembly of nearly synchronous synaptic activities. We analytically investigate the impact of a transient signaling input on a leaky integrate-and-fire postsynaptic neuron that receives background noise near the threshold regime. The signaling input models a single strong synapse or a set of synchronous synapses, while the background noise represents a lot of weak synapses. We find an analytic solution that explains how the first-passage time (ISI) density is changed by transient signaling input. The analysis allows us to connect properties of the signaling input like spike timing and amplitude with postsynaptic first-passage time density in a noisy environment. Based on the analytic solution, we calculate the Fisher information with respect to the signaling input’s amplitude. For a wide range of amplitudes, we observe a non-monotonic behavior for the Fisher information as a function of background noise. Moreover, Fisher information non-trivially depends on the signaling input’s amplitude; changing the amplitude, we observe one maximum in the high level of the background noise. The single maximum splits into two maximums in the low noise regime. This finding demonstrates the benefit of the analytic solution in investigating signal transfer by neurons.

Addition of visual noise boosts evoked potential-based brain-computer interface

Although noise has a proven beneficial role in brain functions, there have not been any attempts on the dedication of stochastic resonance effect in neural engineering applications, especially in researches of brain-computer interfaces (BCIs). In our study, a steady-state motion visual evoked potential (SSMVEP)-based BCI with periodic visual stimulation plus moderate spatiotemporal noise can achieve better offline and online performance due to enhancement of periodic components in brain responses, which was accompanied by suppression of high harmonics. Offline results behaved with a bell-shaped resonance-like functionality and 7–36% online performance improvements can be achieved when identical visual noise was adopted for different stimulation frequencies. Using neural encoding modeling, these phenomena can be explained as noise-induced input-output synchronization in human sensory systems which commonly possess a low-pass property. Our work demonstrated that noise could boost BCIs in addressing human needs.

Fokker-Planck and Fortet Equation-Based Parameter Estimation for a Leaky Integrate-and-Fire Model with Sinusoidal and Stochastic Forcing

Analysis of sinusoidal noisy leaky integrate-and-fire models and comparison with experimental data are important to understand the neural code and neural synchronization and rhythms. In this paper, we propose two methods to estimate input parameters using interspike interval data only. One is based on numerical solutions of the Fokker-Planck equation, and the other is based on an integral equation, which is fulfilled by the interspike interval probability density. This generalizes previous methods tailored to stationary data to the case of time-dependent input. The main contribution is a binning method to circumvent the problems of nonstationarity, and an easy-to-implement initializer for the numerical procedures. The methods are compared on simulated data.

LIST OF ABBREVIATIONS LIF

Leaky integrate-and-fireISI: Interspike intervalSDE: Stochastic differential equationPDE: Partial differential equation.

Cooperative behavior in a jump diffusion model for a simple network of spiking neurons

The distribution of time intervals between successive spikes generated by a neuronal cell --the interspike intervals (ISI)-- may reveal interesting features of the underlying dynamics. In this study we analyze the ISI sequence --the spike train-- generated by a simple network of neurons whose output activity is modeled by a jump-diffusion process. We prove that, when specific ranges of the involved parameters are chosen, it is possible to observe multimodal ISI distributions which reveal that the modeled network fires with more than one single preferred time interval. Furthermore, the system exhibits resonance behavior, with modulation of the spike timings by the noise intensity. We also show that inhibition helps the signal transmission between the units of the simple network.

Characteristic effects of stochastic oscillatory forcing on neural firing: analytical theory and comparison to paddlefish electroreceptor data

Stochastic signals with pronounced oscillatory components are frequently encountered in neural systems. Input currents to a neuron in the form of stochastic oscillations could be of exogenous origin, e.g. sensory input or synaptic input from a network rhythm. They shape spike firing statistics in a characteristic way, which we explore theoretically in this report. We consider a perfect integrate-and-fire neuron that is stimulated by a constant base current (to drive regular spontaneous firing), along with Gaussian narrow-band noise (a simple example of stochastic oscillations), and a broadband noise. We derive expressions for the nth-order interval distribution, its variance, and the serial correlation coefficients of the interspike intervals (ISIs) and confirm these analytical results by computer simulations. The theory is then applied to experimental data from electroreceptors of paddlefish, which have two distinct types of internal noisy oscillators, one forcing the other. The theory provides an analytical description of their afferent spiking statistics during spontaneous firing, and replicates a pronounced dependence of ISI serial correlation coefficients on the relative frequency of the driving oscillations, and furthermore allows extraction of certain parameters of the intrinsic oscillators embedded in these electroreceptors.

Cooperation in neural systems: bridging complexity and periodicity

Inverse power law distributions are generally interpreted as a manifestation of complexity, and waiting time distributions with power index μ<2 reflect the occurrence of ergodicity-breaking renewal events. In this paper we show how to combine these properties with the apparently foreign clocklike nature of biological processes. We use a two-dimensional regular network of leaky integrate-and-fire neurons, each of which is linked to its four nearest neighbors, to show that both complexity and periodicity are generated by locality breakdown: Links of increasing strength have the effect of turning local interactions into long-range interactions, thereby generating time complexity followed by time periodicity. Increasing the density of neuron firings reduces the influence of periodicity, thus creating a cooperation-induced renewal condition that is distinctly non-Poissonian.

Spiking Neurons and the First Passage Problem

We derive a model of a neuron’s interspike interval probability density through analysis of the first passage problem. The fit of our expression to retinal ganglion cell laboratory data extracts three physiologically relevant parameters, with which our model yields input-output features that conform to laboratory results. Preliminary analysis suggests that under common circumstances, local circuitry readjusts these parameters with changes in firing rate and so endeavors to faithfully replicate an input signal. Further results suggest that the so-called principle of sloppy workmanship also plays a role in evolution’s choice of these parameters.

Path integral approach to the pricing of timer options with the Duru-Kleinert time transformation

In this paper, a time substitution as used by Duru and Kleinert in their treatment of the hydrogen atom with path integrals is performed to price timer options under stochastic volatility models. We present general pricing formulas for both the perpetual timer call options and the finite time-horizon timer call options. These general results allow us to find closed-form pricing formulas for both the perpetual and the finite time-horizon timer options under the 3/2 stochastic volatility model as well as under the Heston stochastic volatility model. For the treatment of timer options under the 3/2 model we will rely on the path integral for the Morse potential, with the Heston model we will rely on the Kratzer potential.

Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity

In this work we study the detection of weak stimuli by spiking (integrate-and-fire) neurons in the presence of certain level of noisy background neural activity. Our study has focused in the realistic assumption that the synapses in the network present activity-dependent processes, such as short-term synaptic depression and facilitation. Employing mean-field techniques as well as numerical simulations, we found that there are two possible noise levels which optimize signal transmission. This new finding is in contrast with the classical theory of stochastic resonance which is able to predict only one optimal level of noise. We found that the complex interplay between adaptive neuron threshold and activity-dependent synaptic mechanisms is responsible for this new phenomenology. Our main results are confirmed by employing a more realistic FitzHugh-Nagumo neuron model, which displays threshold variability, as well as by considering more realistic stochastic synaptic models and realistic signals such as poissonian spike trains.

Survival probability and first-passage-time statistics of a Wiener process driven by an exponential time-dependent drift

The survival probability and the first-passage-time statistics are important quantities in different fields. The Wiener process is the simplest stochastic process with continuous variables, and important results can be explicitly found from it. The presence of a constant drift does not modify its simplicity; however, when the process has a time-dependent component the analysis becomes difficult. In this work we analyze the statistical properties of the Wiener process with an absorbing boundary, under the effect of an exponential time-dependent drift. Based on the backward Fokker-Planck formalism we set the time-inhomogeneous equation and conditions that rule the diffusion of the corresponding survival probability. We propose as the solution an expansion series in terms of the intensity of the exponential drift, resulting in a set of recurrence equations. We explicitly solve the expansion up to second order and comment on higher-order solutions. The first-passage-time density function arises naturally from the survival probability and preserves the proposed expansion. Explicit results, related properties, and limit behaviors are analyzed and extensively compared to numerical simulations.

Distribution of interspike intervals estimated from multiple spike trains observed in a short time window

Several nonparametric estimators of the probability distribution of interspike intervals are introduced. The methods are suitable for simultaneous spike trains observed in a time window of length comparable with the mean interspike interval. This reflects the situation in which a high number of input spike trains converge to a single cortical neuron that has to react in a relatively short time. The simulation study is performed to compare the estimators. For that purpose, several types of stationary point processes are considered as the models of neuronal activity. The methods permit one to estimate the distribution of interspike intervals even if practically none of them are observed. The Kaplan-Meier estimator seems to be the most flexible and reliable among all studied methods, but no direct conclusions as to how real neurons work can be deduced from it.

Estimating input parameters from intracellular recordings in the Feller neuronal model

We study the estimation of the input parameters in a Feller neuronal model from a trajectory of the membrane potential sampled at discrete times. These input parameters are identified with the drift and the infinitesimal variance of the underlying stochastic diffusion process with multiplicative noise. The state space of the process is restricted from below by an inaccessible boundary. Further, the model is characterized by the presence of an absorbing threshold, the first hitting of which determines the length of each trajectory and which constrains the state space from above. We compare, both in the presence and in the absence of the absorbing threshold, the efficiency of different known estimators. In addition, we propose an estimator for the drift term, which is proved to be more efficient than the others, at least in the explored range of the parameters. The presence of the threshold makes the estimates of the drift term biased, and two methods to correct it are proposed.

Quasistatic approximation of the interspike interval distribution of neurons driven by time-dependent inputs

Variability in neural responses is a ubiquitous phenomenon in neurons, usually modeled with stochastic differential equations. In particular, stochastic integrate-and-fire models are widely used to simplify theoretical studies. The statistical properties of the generated spikes depend on the stimulating input current. Given that real sensory neurons are driven by time-dependent signals, here we study how the interspike interval distribution of integrate-and-fire neurons depends on the evolution of the stimulus in a quasistatic limit. We obtain a closed-form expression for this distribution, and we compare it to the one obtained with numerical simulations for several time-dependent currents. For slow inputs, the quasistatic distribution provides a very good description of the data. The results obtained for the integrate-and-fire model can be extended to other nonautonomous stochastic systems where the first passage time problem has an explicit solution.

Are the input parameters of white noise driven integrate and fire neurons uniquely determined by rate and CV?

Integrate and fire (IF) neurons have found widespread applications in computational neuroscience. Particularly important are stochastic versions of these models where the driving consists of a synaptic input modeled as white Gaussian noise with mean mu and noise intensity D. Different IF models have been proposed, the firing statistics of which depends nontrivially on the input parameters mu and D. In order to compare these models among each other, one must first specify the correspondence between their parameters. This can be done by determining which set of parameters (mu,D) of each model is associated with a given set of basic firing statistics as, for instance, the firing rate and the coefficient of variation (CV) of the interspike interval (ISI). However, it is not clear a priori whether for a given firing rate and CV there is only one unique choice of input parameters for each model. Here we review the dependence of rate and CV on input parameters for the perfect, leaky, and quadratic IF neuron models and show analytically that indeed in these three models the firing rate and the CV uniquely determine the input parameters.

A review of the methods for signal estimation in stochastic diffusion leaky integrate-and-fire neuronal models

Parameters in diffusion neuronal models are divided into two groups; intrinsic and input parameters. Intrinsic parameters are related to the properties of the neuronal membrane and are assumed to be known throughout the paper. Input parameters characterize processes generated outside the neuron and methods for their estimation are reviewed here. Two examples of the diffusion neuronal model, which are based on the integrate-and-fire concept, are investigated--the Ornstein--Uhlenbeck model as the most common one and the Feller model as an illustration of state-dependent behavior in modeling the neuronal input. Two types of experimental data are assumed-intracellular describing the membrane trajectories and extracellular resulting in knowledge of the interspike intervals. The literature on estimation from the trajectories of the diffusion process is extensive and thus the stress in this review is set on the inference made from the interspike intervals.

On the evaluation of firing densities for periodically driven neuron models

The leaky integrate-and-fire model for neuronal spiking events driven by a periodic stimulus is studied by using the Fokker-Planck formulation. To this purpose, an essential use is made of the asymptotic behavior of the first-passage-time probability density function of a time homogeneous diffusion process through an asymptotically periodic threshold. Numerical comparisons with some recently published results derived by a different approach are performed. Use of a new asymptotic approximation is then made in order to design a numerical algorithm of predictor-corrector type to solve the integral equation in the unknown first-passage-time probability density function. Such algorithm, characterized by a reduced (linear) computation time, is seen to provide a high computation accuracy. Finally, it is shown that such an approach yields excellent approximations to the firing probability density function for a wide range of parameters, including the case of high stimulus frequencies.

Interspike interval statistics of a leaky integrate-and-fire neuron driven by Gaussian noise with large correlation times

We analytically investigate the interspike interval (ISI) density, the Fano factor, and the coefficient of variation of a leaky integrate-and-fire neuron model driven by exponentially correlated Gaussian noise with a large correlation time tau . We find a burstinglike behavior of the spike train, which is revealed by a dominant peak of the ISI density at small intraburst intervals and a slow power-law decay of long interburst intervals. The large, power-law distributed ISIs give rise to a coefficient of variation which diverges as square root [tau] . This leads to the paradoxical effect that ISI correlations, as expressed by the serial correlation coefficient, vanish for large correlation times. This is in contrast to findings of previous works on a simpler neuron model where the effect of noise correlations appeared in higher-order statistical measures.

Parameters of stochastic diffusion processes estimated from observations of first-hitting times: application to the leaky integrate-and-fire neuronal model

A theoretical model has to stand the test against the real world to be of any practical use. The first step is to identify parameters in the model estimated from experimental data. In many applications where renewal point data are available, models of first-hitting times of underlying diffusion processes arise. Despite the seemingly simplicity of the model, the problem of how to estimate parameters of the underlying stochastic process has resisted solution. The few attempts have either been unreliable, difficult to implement, or only valid in subsets of the relevant parameter space. Here we present an estimation method that overcomes these difficulties, is computationally easy and fast to implement, and also works surprisingly well on small data sets. The method is illustrated on simulated and experimental data. Two common neuronal models--the Ornstein-Uhlenbeck and Feller models--are investigated.

Optimum signal in a diffusion leaky integrate-and-fire neuronal model

An optimum signal in the Ornstein-Uhlenbeck neuronal model is determined on the basis of interspike interval data. Two criteria are proposed for this purpose. The first, the classical one, is based on searching for maxima of the slope of the frequency transfer function. The second one uses maximum of the Fisher information, which is, under certain conditions, the inverse variance of the best possible estimator. The Fisher information is further normalized with respect to the time required to make the observation on which the signal estimation is performed. Three variants of the model are investigated. Beside the basic one, we use the version obtained by inclusion of the refractory period. Finally, we investigate such a version of the model in which signal and the input parameter of the model are in a nonlinear relationship. The results show that despite qualitative similarity between the criteria, there is substantial quantitative difference. As a common feature, we found that in the Ornstein-Uhlenbeck model with increasing noise the optimum signal decreases and the coding range gets broader.

Stochastic resonance in two simple compare-and-fire models

Two neural models are analysed and shown to exhibit the stochastic resonance effect. Namely, they respond to an underthreshold sinusoidal signal with an output signal whose signal-to-noise ratio (SNR) firstly increases then decreases as the intensity of noise affecting the system increases. The resonance curves are determined, analytically for the first and simplest model and by a synthetic method for the second one, and the respective resonant behaviours are illustrated and interpreted.

A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties

The integrate-and-fire neuron model describes the state of a neuron in terms of its membrane potential, which is determined by the synaptic inputs and the injected current that the neuron receives. When the membrane potential reaches a threshold, an action potential (spike) is generated. This review considers the model in which the synaptic input varies periodically and is described by an inhomogeneous Poisson process, with both current and conductance synapses. The focus is on the mathematical methods that allow the output spike distribution to be analyzed, including first passage time methods and the Fokker-Planck equation. Recent interest in the response of neurons to periodic input has in part arisen from the study of stochastic resonance, which is the noise-induced enhancement of the signal-to-noise ratio. Networks of integrate-and-fire neurons behave in a wide variety of ways and have been used to model a variety of neural, physiological, and psychological phenomena. The properties of the integrate-and-fire neuron model with synaptic input described as a temporally homogeneous Poisson process are reviewed in an accompanying paper (Burkitt in Biol Cybern, 2006).

Noise-Induced Coherence and Network Oscillations in a Reduced Bursting Model

The dynamics of the Hindmarsh-Rose (HR) model of bursting thalamic neurons is reduced to a system of two linear differential equations that retains the subthreshold resonance properties of the HR model. Introducing a reset mechanism after a threshold crossing, we turn this system into a resonant integrate-and-fire (RIF) model. Using Monte-Carlo simulations and mathematical analysis, we examine the effects of noise and the subthreshold dynamic properties of the RIF model on the occurrence of coherence resonance (CR). Synchronized burst firing occurs in a network of such model neurons with excitatory pulse-coupling. The coherence level of the network oscillations shows a stochastic resonance-like dependence on the noise level. Stochastic analysis of the equations shows that the slow recovery from the spike-induced inhibition is crucial in determining the frequencies of the CR and the subthreshold resonance in the original HR model. In this particular type of CR, the oscillation frequency strongly depends on the intrinsic time scales but changes little with the noise intensity. We give analytical quantities to describe this CR mechanism and illustrate its influence on the emerging network oscillations. We discuss the profound physiological roles this kind of CR may have in information processing in neurons possessing a subthreshold resonant frequency and in generating synchronized network oscillations with a frequency that is determined by intrinsic properties of the neurons.

On the Classification of Experimental Data Modeled Via a Stochastic Leaky Integrate and Fire Model Through Boundary Values

We present a computational algorithm aimed to classify single unit spike trains on the basis of observed interspikes intervals (ISI). The neuronal activity is modeled with a stochastic leaky integrate and fire model and the inverse first passage time method is extended to the Ornstein-Uhlenbeck (OU) process. Differences between spike trains are detected in terms of the boundary shape. The proposed classification method is applied to the analysis of multiple single units recorded simultaneously in the thalamus and in the cerebral cortex of unanesthetized rats during spontaneous activity. We show the existence of at least three different firing patterns that could not be classified using the usual statistical indices.

Stochastic resonance with differential code in feedforward network with intra-layer random connections

We examined stochastic resonance with a differential coding scheme using a multilayer feedforward neural network which is composed of intra-layer connections. We show that the network, with random synaptic connections in each layer, encodes an input signal into a spike coherence that represents temporal differences among the inputs. We also demonstrate that both internal and external noise enhance the detection of weak signals. Finally, we discuss how the feedforward network with intra-layer random connections is similar to a membrane in its sensitivity to and amplification of a change in stimulus and suggest that the intensity of internal noise may be tuned in a real brain.

Stochastic resonance in the LIF models with input or threshold noise

In this paper, two stochastic versions of the LIF neural model are considered: one with the noise signal applied to the firing threshold, the other having it added to the input current. Then, adopting a discontinuous stepwise noise whose innovations are uncorrelated and gaussian distributed, the behaviours of the two models pertaining to the stochastic resonance (SR) are analysed and compared. Furthermore, it is shown that introducing a suitable time correlation into the noise signal brings us from the first model to the second one.

Optimum signal in a simple neuronal model with signal-dependent noise

How does the information about a signal in neural threshold crossings depend on the noise acting upon it? Two models are explored, a binary McCulloch and Pitts (threshold exceedance) model and a model of waiting time to exceedance--a discrete-time version of interspike intervals. If noise grows linearly with the signal, we find the best identification of the signal in terms of the Fisher information is for signals that do not reach the threshold in the absence of noise. Identification attains the same precision under weak and strong signals, but the coding range decreases at both extremes of signal level. We compare the results obtained for Fisher information with those using related first and second moment measures. The maximum obtainable information is plotted as a function of the ratio of noise to signal.

Detection of pulses in a colored noise setting

Cortical neurons are exposed to a considerable amount of synaptic background activity, which increases the neurons' conductance and which leads to a fluctuating membrane potential. Here we investigate how the presence and the properties of this background noise influence the ability of a neuron to detect transient inputs, a task that is important for coincidence detection as well as for the detection of synchronous spiking events in a neural system. Using a leaky integrate-and-fire neuron as well as a biologically more realistic Hodgkin-Huxley type point neuron we find that noise enhances the detection of subthreshold input pulses and that the phenomenon of stochastic resonance occurs. When the noise is colored, pulse detection becomes more robust, because the number of false positive events decreases with increasing temporal correlation while the number of correctly detected events is almost unaffected. Therefore, the optimal variance of the noise also changes with the degree of temporal correlations of the background activity. For the integrate-and-fire model these effects can be described using an ansatz by Brunel and Sergi [J. Theor. Biol. 195, 87 (1998)]. Numerical simulations show that the leaky integrate-and-fire model and the Hodgkin-Huxley type point neuron behave qualitatively similarly.

Effect of periodic stimulus on a neuronal diffusion model with signal-dependent noise

To relate the noise intensity with a periodically modulated input signal in a single neuron stochastic model we introduce a diffusion model with both time modulated drift and diffusion coefficient. Such a model is the continuous version of a Stein model with time oscillating frequencies for the Poisson processes describing the inputs impinging on the neuron. We focus here on some aspects of the resonance phenomenon for such a model. We compare the corresponding interspike interval distribution with the analogous distribution for a model sharing the same parameter values, but with constant noise intensity. Examples with two different levels for this noise intensity are discussed. The enhancement of the height of the peaks in the interspike interval distribution appearing at the modulation period, the improvement of the phase locking behavior and an enlargement of the noise ranges where a resonance like behavior arises are the main features observed in the considered cases.

Estimation of the input parameters in the Ornstein-Uhlenbeck neuronal model

The stochastic Ornstein-Uhlenbeck neuronal model is studied, and estimators of the model input parameters, depending on the firing regime of the process, are derived. Closed expressions for the Laplace transforms of the first two moments of the normalized first-passage time through a constant boundary in the suprathreshold regime are derived, which is used to define moment estimators. In the subthreshold regime, the exponentiality of the first-passage time is utilized to characterize the input parameters. In the threshold regime and for the Wiener process approximation, analytic expressions for the first-passage-time density are used to derive the maximum-likelihood estimators of the parameters. The methods are illustrated on simulated data under different conditions, including misspecification of the intrinsic parameters of the model. Finally, known approximations of the first-passage-time moments are improved.

Adaptive Stochastic Resonance in Noisy Neurons Based on Mutual Information

Noise can improve how memoryless neurons process signals and maximize their throughput information. Such favorable use of noise is the so-called "stochastic resonance" or SR effect at the level of threshold neurons and continuous neurons. This paper presents theoretical and simulation evidence that 1) lone noisy threshold and continuous neurons exhibit the SR effect in terms of the mutual information between random input and output sequences, 2) a new statistically robust learning law can find this entropy-optimal noise level, and 3) the adaptive SR effect is robust against highly impulsive noise with infinite variance. Histograms estimate the relevant probability density functions at each learning iteration. A theorem shows that almost all noise probability density functions produce some SR effect in threshold neurons even if the noise is impulsive and has infinite variance. The optimal noise level in threshold neurons also behaves nonlinearly as the input signal amplitude increases. Simulations further show that the SR effect persists for several sigmoidal neurons and for Gaussian radial-basis-function neurons.

Comparison of Stochastic vs. Conventional Transcutaneous Electrical Stimulation for Pain Modulation in Patients with Electromyographically Documented Radiculopathy

OBJECTIVE

To determine if a transcutaneous electrical stimulation (TENS) unit modified to deliver electrical impulses at random (R) or stochastic frequency, called TENS-R, provided better pain relief than conventional TENS.

DESIGN

A prospective, randomized, double-blinded, placebo-controlled study at an urban teaching hospital. A total of 13 adult subjects with radiculopathy on electromyogram and chronic radicular pain rated pain before and after walking 100 feet with proximal (axial) placement of TENS leads with randomized settings on conventional TENS, placebo, or TENS-R and, subsequently, with distal (limb) placement of TENS leads with randomized settings, all on the same day. The pain measures used were the McGill Pain Questionnaire, parts 1 and 2, and the Visual Analog Scale. The functional measure was speed of walking.

RESULTS

Four men and seven women completed the study pain scores, measured by McGill Pain Questionnaire part 2, significantly improved when the patient used TENS-R vs. conventional TENS (P = 0.006, analysis of variance). Placement of TENS electrodes on the back significantly decreased pain compared with lead placement on the legs for McGill Pain Questionnaire part 1 (P = 0.007), McGill Pain Questionnaire part 2 (P = 0.042), and the Visual Analog Scale (P = 0.026) measures.

CONCLUSIONS

Qualitative pain scores significantly improved when the patient used TENS-R vs. conventional TENS. Lead placement of any TENS modality over the back vs. over the leg improved all pain scores.

Firing time statistics for driven neuron models: analytic expressions versus numerics

Analytical expressions are put forward to investigate the forced spiking activity of abstract neuron models such as the driven leaky integrate-and-fire model. The method is valid in a wide parameter regime beyond the restraining limits of weak driving (linear response) and/or weak noise. The novel approximation is based on a discrete state Markovian modeling of the full long-time dynamics with time-dependent rates. The scheme yields excellent agreement with numerical Langevin and Fokker-Planck simulations of the full nonstationary dynamics, not only for the first-passage time statistics, but also for the important interspike interval (residence time) distribution.

Stochastic resonance in a sinusoidally forced LIF model with noisy threshold

In this report, the LIF neural model driven by underthreshold sinusoidal signals but with a gaussian-distributed noise on the threshold, is approximated by suitably defining an instantaneous firing (or escape) rate, which depends only on the momentary value of the voltage variable. This allows us to obtain, by analytically solving the relevant equations, the main statistical functions describing the "firing activity"; namely, the probability density function of firing phases and that of interspike intervals. From these functions two quantities can be derived, whose dependence on the noise intensity allows the Stochastic Resonance (SR) to be demonstrated. Besides the "regular" SR, the analysed system was found to produce, either for low frequencies and large amplitudes of modulation or for high modulation frequencies, resonance curves displaying two peaks. This bimodal feature of the resonance curves is accounted for on the basis of phase locked firing patterns.

Noise-induced divisive gain control in neuron models

A recent computational study of gain control via shunting inhibition has shown that the slope of the frequency-versus-input (f-I) characteristic of a neuron can be decreased by increasing the noise associated with the inhibitory input (Neural Comput. 13, 227-248). This novel noise-induced divisive gain control relies on the concommittant increase of the noise variance with the mean of the total inhibitory conductance. Here we investigate this effect using different neuronal models. The effect is shown to occur in the standard leaky integrate-and-fire (LIF) model with additive Gaussian white noise, and in the LIF with multiplicative noise acting on the inhibitory conductance. The noisy scaling of input currents is also shown to occur in the one-dimensional theta-neuron model, which has firing dynamics, as well as a large scale compartmental model of a pyramidal cell in the electrosensory lateral line lobe of a weakly electric fish. In this latter case, both the inhibition and the excitatory input have Poisson statistics; noise-induced divisive inhibition is thus seen in f-I curves for which the noise increases along with the input I. We discuss how the variation of the noise intensity along with inputs is constrained by the physiological context and the class of model used, and further provide a comparison of the divisive effect across models.

Interspike interval statistics in the Ornstein-Uhlenbeck neuronal model with signal-dependent noise

The stochastic leaky integrate-and-fire (LIF) continuous model is studied under the condition that the amplitude of noise is a function of the input signal. The coefficient of variation (CV) of interspike intervals (ISIs) is investigated for different types of dependencies between the noise and the signal. Finally, we present the CV and the ISI density resulting from the special choice of parameters of the input that gave rise to a contra-intuitive behavior of the transfer function in Lánský and Sacerdote [Phys. Lett. A 285 (2001) 132].

Maximizing spike train coherence or incoherence in the leaky integrate-and-fire model

We study noise-induced resonance effects in the leaky integrate-and-fire neuron model with absolute refractory period, driven by a Gaussian white noise. It is demonstrated that a finite noise level may either maximize or minimize the regularity of the spike train. We also partition the parameter space into regimes where either or both of these effects occur. It is shown that the coherence minimization at moderate noise results in a flat spectral response with respect to periodic stimulation in contrast to sharp resonances that are observed for both small and large noise intensities.

Evolution of escape processes with a time-varying load

We study an escape process of a noisy particle with a time varying load. We present an effective nonperturbative method which works even when the time varying load amplitude is comparable to other parameters. It is based on the idea that for every instant of time, we know the quasiadiabatic eigenspectrum and the quasiadiabatic eigenfunctions of the instantaneous system. We show that when two time-varying quasiadiabatic eigenvalues in the spectrum get close to each other, the amplitudes of the quasiadiabatic eigenfuntions show an abrupt change; therefore, the escape rate is highly affected.

Stochastic resonance of ensemble neurons for transient spike trains: wavelet analysis

By using the wavelet transformation (WT), I have analyzed the response of an ensemble of N (=1, 10, 100, and 500) Hodgkin-Huxley neurons to transient M-pulse spike trains (M=1 to 3) with independent Gaussian noises. The cross correlation between the input and output signals is expressed in terms of the WT expansion coefficients. The signal-to-noise ratio (SNR) is evaluated by using the denoising method within the WT, by which the noise contribution is extracted from the output signals. Although the response of a single (N=1) neuron to subthreshold transient signals with noises is quite unreliable, the transmission fidelity assessed by the cross correlation and SNR is shown to be much improved by increasing the value of N: a population of neurons plays an indispensable role in the stochastic resonance (SR) for transient spike inputs. It is also shown that in a large-scale ensemble, the transmission fidelity for suprathreshold transient spikes is not significantly degraded by a weak noise which is responsible to SR for subthreshold inputs.

The reliability of the stochastic active rotator

The reliability of firing of excitable-oscillating systems is studied through the response of the active rotator, a neuronal model evolving on the unit circle, to white gaussian noise. A stochastic return map is introduced that captures the behavior of the model. This map has two fixed points: one stable and the other unstable. Iterates of all initial conditions except the unstable point tend to the stable fixed point for almost all input realizations. This means that to a given input realization, there corresponds a unique asymptotic response. In this way, repetitive stimulation with the same segment of noise realization evokes, after possibly a transient time, the same response in the active rotator. In other words, this model responds reliably to such inputs. It is argued that this results from the nonuniform motion of the active rotator around the unit circle and that similar results hold for other neuronal models whose dynamics can be approximated by phase dynamics similar to the active rotator.

Synchronization of the neural response to noisy periodic synaptic input

The timing information contained in the response of a neuron to noisy periodic synaptic input is analyzed for the leaky integrate-and-fire neural model. We address the question of the relationship between the timing of the synaptic inputs and the output spikes. This requires an analysis of the interspike interval distribution of the output spikes, which is obtained in the gaussian approximation. The conditional output spike density in response to noisy periodic input is evaluated as a function of the initial phase of the inputs. This enables the phase transition matrix to be calculated, which relates the phase at which the output spike is generated to the initial phase of the inputs. The interspike interval histogram and the period histogram for the neural response to ongoing periodic input are then evaluated by using the leading eigenvector of this phase transition matrix. The synchronization index of the output spikes is found to increase sharply as the inputs become synchronized. This enhancement of synchronization is most pronounced for large numbers of inputs and lower frequencies of modulation and also for rates of input near the critical input rate. However, the mutual information between the input phase of the stimulus and the timing of output spikes is found to decrease at low input rates as the number of inputs increases. The results show close agreement with those obtained from numerical simulations for large numbers of inputs.