Parameters of stochastic diffusion processes estimated from observations of first-hitting times: application to the leaky integrate-and-fire neuronal model

The Jacobi diffusion process as a neuronal model

The Jacobi process is a stochastic diffusion characterized by a linear drift and a special form of multiplicative noise which keeps the process confined between two boundaries. One example of such a process can be obtained as the diffusion limit of the Stein's model of membrane depolarization which includes both excitatory and inhibitory reversal potentials. The reversal potentials create the two boundaries between which the process is confined. Solving the first-passage-time problem for the Jacobi process, we found closed-form expressions for mean, variance, and third moment that are easy to implement numerically. The first two moments are used here to determine the role played by the parameters of the neuronal model; namely, the effect of multiplicative noise on the output of the Jacobi neuronal model with input-dependent parameters is examined in detail and compared with the properties of the generic Jacobi diffusion. It appears that the dependence of the model parameters on the rate of inhibition turns out to be of primary importance to observe a change in the slope of the response curves. This dependence also affects the variability of the output as reflected by the coefficient of variation. It often takes values larger than one, and it is not always a monotonic function in dependency on the rate of excitation.

Synchrony measure for a neuron driven by excitatory and inhibitory inputs and its adaptation to experimentally-recorded data

The aim of the current work is twofold: firstly to adapt an existing method measuring the input synchrony of a neuron driven only by excitatory inputs in such a way so as to account for inhibitory inputs as well and secondly to further appropriately adapt this measure so as to be correctly utilised on experimentally-recorded data. The existing method uses the normalized pre-spike slope (NPSS) of the membrane potential, resulting from observing the slope of depolarization of the membrane potential of a neuron prior to the moment of crossing the threshold within a short period of time, to identify the response-relevant input synchrony and through it to infer the operational mode of a neuron. The first adaptation of NPSS is made such that its upper bound calculation accommodates for the higher possible slope values caused by the lower average and minimum membrane potential values due to inhibitory inputs. Results indicate that when the input spike trains arrive randomly, the modified NPSS works as expected inferring that the neuron is operating as a temporal integrator. When the input spike trains arrive in perfect synchrony though, the modified NPSS works as expected only when the level of inhibition is much higher than the level of excitation. This suggests that calculation of the upper bound of the NPSS should be a function of the ratio between excitatory and inhibitory inputs in order to be able to correctly capture perfect synchrony at a neuron's input. In addition, we effectively demonstrate a process which has to be followed when aiming to use the NPSS on real neuron recordings. This process, which relies on empirical observations of the slope of depolarisation for estimating the bounds for the range of observed interspike interval lengths, is successfully applied to experimentally-recorded data showing that through it both a real neuron's operational mode and the amount of input synchrony that caused its firing can be inferred.

Responses of Leaky Integrate-and-Fire Neurons to a Plurality of Stimuli in Their Receptive Fields

A fundamental question concerning the way the visual world is represented in our brain is how a cortical cell responds when its classical receptive field contains a plurality of stimuli. Two opposing models have been proposed. In the response-averaging model, the neuron responds with a weighted average of all individual stimuli. By contrast, in the probability-mixing model, the cell responds to a plurality of stimuli as if only one of the stimuli were present. Here we apply the probability-mixing and the response-averaging model to leaky integrate-and-fire neurons, to describe neuronal behavior based on observed spike trains. We first estimate the parameters of either model using numerical methods, and then test which model is most likely to have generated the observed data. Results show that the parameters can be successfully estimated and the two models are distinguishable using model selection.

The Space-Clamped Hodgkin-Huxley System with Random Synaptic Input: Inhibition of Spiking by Weak Noise and Analysis with Moment Equations

We consider a classical space-clamped Hodgkin-Huxley model neuron stimulated by synaptic excitation and inhibition with conductances represented by Ornstein-Uhlenbeck processes. Using numerical solutions of the stochastic model system obtained by an Euler method, it is found that with excitation only, there is a critical value of the steady-state excitatory conductance for repetitive spiking without noise, and for values of the conductance near the critical value, small noise has a powerfully inhibitory effect. For a given level of inhibition, there is also a critical value of the steady-state excitatory conductance for repetitive firing, and it is demonstrated that noise in either the excitatory or inhibitory processes or both can powerfully inhibit spiking. Furthermore, near the critical value, inverse stochastic resonance was observed when noise was present only in the inhibitory input process. The system of deterministic differential equations for the approximate first- and second-order moments of the model is derived. They are solved using Runge-Kutta methods, and the solutions are compared with the results obtained by simulation for various sets of parameters, including some with conductances obtained by experiment on pyramidal cells of rat prefrontal cortex. The mean and variance obtained from simulation are in good agreement when there is spiking induced by strong stimulation and relatively small noise or when the voltage is fluctuating at subthreshold levels. In the occasional spike mode sometimes exhibited by spinal motoneurons and cortical pyramidal cells, the assumptions underlying the moment equation approach are not satisfied. The simulation results show that noisy synaptic input of either an excitatory or inhibitory character or both may lead to the suppression of firing in neurons operating near a critical point and this has possible implications for cortical networks. Although suppression of firing is corroborated for the system of moment equations, there seem to be substantial differences between the dynamical properties of the original system of stochastic differential equations and the much larger system of moment equations.

Reconstruction of the input signal of the leaky integrate-and-fire neuronal model from its interspike intervals

Extracting the input signal of a neuron by analyzing its spike output is an important step toward understanding how external information is coded into discrete events of action potentials and how this information is exchanged between different neurons in the nervous system. Most of the existing methods analyze this decoding problem in a stochastic framework and use probabilistic metrics such as maximum-likelihood method to determine the parameters of the input signal assuming a leaky and integrate-and-fire (LIF) model. In this article, the input signal of the LIF model is considered as a combination of orthogonal basis functions. The coefficients of the basis functions are found by minimizing the norm of the observed spikes and those generated by the estimated signal. This approach gives rise to the deterministic reconstruction of the input signal and results in a simple matrix identity through which the coefficients of the basis functions and therefore the neuronal stimulus can be identified. The inherent noise of the neuron is considered as an additional factor in the membrane potential and is treated as the disturbance in the reconstruction algorithm. The performance of the proposed scheme is evaluated by numerical simulations, and it is shown that input signals with different characteristics can be well recovered by this algorithm.

On modeling the neuronal activity in movement disorder patients by using the Ornstein Uhlenbeck process

Mathematical models of the neuronal activity in the affected brain regions of Essential Tremor (ET) and Parkinson's Disease (PD) patients could shed light into the underlying pathophysiology of these diseases, which in turn could help develop personalized treatments including adaptive Deep Brain Stimulation (DBS). In this paper, we use an Ornstein Uhlenbeck Process (OUP) to model the neuronal spiking activity recorded from the brain of ET and PD patients during DBS stereotactic surgery. The parameters of the OUP are estimated based on Inter Spike Interval (ISI) measurements, i.e., the time interval between two consecutive neuronal firings, by means of the Fortet Integral Equation (FIE). The OUP model parameters identified with the FIE method (OUP-FIE) are then used to simulate the ISI distribution resulting from the OUP. Other widely used neuronal activity models, such as the Poisson Process (PP), the Brownian Motion (BM), and the OUP whose parameters are extracted by matching the first two moments of the ISI (OUP-MOM), are also considered. To quantify how close the simulated ISI distribution is to the measured ISI distribution, the Integral Square Error (ISE) criterion is adopted. Amongst all considered stochastic processes, the ISI distribution generated by the OUP-FIE method is shown to produce the least ISE. Finally, a directional Wilcoxon signed rank test is used to show statistically significant reduction in the ISE value obtained from the OUP-FIE compared to the other stochastic processes.

Stochastic optimal control of single neuron spike trains

OBJECTIVE

External control of spike times in single neurons can reveal important information about a neuron's sub-threshold dynamics that lead to spiking, and has the potential to improve brain-machine interfaces and neural prostheses. The goal of this paper is the design of optimal electrical stimulation of a neuron to achieve a target spike train under the physiological constraint to not damage tissue.

APPROACH

We pose a stochastic optimal control problem to precisely specify the spike times in a leaky integrate-and-fire (LIF) model of a neuron with noise assumed to be of intrinsic or synaptic origin. In particular, we allow for the noise to be of arbitrary intensity. The optimal control problem is solved using dynamic programming when the controller has access to the voltage (closed-loop control), and using a maximum principle for the transition density when the controller only has access to the spike times (open-loop control).

MAIN RESULTS

We have developed a stochastic optimal control algorithm to obtain precise spike times. It is applicable in both the supra-threshold and sub-threshold regimes, under open-loop and closed-loop conditions and with an arbitrary noise intensity; the accuracy of control degrades with increasing intensity of the noise. Simulations show that our algorithms produce the desired results for the LIF model, but also for the case where the neuron dynamics are given by more complex models than the LIF model. This is illustrated explicitly using the Morris-Lecar spiking neuron model, for which an LIF approximation is first obtained from a spike sequence using a previously published method. We further show that a related control strategy based on the assumption that there is no noise performs poorly in comparison to our noise-based strategies. The algorithms are numerically intensive and may require efficiency refinements to achieve real-time control; in particular, the open-loop context is more numerically demanding than the closed-loop one.

SIGNIFICANCE

Our main contribution is the online feedback control of a noisy neuron through modulation of the input, taking into account physiological constraints on the control. A precise and robust targeting of neural activity based on stochastic optimal control has great potential for regulating neural activity in e.g. prosthetic applications and to improve our understanding of the basic mechanisms by which neuronal firing patterns can be controlled in vivo.

Path integral approach to the pricing of timer options with the Duru-Kleinert time transformation

In this paper, a time substitution as used by Duru and Kleinert in their treatment of the hydrogen atom with path integrals is performed to price timer options under stochastic volatility models. We present general pricing formulas for both the perpetual timer call options and the finite time-horizon timer call options. These general results allow us to find closed-form pricing formulas for both the perpetual and the finite time-horizon timer options under the 3/2 stochastic volatility model as well as under the Heston stochastic volatility model. For the treatment of timer options under the 3/2 model we will rely on the path integral for the Morse potential, with the Heston model we will rely on the Kratzer potential.

Firing variability is higher than deduced from the empirical coefficient of variation

A convenient and often used summary measure to quantify the firing variability in neurons is the coefficient of variation (CV), defined as the standard deviation divided by the mean. It is therefore important to find an estimator that gives reliable results from experimental data, that is, the estimator should be unbiased and have low estimation variance. When the CV is evaluated in the standard way (empirical standard deviation of interspike intervals divided by their average), then the estimator is biased, underestimating the true CV, especially if the distribution of the interspike intervals is positively skewed. Moreover, the estimator has a large variance for commonly used distributions. The aim of this letter is to quantify the bias and propose alternative estimation methods. If the distribution is assumed known or can be determined from data, parametric estimators are proposed, which not only remove the bias but also decrease the estimation errors. If no distribution is assumed and the data are very positively skewed, we propose to correct the standard estimator. When defining the corrected estimator, we simply use that it is more stable to work on the log scale for positively skewed distributions. The estimators are evaluated through simulations and applied to experimental data from olfactory receptor neurons in rats.

Motoneuron membrane potentials follow a time inhomogeneous jump diffusion process

Stochastic leaky integrate-and-fire models are popular due to their simplicity and statistical tractability. They have been widely applied to gain understanding of the underlying mechanisms for spike timing in neurons, and have served as building blocks for more elaborate models. Especially the Ornstein-Uhlenbeck process is popular to describe the stochastic fluctuations in the membrane potential of a neuron, but also other models like the square-root model or models with a non-linear drift are sometimes applied. Data that can be described by such models have to be stationary and thus, the simple models can only be applied over short time windows. However, experimental data show varying time constants, state dependent noise, a graded firing threshold and time-inhomogeneous input. In the present study we build a jump diffusion model that incorporates these features, and introduce a firing mechanism with a state dependent intensity. In addition, we suggest statistical methods to estimate all unknown quantities and apply these to analyze turtle motoneuron membrane potentials. Finally, simulated and real data are compared and discussed. We find that a square-root diffusion describes the data much better than an Ornstein-Uhlenbeck process with constant diffusion coefficient. Further, the membrane time constant decreases with increasing depolarization, as expected from the increase in synaptic conductance. The network activity, which the neuron is exposed to, can be reasonably estimated to be a threshold version of the nerve output from the network. Moreover, the spiking characteristics are well described by a Poisson spike train with an intensity depending exponentially on the membrane potential.

Estimating input parameters from intracellular recordings in the Feller neuronal model

We study the estimation of the input parameters in a Feller neuronal model from a trajectory of the membrane potential sampled at discrete times. These input parameters are identified with the drift and the infinitesimal variance of the underlying stochastic diffusion process with multiplicative noise. The state space of the process is restricted from below by an inaccessible boundary. Further, the model is characterized by the presence of an absorbing threshold, the first hitting of which determines the length of each trajectory and which constrains the state space from above. We compare, both in the presence and in the absence of the absorbing threshold, the efficiency of different known estimators. In addition, we propose an estimator for the drift term, which is proved to be more efficient than the others, at least in the explored range of the parameters. The presence of the threshold makes the estimates of the drift term biased, and two methods to correct it are proposed.

Effect of stimulation on the input parameters of stochastic leaky integrate-and-fire neuronal model

The Ornstein-Uhlenbeck neuronal model is specified by two types of parameters. One type corresponds to the properties of the neuronal membrane, whereas the second type (local average rate of the membrane depolarization and its variability) corresponds to the input of the neuron. In this article, we estimate the parameters of the second type from an intracellular record during neuronal firing caused by stimulation (audio signal). We compare the obtained estimates with those from the spontaneous part of the record. As predicted from the model construction, the values of the input parameters are larger for the periods when neuron is stimulated than for the spontaneous ones. Finally, the firing regimen of the model is checked. It is confirmed that the neuron is in the suprathreshold regimen during the stimulation.

Are the input parameters of white noise driven integrate and fire neurons uniquely determined by rate and CV?

Integrate and fire (IF) neurons have found widespread applications in computational neuroscience. Particularly important are stochastic versions of these models where the driving consists of a synaptic input modeled as white Gaussian noise with mean mu and noise intensity D. Different IF models have been proposed, the firing statistics of which depends nontrivially on the input parameters mu and D. In order to compare these models among each other, one must first specify the correspondence between their parameters. This can be done by determining which set of parameters (mu,D) of each model is associated with a given set of basic firing statistics as, for instance, the firing rate and the coefficient of variation (CV) of the interspike interval (ISI). However, it is not clear a priori whether for a given firing rate and CV there is only one unique choice of input parameters for each model. Here we review the dependence of rate and CV on input parameters for the perfect, leaky, and quadratic IF neuron models and show analytically that indeed in these three models the firing rate and the CV uniquely determine the input parameters.

A review of the methods for signal estimation in stochastic diffusion leaky integrate-and-fire neuronal models

Parameters in diffusion neuronal models are divided into two groups; intrinsic and input parameters. Intrinsic parameters are related to the properties of the neuronal membrane and are assumed to be known throughout the paper. Input parameters characterize processes generated outside the neuron and methods for their estimation are reviewed here. Two examples of the diffusion neuronal model, which are based on the integrate-and-fire concept, are investigated--the Ornstein--Uhlenbeck model as the most common one and the Feller model as an illustration of state-dependent behavior in modeling the neuronal input. Two types of experimental data are assumed-intracellular describing the membrane trajectories and extracellular resulting in knowledge of the interspike intervals. The literature on estimation from the trajectories of the diffusion process is extensive and thus the stress in this review is set on the inference made from the interspike intervals.

Parameters of the Diffusion Leaky Integrate-and-Fire Neuronal Model for a Slowly Fluctuating Signal

Stochastic leaky integrate-and-fire (LIF) neuronal models are common theoretical tools for studying properties of real neuronal systems. Experimental data of frequently sampled membrane potential measurements between spikes show that the assumption of constant parameter values is not realistic and that some (random) fluctuations are occurring. In this article, we extend the stochastic LIF model, allowing a noise source determining slow fluctuations in the signal. This is achieved by adding a random variable to one of the parameters characterizing the neuronal input, considering each interspike interval (ISI) as an independent experimental unit with a different realization of this random variable. In this way, the variation of the neuronal input is split into fast (within-interval) and slow (between-intervals) components. A parameter estimation method is proposed, allowing the parameters to be estimated simultaneously over the entire data set. This increases the statistical power, and the average estimate over all ISIs will be improved in the sense of decreased variance of the estimator compared to previous approaches, where the estimation has been conducted separately on each individual ISI. The results obtained on real data show good agreement with classical regression methods.

Errors in estimation of the input signal for integrate-and-fire neuronal models

Estimation of the input parameters of stochastic (leaky) integrate-and-fire neuronal models is studied. It is shown that the presence of a firing threshold brings a systematic error to the estimation procedure. Analytical formulas for the bias are given for two models, the randomized random walk and the perfect integrator. For the third model considered, the leaky integrate-and-fire model, the study is performed by using Monte Carlo simulated trajectories. The bias is compared with other errors appearing during the estimation, and it is documented that the effect of the bias has to be taken into account in experimental studies.