Comparison of Langevin and Markov channel noise models for neuronal signal generation

Simple model to incorporate statistical noise based on a modified hodgkin-huxley approach for external electrical field driven neural responses

Noise activity is known to affect neural networks, enhance the system response to weak external signals, and lead to stochastic resonance phenomenon that can effectively amplify signals in nonlinear systems. In most treatments, channel noise has been modeled based on multi-state Markov descriptions or the use stochastic differential equation models. Here we probe a computationally simple approach based on a minor modification of the traditional Hodgkin-Huxley approach to embed noise in neural response. Results obtained from numerous simulations with different excitation frequencies and noise amplitudes for the action potential firing show very good agreement with output obtained from well-established models. Furthermore, results from the Mann-Whitney U Test reveal a statistically insignificant difference. The distribution of the time interval between successive potential spikes obtained from this simple approach compared very well with the results of complicated Fox and Lu type methods at much reduced computational cost. This present method could also possibly be applied to the analysis of spatial variations and/or differences in characteristics of random incident electromagnetic signals.

Fast and Accurate Langevin Simulations of Stochastic Hodgkin-Huxley Dynamics

Fox and Lu introduced a Langevin framework for discrete-time stochastic models of randomly gated ion channels such as the Hodgkin-Huxley (HH) system. They derived a Fokker-Planck equation with state-dependent diffusion tensor D and suggested a Langevin formulation with noise coefficient matrix S such that SS⊤=D. Subsequently, several authors introduced a variety of Langevin equations for the HH system. In this article, we present a natural 14-dimensional dynamics for the HH system in which each directed edge in the ion channel state transition graph acts as an independent noise source, leading to a 14 × 28 noise coefficient matrix S. We show that (1) the corresponding 14D system of ordinary differential equations is consistent with the classical 4D representation of the HH system; (2) the 14D representation leads to a noise coefficient matrix S that can be obtained cheaply on each time step, without requiring a matrix decomposition; (3) sample trajectories of the 14D representation are pathwise equivalent to trajectories of Fox and Lu's system, as well as trajectories of several existing Langevin models; (4) our 14D representation (and those equivalent to it) gives the most accurate interspike interval distribution, not only with respect to moments but under both the L1 and L∞ metric-space norms; and (5) the 14D representation gives an approximation to exact Markov chain simulations that are as fast and as efficient as all equivalent models. Our approach goes beyond existing models, in that it supports a stochastic shielding decomposition that dramatically simplifies S with minimal loss of accuracy under both voltage- and current-clamp conditions.

Strong diffusion formulation of Markov chain ensembles and its optimal weaker reductions

Two self-contained diffusion formulations, in the form of coupled stochastic differential equations, are developed for the temporal evolution of state densities over an ensemble of Markov chains evolving independently under a common transition rate matrix. Our first formulation derives from Kurtz's strong approximation theorem of density-dependent Markov jump processes [Stoch.

PROCESS

Their Appl. 6, 223 (1978)STOPB70304-414910.1016/0304-4149(78)90020-0] and, therefore, strongly converges with an error bound of the order of lnN/N for ensemble size N. The second formulation eliminates some fluctuation variables, and correspondingly some noise terms, within the governing equations of the strong formulation, with the objective of achieving a simpler analytic formulation and a faster computation algorithm when the transition rates are constant or slowly varying. There, the reduction of the structural complexity is optimal in the sense that the elimination of any given set of variables takes place with the lowest attainable increase in the error bound. The resultant formulations are supported by numerical simulations.

Channel noise effects on first spike latency of a stochastic Hodgkin-Huxley neuron

While it is widely accepted that information is encoded in neurons via action potentials or spikes, it is far less understood what specific features of spiking contain encoded information. Experimental evidence has suggested that the timing of the first spike may be an energy-efficient coding mechanism that contains more neural information than subsequent spikes. Therefore, the biophysical features of neurons that underlie response latency are of considerable interest. Here we examine the effects of channel noise on the first spike latency of a Hodgkin-Huxley neuron receiving random input from many other neurons. Because the principal feature of a Hodgkin-Huxley neuron is the stochastic opening and closing of channels, the fluctuations in the number of open channels lead to fluctuations in the membrane voltage and modify the timing of the first spike. Our results show that when a neuron has a larger number of channels, (i) the occurrence of the first spike is delayed and (ii) the variation in the first spike timing is greater. We also show that the mean, median, and interquartile range of first spike latency can be accurately predicted from a simple linear regression by knowing only the number of channels in the neuron and the rate at which presynaptic neurons fire, but the standard deviation (i.e., neuronal jitter) cannot be predicted using only this information. We then compare our results to another commonly used stochastic Hodgkin-Huxley model and show that the more commonly used model overstates the first spike latency but can predict the standard deviation of first spike latencies accurately. We end by suggesting a more suitable definition for the neuronal jitter based upon our simulations and comparison of the two models.

Dynamic Behavior of Artificial Hodgkin-Huxley Neuron Model Subject to Additive Noise

Motivated by neuroscience discoveries during the last few years, many studies consider pulse-coupled neural networks with spike-timing as an essential component in information processing by the brain. There also exists some technical challenges while simulating the networks of artificial spiking neurons. The existing studies use a Hodgkin-Huxley (H-H) model to describe spiking dynamics and neuro-computational properties of each neuron. But they fail to address the effect of specific non-Gaussian noise on an artificial H-H neuron system. This paper aims to analyze how an artificial H-H neuron responds to add different types of noise using an electrical current and subunit noise model. The spiking and bursting behavior of this neuron is also investigated through numerical simulations. In addition, through statistic analysis, the intensity of different kinds of noise distributions is discussed to obtain their relationship with the mean firing rate, interspike intervals, and stochastic resonance.

Channel based generating function approach to the stochastic Hodgkin-Huxley neuronal system

Internal and external fluctuations, such as channel noise and synaptic noise, contribute to the generation of spontaneous action potentials in neurons. Many different Langevin approaches have been proposed to speed up the computation but with waning accuracy especially at small channel numbers. We apply a generating function approach to the master equation for the ion channel dynamics and further propose two accelerating algorithms, with an accuracy close to the Gillespie algorithm but with much higher efficiency, opening the door for expedited simulation of noisy action potential propagating along axons or other types of noisy signal transduction.

Accurate Langevin approaches to simulate Markovian channel dynamics

The stochasticity of ion-channels dynamic is significant for physiological processes on neuronal cell membranes. Microscopic simulations of the ion-channel gating with Markov chains can be considered to be an accurate standard. However, such Markovian simulations are computationally demanding for membrane areas of physiologically relevant sizes, which makes the noise-approximating or Langevin equation methods advantageous in many cases. In this review, we discuss the Langevin-like approaches, including the channel-based and simplified subunit-based stochastic differential equations proposed by Fox and Lu, and the effective Langevin approaches in which colored noise is added to deterministic differential equations. In the framework of Fox and Lu's classical models, several variants of numerical algorithms, which have been recently developed to improve accuracy as well as efficiency, are also discussed. Through the comparison of different simulation algorithms of ion-channel noise with the standard Markovian simulation, we aim to reveal the extent to which the existing Langevin-like methods approximate results using Markovian methods. Open questions for future studies are also discussed.

Minimal diffusion formulation of Markov chain ensembles and its application to ion channel clusters

We study ensembles of continuous-time Markov chains evolving independently under a common transition rate matrix in some finite state space. A diffusion approximation, composed of two specifically coupled Ornstein-Uhlenbeck processes in stochastic differential equation representation, is formulated to deduce how the number of chains in a given particular state evolves in time. This particular form of the formulation builds upon a theoretical argument adduced here. The formulation is minimal in the sense that it is always a two-dimensional stochastic process regardless of the state space size or the transition matrix density, and that it requires no matrix square root operations. A set of criteria, put forward here as to be necessarily captured by any consistent approximation scheme, is used together with the master equation to determine uniquely the parameter values and noise variances in the formulation. The model is applied to the gating dynamics in ion channel clusters.

Consequences of converting graded to action potentials upon neural information coding and energy efficiency

Information is encoded in neural circuits using both graded and action potentials, converting between them within single neurons and successive processing layers. This conversion is accompanied by information loss and a drop in energy efficiency. We investigate the biophysical causes of this loss of information and efficiency by comparing spiking neuron models, containing stochastic voltage-gated Na(+) and K(+) channels, with generator potential and graded potential models lacking voltage-gated Na(+) channels. We identify three causes of information loss in the generator potential that are the by-product of action potential generation: (1) the voltage-gated Na(+) channels necessary for action potential generation increase intrinsic noise and (2) introduce non-linearities, and (3) the finite duration of the action potential creates a 'footprint' in the generator potential that obscures incoming signals. These three processes reduce information rates by ∼50% in generator potentials, to ∼3 times that of spike trains. Both generator potentials and graded potentials consume almost an order of magnitude less energy per second than spike trains. Because of the lower information rates of generator potentials they are substantially less energy efficient than graded potentials. However, both are an order of magnitude more efficient than spike trains due to the higher energy costs and low information content of spikes, emphasizing that there is a two-fold cost of converting analogue to digital; information loss and cost inflation.

Channel-noise-induced stochastic facilitation in an auditory brainstem neuron model

Neuronal membrane potentials fluctuate stochastically due to conductance changes caused by random transitions between the open and closed states of ion channels. Although it has previously been shown that channel noise can nontrivially affect neuronal dynamics, it is unknown whether ion-channel noise is strong enough to act as a noise source for hypothesized noise-enhanced information processing in real neuronal systems, i.e., "stochastic facilitation". Here we demonstrate that biophysical models of channel noise can give rise to two kinds of recently discovered stochastic facilitation effects in a Hodgkin-Huxley-like model of auditory brainstem neurons. The first, known as slope-based stochastic resonance (SBSR), enables phasic neurons to emit action potentials that can encode the slope of inputs that vary slowly relative to key time constants in the model. The second, known as inverse stochastic resonance (ISR), occurs in tonically firing neurons when small levels of noise inhibit tonic firing and replace it with burstlike dynamics. Consistent with previous work, we conclude that channel noise can provide significant variability in firing dynamics, even for large numbers of channels. Moreover, our results show that possible associated computational benefits may occur due to channel noise in neurons of the auditory brainstem. This holds whether the firing dynamics in the model are phasic (SBSR can occur due to channel noise) or tonic (ISR can occur due to channel noise).

Balanced excitatory and inhibitory synaptic currents promote efficient coding and metabolic efficiency

A balance between excitatory and inhibitory synaptic currents is thought to be important for several aspects of information processing in cortical neurons in vivo, including gain control, bandwidth and receptive field structure. These factors will affect the firing rate of cortical neurons and their reliability, with consequences for their information coding and energy consumption. Yet how balanced synaptic currents contribute to the coding efficiency and energy efficiency of cortical neurons remains unclear. We used single compartment computational models with stochastic voltage-gated ion channels to determine whether synaptic regimes that produce balanced excitatory and inhibitory currents have specific advantages over other input regimes. Specifically, we compared models with only excitatory synaptic inputs to those with equal excitatory and inhibitory conductances, and stronger inhibitory than excitatory conductances (i.e. approximately balanced synaptic currents). Using these models, we show that balanced synaptic currents evoke fewer spikes per second than excitatory inputs alone or equal excitatory and inhibitory conductances. However, spikes evoked by balanced synaptic inputs are more informative (bits/spike), so that spike trains evoked by all three regimes have similar information rates (bits/s). Consequently, because spikes dominate the energy consumption of our computational models, approximately balanced synaptic currents are also more energy efficient than other synaptic regimes. Thus, by producing fewer, more informative spikes approximately balanced synaptic currents in cortical neurons can promote both coding efficiency and energy efficiency.

An Investigation of the Stochastic Hodgkin-Huxley Models Under Noisy Rate Functions

The effects of ion channel fluctuations on the transmembrane voltage activity are potentially profound in small-size excitable membrane patches. Different groups have extended Hodgkin-Huxley equations into stochastic differential equations to capture the effects of ion channel noise analytically (Fox & Lu, 1994 ; Linaro, Storace, & Giugliano, 2011 ; Güler, 2013 ). Studies have shown that the accuracy of spiking statistics by Fox and Lu's model does not match well with the corresponding statistics from the exact microscopic simulations. The models of both Linaro et al. and Güler, however, were found to produce highly accurate statistics. Here we extend the examination of these models to the case in which the rate functions for the opening and closing of gates are under the influence of noise. For that purpose, the usual rate functions are accompanied additively by Ornstein-Uhlenbeck–type stochastic angular variables. Moreover, we argue that the existence of such noise in the rate functions is a plausible physiological phenomenon for finite-size membranes. It is observed that the presence of noise in the rates is not effective on the degree of inaccuracies within the Fox and Lu model. Güler model's accuracy is found to remain high as in the case of noise free rates. But the performance of Linaro et al.’s model is seen to degrade seriously with the increasing strength of the introduced rate function noise. We attribute this failure of Linaro et al.’s model to the use of the covariance function of open channels at the steady state, in its derivation.

The effect of cell size and channel density on neuronal information encoding and energy efficiency

Identifying the determinants of neuronal energy consumption and their relationship to information coding is critical to understanding neuronal function and evolution. Three of the main determinants are cell size, ion channel density, and stimulus statistics. Here we investigate their impact on neuronal energy consumption and information coding by comparing single-compartment spiking neuron models of different sizes with different densities of stochastic voltage-gated Na(+) and K(+) channels and different statistics of synaptic inputs. The largest compartments have the highest information rates but the lowest energy efficiency for a given voltage-gated ion channel density, and the highest signaling efficiency (bits spike(-1)) for a given firing rate. For a given cell size, our models revealed that the ion channel density that maximizes energy efficiency is lower than that maximizing information rate. Low rates of small synaptic inputs improve energy efficiency but the highest information rates occur with higher rates and larger inputs. These relationships produce a Law of Diminishing Returns that penalizes costly excess information coding capacity, promoting the reduction of cell size, channel density, and input stimuli to the minimum possible, suggesting that the trade-off between energy and information has influenced all aspects of neuronal anatomy and physiology.

Stochastic Hodgkin-Huxley Equations with Colored Noise Terms in the Conductances

The excitability of cells is facilitated by voltage-gated ion channels. These channels accommodate a multiple number of gates individually. The possible impact of that gate multiplicity on the cell's function, specifically when the membrane area is of limited size, was investigated in the author's prior work (Güler, 2011 ). There, it was found that a nontrivially persistent correlation takes place between the transmembrane voltage fluctuations (also between the fluctuations in the gating variables) and the component of open channel fluctuations attributed to the gate multiplicity. This nontrivial phenomenon was found to be playing a major augmentative role for the elevation of excitability and spontaneous firing in small cells. In addition, the same phenomenon was found to be enhancing spike coherence significantly. Here we extend Fox and Lu's ( 1994 ) stochastic Hodgkin-Huxley equations by incorporating colored noise terms into the conductances there to obtain a formalism capable of capturing the addressed cross-correlations. Statistics of spike generation, spike coherence, firing efficiency, latency, and jitter from the articulated set of equations are found to be highly accurate in comparison with the corresponding statistics from the exact microscopic Markov simulations. This way, it is demonstrated vividly that our formulation overcomes the inherent inadequacy of the Fox and Lu equations. Finally, a recently proposed diffusion approximation method (Linaro, Storace, & Giugliano, 2011 ) is taken into consideration, and a discussion on its character is pursued.

Channel-based Langevin approach for the stochastic Hodgkin-Huxley neuron

Stochasticity in ion channel gating is the major source of intrinsic neuronal noise, which can induce many important effects in neuronal dynamics. Several numerical implementations of the Langevin approach have been proposed to approximate the Markovian dynamics of the Hodgkin-Huxley neuronal model. In this work an improved channel-based Langevin approach is proposed by introducing a truncation procedure to limit the state fractions in the range of [0, 1]. The truncated fractions are put back into the state fractions in the next time step for channel noise calculation. Our simulations show that the bounded Langevin approaches combined with the restored process give better approximations to the statistics of action potentials with the Markovian method. As a result, in our approach the channel state fractions are disturbed by two terms of noise: an uncorrelated Gaussian noise and a time-correlated noise obtained from the truncated fractions. We suggest that the restoration of truncated fractions is a critical process for a bounded Langevin method.

Comparison of continuous and discrete stochastic ion channel models

The stochastic behaviour of ion channels can be described by a discrete model or by an approximate continuous approach. While the discrete approach is exact, it is also less computationally efficient, and so the continuous model is often the method of choice since it allows for incorporation into a multiscale environment. However, in recent years the accuracy of the stochastic continuous approach for calculating statistics of certain quantities in the Hodgkin-Huxley model has come into question. In this paper, we show that by correct formulation of the continuous model, the first two moments in the number of open sodium and potassium channels in the Hodgkin-Huxley model, calculated under voltage clamp conditions using the continuous approach are in good agreement with those obtained from the discrete model.

Modeling ion channel dynamics through reflected stochastic differential equations

Ion channels are membrane proteins that open and close at random and play a vital role in the electrical dynamics of excitable cells. The stochastic nature of the conformational changes these proteins undergo can be significant, however current stochastic modeling methodologies limit the ability to study such systems. Discrete-state Markov chain models are seen as the "gold standard," but are computationally intensive, restricting investigation of stochastic effects to the single-cell level. Continuous stochastic methods that use stochastic differential equations (SDEs) to model the system are more efficient but can lead to simulations that have no biological meaning. In this paper we show that modeling the behavior of ion channel dynamics by a reflected SDE ensures biologically realistic simulations, and we argue that this model follows from the continuous approximation of the discrete-state Markov chain model. Open channel and action potential statistics from simulations of ion channel dynamics using the reflected SDE are compared with those of a discrete-state Markov chain method. Results show that the reflected SDE simulations are in good agreement with the discrete-state approach. The reflected SDE model therefore provides a computationally efficient method to simulate ion channel dynamics while preserving the distributional properties of the discrete-state Markov chain model and also ensuring biologically realistic solutions. This framework could easily be extended to other biochemical reaction networks.

The what and where of adding channel noise to the Hodgkin-Huxley equations

Conductance-based equations for electrically active cells form one of the most widely studied mathematical frameworks in computational biology. This framework, as expressed through a set of differential equations by Hodgkin and Huxley, synthesizes the impact of ionic currents on a cell's voltage--and the highly nonlinear impact of that voltage back on the currents themselves--into the rapid push and pull of the action potential. Later studies confirmed that these cellular dynamics are orchestrated by individual ion channels, whose conformational changes regulate the conductance of each ionic current. Thus, kinetic equations familiar from physical chemistry are the natural setting for describing conductances; for small-to-moderate numbers of channels, these will predict fluctuations in conductances and stochasticity in the resulting action potentials. At first glance, the kinetic equations provide a far more complex (and higher-dimensional) description than the original Hodgkin-Huxley equations or their counterparts. This has prompted more than a decade of efforts to capture channel fluctuations with noise terms added to the equations of Hodgkin-Huxley type. Many of these approaches, while intuitively appealing, produce quantitative errors when compared to kinetic equations; others, as only very recently demonstrated, are both accurate and relatively simple. We review what works, what doesn't, and why, seeking to build a bridge to well-established results for the deterministic equations of Hodgkin-Huxley type as well as to more modern models of ion channel dynamics. As such, we hope that this review will speed emerging studies of how channel noise modulates electrophysiological dynamics and function. We supply user-friendly MATLAB simulation code of these stochastic versions of the Hodgkin-Huxley equations on the ModelDB website (accession number 138950) and http://www.amath.washington.edu/~etsb/tutorials.html.

Perturbation analysis of spontaneous action potential initiation by stochastic ion channels

A stochastic interpretation of spontaneous action potential initiation is developed for the Morris-Lecar equations. Initiation of a spontaneous action potential can be interpreted as the escape from one of the wells of a double well potential, and we develop an asymptotic approximation of the mean exit time using a recently developed quasistationary perturbation method. Using the fact that the activating ionic channel's random openings and closings are fast relative to other processes, we derive an accurate estimate for the mean time to fire an action potential (MFT), which is valid for a below-threshold applied current. Previous studies have found that for above-threshold applied current, where there is only a single stable fixed point, a diffusion approximation can be used. We also explore why different diffusion approximation techniques fail to estimate the MFT.

Stochastic differential equation models for ion channel noise in Hodgkin-Huxley neurons

The random transitions of ion channels between conducting and nonconducting states generate a source of internal fluctuations in a neuron, known as channel noise. The standard method for modeling the states of ion channels nonlinearly couples continuous-time Markov chains to a differential equation for voltage. Beginning with the work of R. F. Fox and Y.-N. Lu [Phys. Rev. E 49, 3421 (1994)], there have been attempts to generate simpler models that use stochastic differential equation (SDEs) to approximate the stochastic spiking activity produced by Markov chain models. Recent numerical investigations, however, have raised doubts that SDE models can capture the stochastic dynamics of Markov chain models.We analyze three SDE models that have been proposed as approximations to the Markov chain model: one that describes the states of the ion channels and two that describe the states of the ion channel subunits. We show that the former channel-based approach can capture the distribution of channel noise and its effects on spiking in a Hodgkin-Huxley neuron model to a degree not previously demonstrated, but the latter two subunit-based approaches cannot. Our analysis provides intuitive and mathematical explanations for why this is the case. The temporal correlation in the channel noise is determined by the combinatorics of bundling subunits into channels, but the subunit-based approaches do not correctly account for this structure. Our study confirms and elucidates the findings of previous numerical investigations of subunit-based SDE models. Moreover, it presents evidence that Markov chain models of the nonlinear, stochastic dynamics of neural membranes can be accurately approximated by SDEs. This finding opens a door to future modeling work using SDE techniques to further illuminate the effects of ion channel fluctuations on electrically active cells.

Accurate and fast simulation of channel noise in conductance-based model neurons by diffusion approximation

Stochastic channel gating is the major source of intrinsic neuronal noise whose functional consequences at the microcircuit- and network-levels have been only partly explored. A systematic study of this channel noise in large ensembles of biophysically detailed model neurons calls for the availability of fast numerical methods. In fact, exact techniques employ the microscopic simulation of the random opening and closing of individual ion channels, usually based on Markov models, whose computational loads are prohibitive for next generation massive computer models of the brain. In this work, we operatively define a procedure for translating any Markov model describing voltage- or ligand-gated membrane ion-conductances into an effective stochastic version, whose computer simulation is efficient, without compromising accuracy. Our approximation is based on an improved Langevin-like approach, which employs stochastic differential equations and no Montecarlo methods. As opposed to an earlier proposal recently debated in the literature, our approximation reproduces accurately the statistical properties of the exact microscopic simulations, under a variety of conditions, from spontaneous to evoked response features. In addition, our method is not restricted to the Hodgkin-Huxley sodium and potassium currents and is general for a variety of voltage- and ligand-gated ion currents. As a by-product, the analysis of the properties emerging in exact Markov schemes by standard probability calculus enables us for the first time to analytically identify the sources of inaccuracy of the previous proposal, while providing solid ground for its modification and improvement we present here.

A possible approach to understanding the neuronal bases of the computational properties of the nervous system consists of modelling its basic building blocks, neurons and synapses, and then simulating their collective activity emerging in large networks. In developing such models, a satisfactory description level must be chosen as a compromise between simplicity and faithfulness in reproducing experimental data. Deterministic neuron models – i.e., models that upon repeated simulation with fixed parameter values provide the same results – are usually made up of ordinary differential equations and allow for relatively fast simulation times. By contrast, they do not describe accurately the underlying stochastic response properties arising from the microscopical correlate of neuronal excitability. Stochastic models are usually based on mathematical descriptions of individual ion channels, or on an effective macroscopic account of their random opening and closing. In this contribution we describe a general method to transform any deterministic neuron model into its effective stochastic version that accurately replicates the statistical properties of ion channels random kinetics.