Mind the last spike - firing rate models for mesoscopic populations of spiking neurons

Modeling Instantaneous Firing Rate of Deep Brain Stimulation Target Neuronal Ensembles in the Basal Ganglia and Thalamus

OBJECTIVE

Deep brain stimulation (DBS) is an effective treatment for movement disorders, including Parkinson disease and essential tremor. However, the underlying mechanisms of DBS remain elusive. Despite the capability of existing models in interpreting experimental data qualitatively, there are very few unified computational models that quantitatively capture the dynamics of the neuronal activity of varying stimulated nuclei-including subthalamic nucleus (STN), substantia nigra pars reticulata (SNr), and ventral intermediate nucleus (Vim)-across different DBS frequencies.

MATERIALS AND METHODS

Both synthetic and experimental data were used in the model fitting; the synthetic data were generated by an established spiking neuron model that was reported in our previous work, and the experimental data were provided using single-unit microelectrode recordings (MERs) during DBS (microelectrode stimulation). Based on these data, we developed a novel mathematical model to represent the firing rate of neurons receiving DBS, including neurons in STN, SNr, and Vim-across different DBS frequencies. In our model, the DBS pulses were filtered through a synapse model and a nonlinear transfer function to formulate the firing rate variability. For each DBS-targeted nucleus, we fitted a single set of optimal model parameters consistent across varying DBS frequencies.

RESULTS

Our model accurately reproduced the firing rates observed and calculated from both synthetic and experimental data. The optimal model parameters were consistent across different DBS frequencies.

CONCLUSIONS

The result of our model fitting was in agreement with experimental single-unit MER data during DBS. Reproducing neuronal firing rates of different nuclei of the basal ganglia and thalamus during DBS can be helpful to further understand the mechanisms of DBS and to potentially optimize stimulation parameters based on their actual effects on neuronal activity.

Single-compartment model of a pyramidal neuron, fitted to recordings with current and conductance injection

For single neuron models, reproducing characteristics of neuronal activity such as the firing rate, amplitude of spikes, and threshold potentials as functions of both synaptic current and conductance is a challenging task. In the present work, we measure these characteristics of regular spiking cortical neurons using the dynamic patch-clamp technique, compare the data with predictions from the standard Hodgkin-Huxley and Izhikevich models, and propose a relatively simple five-dimensional dynamical system model, based on threshold criteria. The model contains a single sodium channel with slow inactivation, fast activation and moderate deactivation, as well as, two fast repolarizing and slow shunting potassium channels. The model quantitatively reproduces characteristics of steady-state activity that are typical for a cortical pyramidal neuron, namely firing rate not exceeding 30 Hz; critical values of the stimulating current and conductance which induce the depolarization block not exceeding 80 mV and 3, respectively (both values are scaled by the resting input conductance); extremum of hyperpolarization close to the midpoint between spikes. The analysis of the model reveals that the spiking regime appears through a saddle-node-on-invariant-circle bifurcation, and the depolarization block is reached through a saddle-node bifurcation of cycles. The model can be used for realistic network simulations, and it can also be implemented within the so-called mean-field, refractory density framework.

Self-Consistent Stochastic Dynamics for Finite-Size Networks of Spiking Neurons

Despite the huge number of neurons composing a brain network, ongoing activity of local cell assemblies is intrinsically stochastic. Fluctuations in their instantaneous rate of spike firing ν(t) scale with the size of the assembly and persist in isolated networks, i.e., in the absence of external sources of noise. Although deterministic chaos due to the quenched disorder of the synaptic couplings underlies this seemingly stochastic dynamics, an effective theory for the network dynamics of a finite assembly of spiking neurons is lacking. Here, we fill this gap by extending the so-called population density approach including an activity- and size-dependent stochastic source in the Fokker-Planck equation for the membrane potential density. The finite-size noise embedded in this stochastic partial derivative equation is analytically characterized leading to a self-consistent and nonperturbative description of ν(t) valid for a wide class of spiking neuron networks. Power spectra of ν(t) are found in excellent agreement with those from detailed simulations both in the linear regime and across a synchronization phase transition, when a size-dependent smearing of the critical dynamics emerges.

Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity patterns are propagating bursts of place-cell activities called hippocampal replay, which is critical for memory consolidation. The sudden and repeated occurrences of these burst states during ongoing neural activity suggest metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to stochastic spiking and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesoscopic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie to obtain a "chemical Langevin equation", which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down-states dynamics) by means of phase-plane analysis. An extension of the Langevin equation for small network sizes is also presented. The stochastic neural mass model constitutes the basic component of our mesoscopic model for replay. We show that the mesoscopic model faithfully captures the statistical structure of individual replayed trajectories in microscopic simulations and in previously reported experimental data. Moreover, compared to the deterministic Romani-Tsodyks model of place-cell dynamics, it exhibits a higher level of variability regarding order, direction and timing of replayed trajectories, which seems biologically more plausible and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.

Ultrafast simulation of large-scale neocortical microcircuitry with biophysically realistic neurons

Understanding the activity of the mammalian brain requires an integrative knowledge of circuits at distinct scales, ranging from ion channel gating to circuit connectomics. Computational models are regularly employed to understand how multiple parameters contribute synergistically to circuit behavior. However, traditional models of anatomically and biophysically realistic neurons are computationally demanding, especially when scaled to model local circuits. To overcome this limitation, we trained several artificial neural network (ANN) architectures to model the activity of realistic multicompartmental cortical neurons. We identified an ANN architecture that accurately predicted subthreshold activity and action potential firing. The ANN could correctly generalize to previously unobserved synaptic input, including in models containing nonlinear dendritic properties. When scaled, processing times were orders of magnitude faster compared with traditional approaches, allowing for rapid parameter-space mapping in a circuit model of Rett syndrome. Thus, we present a novel ANN approach allowing for rapid, detailed network experiments using inexpensive and commonly available computational resources.

A framework for macroscopic phase-resetting curves for generalised spiking neural networks

Brain rhythms emerge from synchronization among interconnected spiking neurons. Key properties of such rhythms can be gleaned from the phase-resetting curve (PRC). Inferring the PRC and developing a systematic phase reduction theory for large-scale brain rhythms remains an outstanding challenge. Here we present a theoretical framework and methodology to compute the PRC of generic spiking networks with emergent collective oscillations. We adopt a renewal approach where neurons are described by the time since their last action potential, a description that can reproduce the dynamical feature of many cell types. For a sufficiently large number of neurons, the network dynamics are well captured by a continuity equation known as the refractory density equation. We develop an adjoint method for this equation giving a semi-analytical expression of the infinitesimal PRC. We confirm the validity of our framework for specific examples of neural networks. Our theoretical framework can link key biological properties at the individual neuron scale and the macroscopic oscillatory network properties. Beyond spiking networks, the approach is applicable to a broad class of systems that can be described by renewal processes.

The formation of oscillatory neuronal assemblies at the network level has been hypothesized to be fundamental to many cognitive and motor functions. One prominent tool to understand the dynamics of oscillatory activity response to stimuli, and hence the neural code for which it is a substrate, is a nonlinear measure called Phase-Resetting Curve (PRC). At the network scale, the PRC defines the measure of how a given synaptic input perturbs the timing of next upcoming volley of spike assemblies: either advancing or delaying this timing. As a further application, one can use PRCs to make unambiguous predictions about whether communicating networks of neurons will phase-lock as it is often observed across the cortical areas and what would be this stable phase-configuration: synchronous, asynchronous or with asymmetric phase-shifts. The latter configuration also implies a preferential flow of information form the leading network to the follower, thereby giving causal signatures of directed functional connectivity. Because of the key position of the PRC in studying synchrony, information flow and entrainment to external forcing, it is crucial to move toward a theory that allows to compute the PRCs of network-wide oscillations not only for a restricted class of models, as has been done in the past, but to network descriptions that are generalized and can reflect flexibly single cell properties. In this manuscript, we tackle this issue by showing how the PRC for network oscillations can be computed using the adjoint systems of partial differential equations that define the dynamics of the neural activity density.

A numerical population density technique for N-dimensional neuron models

Population density techniques can be used to simulate the behavior of a population of neurons which adhere to a common underlying neuron model. They have previously been used for analyzing models of orientation tuning and decision making tasks. They produce a fully deterministic solution to neural simulations which often involve a non-deterministic or noise component. Until now, numerical population density techniques have been limited to only one- and two-dimensional models. For the first time, we demonstrate a method to take an N-dimensional underlying neuron model and simulate the behavior of a population. The technique enables so-called graceful degradation of the dynamics allowing a balance between accuracy and simulation speed while maintaining important behavioral features such as rate curves and bifurcations. It is an extension of the numerical population density technique implemented in the MIIND software framework that simulates networks of populations of neurons. Here, we describe the extension to N dimensions and simulate populations of leaky integrate-and-fire neurons with excitatory and inhibitory synaptic conductances then demonstrate the effect of degrading the accuracy on the solution. We also simulate two separate populations in an E-I configuration to demonstrate the technique's ability to capture complex behaviors of interacting populations. Finally, we simulate a population of four-dimensional Hodgkin-Huxley neurons under the influence of noise. Though the MIIND software has been used only for neural modeling up to this point, the technique can be used to simulate the behavior of a population of agents adhering to any system of ordinary differential equations under the influence of shot noise. MIIND has been modified to render a visualization of any three of an N-dimensional state space of a population which encourages fast model prototyping and debugging and could prove a useful educational tool for understanding dynamical systems.

Ictal wavefront propagation in slices and simulations with conductance-based refractory density model

The mechanisms determining ictal discharge (ID) propagation are still not clear. In the present study, we aimed to examine these mechanisms in animal and mathematical models of epileptiform activity. Using double-patch and extracellular potassium ion concentration recordings in rat hippocampal-cortical slices, we observed that IDs moved at a speed of about 1 mm/s or less. The mechanisms of such slow propagation have been studied with a mathematical, conductance-based refractory density (CBRD) model that describes the GABA- and glutamatergic neuronal populations’ interactions and ion dynamics in brain tissue. The modeling study reveals two main factors triggerring IDs: (i) increased interneuronal activity leading to chloride ion accumulation and a consequent depolarizing GABAergic effect and (ii) the elevation of extracellular potassium ion concentration. The local synaptic transmission followed by local potassium ion extrusion and GABA receptor-mediated chloride ion accumulation underlies the ID wavefront’s propagation. In contrast, potassium ion diffusion in the extracellular space is slower and does not affect ID’s speed. The short discharges, constituting the ID, propagate much faster than the ID front. The accumulation of sodium ions inside neurons due to their hyperactivity and glutamatergic currents boosts the Na⁺/K⁺ pump, which terminates the ID. Knowledge of the mechanism of ID generation and propagation contributes to the development of new treatments against epilepsy.

During an epileptic seizure, neuronal excitation spreads across the brain tissue and is accompanied by significant changes in ionic concentrations. Ictal discharge front spreads at low speeds, less than 1 mm/s. Mechanisms underlying this phenomenon are not yet well understood. We study these mechanisms using electrophysiological recordings in brain slices and computer simulations. Our detailed biophysical model describing neuronal populations’ interaction, spatial propagation, and ionic dynamics reproduces the generation and propagation of spontaneously repeating ictal discharges. The simulations are consistent with our recordings of the electrical activity and the extracellular potassium ion concentration. We distinguished between the two alternative mechanisms of the ictal wavefront propagation: (i) the diffusion of potassium ions released from excited neurons, which depolarizes distant neurons and thus supports excitation, and (ii) the axonal spread of excitation followed by the local extracellular potassium ion accumulation that supports the excitation. Our simulations provide evidence in favor of the latter mechanism. Our experiment-based modeling contributes to a mathematical description of brain tissue functioning and potentially contributes to developing new treatments against epilepsy.

Mapping input noise to escape noise in integrate-and-fire neurons: a level-crossing approach

Noise in spiking neurons is commonly modeled by a noisy input current or by generating output spikes stochastically with a voltage-dependent hazard rate ("escape noise"). While input noise lends itself to modeling biophysical noise processes, the phenomenological escape noise is mathematically more tractable. Using the level-crossing theory for differentiable Gaussian processes, we derive an approximate mapping between colored input noise and escape noise in leaky integrate-and-fire neurons. This mapping requires the first-passage-time (FPT) density of an overdamped Brownian particle driven by colored noise with respect to an arbitrarily moving boundary. Starting from the Wiener-Rice series for the FPT density, we apply the second-order decoupling approximation of Stratonovich to the case of moving boundaries and derive a simplified hazard-rate representation that is local in time and numerically efficient. This simplification requires the calculation of the non-stationary auto-correlation function of the level-crossing process: For exponentially correlated input noise (Ornstein-Uhlenbeck process), we obtain an exact formula for the zero-lag auto-correlation as a function of noise parameters, mean membrane potential and its speed, as well as an exponential approximation of the full auto-correlation function. The theory well predicts the FPT and interspike interval densities as well as the population activities obtained from simulations with colored input noise and time-dependent stimulus or boundary. The agreement with simulations is strongly enhanced across the sub- and suprathreshold firing regime compared to a first-order decoupling approximation that neglects correlations between level crossings. The second-order approximation also improves upon a previously proposed theory in the subthreshold regime. Depending on a simplicity-accuracy trade-off, all considered approximations represent useful mappings from colored input noise to escape noise, enabling progress in the theory of neuronal population dynamics.

A strategy for mapping biophysical to abstract neuronal network models applied to primary visual cortex

A fundamental challenge for the theoretical study of neuronal networks is to make the link between complex biophysical models based directly on experimental data, to progressively simpler mathematical models that allow the derivation of general operating principles. We present a strategy that successively maps a relatively detailed biophysical population model, comprising conductance-based Hodgkin-Huxley type neuron models with connectivity rules derived from anatomical data, to various representations with fewer parameters, finishing with a firing rate network model that permits analysis. We apply this methodology to primary visual cortex of higher mammals, focusing on the functional property of stimulus orientation selectivity of receptive fields of individual neurons. The mapping produces compact expressions for the parameters of the abstract model that clearly identify the impact of specific electrophysiological and anatomical parameters on the analytical results, in particular as manifested by specific functional signatures of visual cortex, including input-output sharpening, conductance invariance, virtual rotation and the tilt after effect. Importantly, qualitative differences between model behaviours point out consequences of various simplifications. The strategy may be applied to other neuronal systems with appropriate modifications.

A hierarchy of theoretical approaches to study a neuronal network depends on a tradeoff between biological fidelity and mathematical tractibility. Biophysically-detailed models consider cellular mechanisms and anatomically defined synaptic circuits, but are often too complex to reveal insights into fundamental principles. In contrast, increasingly abstract reduced models facilitate analytical insights. To better ground the latter to the underlying biology, we describe a systematic procedure to move across the model hierarchy that allows understanding how changes in biological parameters—physiological, pathophysiological, or because of new data—impact the behaviour of the network. We apply this approach to mammalian primary visual cortex, and examine how the different models in the hierarchy reproduce functional signatures of this area, in particular the tuning of neurons to the orientation of a visual stimulus. Our work provides a navigation of the complex parameter space of neural network models faithful to biology, as well as highlighting how simplifications made for mathematical convenience can fundamentally change their behaviour.

Low-dimensional firing-rate dynamics for populations of renewal-type spiking neurons

The macroscopic dynamics of large populations of neurons can be mathematically analyzed using low-dimensional firing-rate or neural-mass models. However, these models fail to capture spike synchronization effects and nonstationary responses of the population activity to rapidly changing stimuli. Here we derive low-dimensional firing-rate models for homogeneous populations of neurons modeled as time-dependent renewal processes. The class of renewal neurons includes integrate-and-fire models driven by white noise and has been frequently used to model neuronal refractoriness and spike synchronization dynamics. The derivation is based on an eigenmode expansion of the associated refractory density equation, which generalizes previous spectral methods for Fokker-Planck equations to arbitrary renewal models. We find a simple relation between the eigenvalues characterizing the timescales of the firing rate dynamics and the Laplace transform of the interspike interval density, for which explicit expressions are available for many renewal models. Retaining only the first eigenmode already yields a reliable low-dimensional approximation of the firing-rate dynamics that captures spike synchronization effects and fast transient dynamics at stimulus onset. We explicitly demonstrate the validity of our model for a large homogeneous population of Poisson neurons with absolute refractoriness and other renewal models that admit an explicit analytical calculation of the eigenvalues. The eigenmode expansion presented here provides a systematic framework for alternative firing-rate models in computational neuroscience based on spiking neuron dynamics with refractoriness.

Reduction of the collective dynamics of neural populations with realistic forms of heterogeneity

Reduction of collective dynamics of large heterogeneous populations to low-dimensional mean-field models is an important task of modern theoretical neuroscience. Such models can be derived from microscopic equations, for example with the help of Ott-Antonsen theory. An often used assumption of the Lorentzian distribution of the unit parameters makes the reduction especially efficient. However, the Lorentzian distribution is often implausible as having undefined moments, and the collective behavior of populations with other distributions needs to be studied. In the present Letter we propose a method which allows efficient reduction for an arbitrary distribution and show how it performs for the Gaussian distribution. We show that a reduced system for several macroscopic complex variables provides an accurate description of a population of thousands of neurons. Using this reduction technique we demonstrate that the population dynamics depends significantly on the form of its parameter distribution. In particular, the dynamics of populations with Lorentzian and Gaussian distributions with the same center and width differ drastically.

Molecular mechanisms of action determine inhibition of paroxysmal depolarizing shifts by NMDA receptor antagonists in rat cortical neurons

N-methyl-d-aspartate glutamate receptors (NMDARs) are involved in numerous central nervous system (CNS) processes, including epileptiform activity. We used a picrotoxin-induced epileptiform activity model to compare the action of different types of NMDAR antagonists in rat brain slices. Paroxysmal depolarizing shifts (PDS) were evoked by external stimulation in the medial prefrontal cortex (mPFC) slices and recorded in pyramidal cells (PC) and in fast-spiking interneurons (FSI). The NMDAR antagonists APV and memantine reduced the duration of PDS. However, the competitive antagonist APV caused similar effects on the PC and FSI, while the open-channel blocker memantine had a much stronger effect on the PDS in the FSI than in the PC. This difference cannot be explained by a corresponding difference in NMDAR sensitivity to memantine because the drug inhibited the excitatory postsynaptic current (EPSC) similarly in both cell types. Importantly, the PDS were significantly longer in the FSI than in the PC. The degree of PDS inhibition by memantine correlated with individual PDS durations in each cell type. Computer modeling of a synaptic network in the mPFC suggests that the different effects of memantine on the PDS in the PC and FSI can be explained by use dependence of its action. An open-channel blocking mechanism and competition with Mg²⁺ ions for the binding site result in pronounced inhibition of the long PDS, whereas the short PDS are weakly sensitive. Our results show that peculiarities of kinetics and the mechanism of action largely determine the effects of NMDAR antagonists on physiological and/or pathological processes.

Refractory density model of cortical direction selectivity: Lagged-nonlagged, transient-sustained, and On-Off thalamic neuron-based mechanisms and intracortical amplification

A biophysically detailed description of the mechanisms of the primary vision is still being developed. We have incorporated a simplified, filter-based description of retino-thalamic visual signal processing into the detailed, conductance-based refractory density description of the neuronal population activity of the primary visual cortex. We compared four mechanisms of the direction selectivity (DS), three of them being based on asymmetrical projections of different types of thalamic neurons to the cortex, distinguishing between (i) lagged and nonlagged, (ii) transient and sustained, and (iii) On and Off neurons. The fourth mechanism implies a lack of subcortical bias and is an epiphenomenon of intracortical interactions between orientation columns. The simulations of the cortical response to moving gratings have verified that first three mechanisms provide DS to an extent compared with experimental data and that the biophysical model realistically reproduces characteristics of the visual cortex activity, such as membrane potential, firing rate, and synaptic conductances. The proposed model reveals the difference between the mechanisms of both the intact and the silenced cortex, favoring the second mechanism. In the fourth case, DS is weaker but significant; it completely vanishes in the silenced cortex.DS in the On-Off mechanism derives from the nonlinear interactions within the orientation map. Results of simulations can help to identify a prevailing mechanism of DS in V1. This is a step towards a comprehensive biophysical modeling of the primary visual system in the frameworks of the population rate coding concept.

A major mechanism that underlies tuning of cortical neurons to the direction of a moving stimulus is still debated. Considering the visual cortex structured with orientation-selective columns, we have realized and compared in our biophysically detailed mathematical model four hypothetical mechanisms of the direction selectivity (DS) known from experiments. The present model accomplishes our previous model that was tuned to experimental data on excitability in slices and reproduces orientation tuning effects in vivo. In simulations, we have found that the convergence of inputs from so-called transient and sustained (or lagged and nonlagged) thalamic neurons in the cortex provides an initial bias for DS, whereas cortical interactions amplify the tuning. In the absence of any bias, DS emerges as an epiphenomenon of the orientation map. In the case of a biased convergence of On- and Off- thalamic inputs, DS emerges with the help of the intracortical interactions on the orientation map, also. Thus, we have proposed a comprehensive description of the primary vision and revealed characteristic features of different mechanisms of DS in the visual cortex with columnar structure.

Inference of a Mesoscopic Population Model from Population Spike Trains

Understanding how rich dynamics emerge in neural populations requires models exhibiting a wide range of behaviors while remaining interpretable in terms of connectivity and single-neuron dynamics. However, it has been challenging to fit such mechanistic spiking networks at the single-neuron scale to empirical population data. To close this gap, we propose to fit such data at a mesoscale, using a mechanistic but low-dimensional and, hence, statistically tractable model. The mesoscopic representation is obtained by approximating a population of neurons as multiple homogeneous pools of neurons and modeling the dynamics of the aggregate population activity within each pool. We derive the likelihood of both single-neuron and connectivity parameters given this activity, which can then be used to optimize parameters by gradient ascent on the log likelihood or perform Bayesian inference using Markov chain Monte Carlo (MCMC) sampling. We illustrate this approach using a model of generalized integrate-and-fire neurons for which mesoscopic dynamics have been previously derived and show that both single-neuron and connectivity parameters can be recovered from simulated data. In particular, our inference method extracts posterior correlations between model parameters, which define parameter subsets able to reproduce the data. We compute the Bayesian posterior for combinations of parameters using MCMC sampling and investigate how the approximations inherent in a mesoscopic population model affect the accuracy of the inferred single-neuron parameters.

Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity

Coarse-graining microscopic models of biological neural networks to obtain mesoscopic models of neural activities is an essential step towards multi-scale models of the brain. Here, we extend a recent theory for mesoscopic population dynamics with static synapses to the case of dynamic synapses exhibiting short-term plasticity (STP). The extended theory offers an approximate mean-field dynamics for the synaptic input currents arising from populations of spiking neurons and synapses undergoing Tsodyks-Markram STP. The approximate mean-field dynamics accounts for both finite number of synapses and correlation between the two synaptic variables of the model (utilization and available resources) and its numerical implementation is simple. Comparisons with Monte Carlo simulations of the microscopic model show that in both feedforward and recurrent networks, the mesoscopic mean-field model accurately reproduces the first- and second-order statistics of the total synaptic input into a postsynaptic neuron and accounts for stochastic switches between Up and Down states and for population spikes. The extended mesoscopic population theory of spiking neural networks with STP may be useful for a systematic reduction of detailed biophysical models of cortical microcircuits to numerically efficient and mathematically tractable mean-field models.