Noise-induced precursors of state transitions in the stochastic Wilson-cowan model

Metabolic energetics underlying attractors in neural models

Neural population modeling, including the role of neural attractors, is a promising tool for understanding many aspects of brain function. We propose a modeling framework to connect the abstract variables used in modeling to recent cellular-level estimates of the bioenergetic costs of different aspects of neural activity, measured in ATP consumed per second per neuron. Based on recent work, an empirical reference for brain ATP use for the awake resting brain was estimated as ∼2 × 109 ATP/s-neuron across several mammalian species. The energetics framework was applied to the Wilson-Cowan (WC) model of two interacting populations of neurons, one excitatory (E) and one inhibitory (I). Attractors were considered to exhibit steady-state behavior and limit cycle behavior, both of which end when the excitatory stimulus ends, and sustained activity that persists after the stimulus ends. The energy cost of limit cycles, with oscillations much faster than the average neuronal firing rate of the population, is tracked more closely with the firing rate than the limit cycle frequency. Self-sustained firing driven by recurrent excitation, though, involves higher firing rates and a higher energy cost. As an example of a simple network in which each node is a WC model, a combination of three nodes can serve as a flexible circuit element that turns on with an oscillating output when input passes a threshold and then persists after the input ends (an "on-switch"), with moderate overall ATP use. The proposed framework can serve as a guide for anchoring neural population models to plausible bioenergetics requirements.NEW & NOTEWORTHY This work bridges two approaches for understanding brain function: cellular-level studies of the metabolic energy costs of different aspects of neural activity and neural population modeling, including the role of neural attractors. The proposed modeling framework connects energetic costs, in ATP consumed per second per neuron, to the more abstract variables used in neural population modeling. In particular, this work anchors potential neural attractors to physiologically plausible bioenergetics requirements.

Distance to Criticality Undergoes Critical Transition Before Epileptic Seizure Attacks

Epilepsy is a common neurological disorder characterized by recurring seizures, but its underlying mechanisms remain poorly understood. Despite extensive research, there are still gaps in our knowledge about the relationship between brain dynamics and seizures. In this study, our aim is to address these gaps by proposing a novel approach to assess the role of brain network dynamics in the onset of seizures. Specifically, we investigate the relationship between brain dynamics and seizures by tracking the distance to criticality. Our hypothesis is that this distance plays a crucial role in brain state changes and that seizures may be related to critical transitions of this distance. To test this hypothesis, we develop a method to measure the evolution of the brain network's distance to the critical dynamic systems (i.e., the distance to the tipping point, DTP) using dynamic network biomarker theory and random matrix theory. The results show that the DTP of the brain decreases significantly immediately after onset of an epileptic seizure, suggesting that the brain loses its well-defined quasi-critical state during seizures. We refer to this phenomenon as the "criticality of the criticality" (COC). Furthermore, we observe that DTP exhibits a shape transition before and after the onset of the seizures. This phenomenon suggests the possibility of early warning signal (EWS) identification in the dynamic sequence of DTP, which could be utilized for seizure prediction. Our results show that the Hurst exponent, skewness, kurtosis, autocorrelation, and variance of the DTP sequence are potential EWS features. This study advances our understanding of the relationship between brain dynamics and seizures and highlights the potential for using criticality-based measures to predict and prevent seizures.

Interplay between biochemical processes and network properties generates neuronal up and down states at the tripartite synapse

Neuronal up and down states have long been known to exist both in vitro and in vivo. A variety of functions and mechanisms have been proposed for their generation, but there has not been a clear connection between the functions and mechanisms. We explore the potential contribution of cellular-level biochemistry to the network-level mechanisms thought to underlie the generation of up and down states. We develop a neurochemical model of a single tripartite synapse, assumed to be within a network of similar tripartite synapses, to investigate possible function-mechanism links for the appearance of up and down states. We characterize the behavior of our model in different regions of parameter space and show that resource limitation at the tripartite synapse affects its ability to faithfully transmit input signals, leading to extinction-down states. Recovery of resources allows for "reignition" into up states. The tripartite synapse exhibits distinctive "regimes" of operation depending on whether ATP, neurotransmitter (glutamate), both, or neither, is limiting. Our model qualitatively matches the behavior of six disparate experimental systems, including both in vitro and in vivo models, without changing any model parameters except those related to the experimental conditions. We also explore the effects of varying different critical parameters within the model. Here we show that availability of energy, represented by ATP, and glutamate for neurotransmission at the cellular level are intimately related, and are capable of promoting state transitions at the network level as ignition and extinction phenomena. Our model is complementary to existing models of neuronal up and down states in that it focuses on cellular-level dynamics while still retaining essential network-level processes. Our model predicts the existence of a "final common pathway" of behavior at the tripartite synapse arising from scarcity of resources and may explain use dependence in the phenomenon of "local sleep." Ultimately, sleeplike behavior may be a fundamental property of networks of tripartite synapses.

Mechanistic modeling as an explanatory tool for clinical treatment of chronic catatonia

Mathematical modeling of neural systems is an effective means to integrate complex information about the brain into a numerical tool that can help explain observations. However, the use of neural models to inform clinical decisions has been limited. In this study, we use a simple model of brain circuitry, the Wilson-Cowan model, to predict changes in a clinical measure for catatonia, the Bush-Francis Catatonia Rating Scale, for use in clinical treatment of schizophrenia. This computational tool can then be used to better understand mechanisms of action for pharmaceutical treatments, and to fine-tune dosage in individual cases. We present the conditions of clinical care for a residential patient cohort, and describe methods for synthesizing data to demonstrated the functioning of the model. We then show that the model can be used to explain effect sizes of treatments and estimate outcomes for combinations of medications. We conclude with a demonstration of how this model could be personalized for individual patients to inform ongoing treatment protocols.

A neuromechanical model for Drosophila larval crawling based on physical measurements

BACKGROUND

Animal locomotion requires dynamic interactions between neural circuits, the body (typically muscles), and surrounding environments. While the neural circuitry of movement has been intensively studied, how these outputs are integrated with body mechanics (neuromechanics) is less clear, in part due to the lack of understanding of the biomechanical properties of animal bodies. Here, we propose an integrated neuromechanical model of movement based on physical measurements by taking Drosophila larvae as a model of soft-bodied animals.

RESULTS

We first characterized the kinematics of forward crawling in Drosophila larvae at a segmental and whole-body level. We then characterized the biomechanical parameters of fly larvae, namely the contraction forces generated by neural activity, and passive elastic and viscosity of the larval body using a stress-relaxation test. We established a mathematical neuromechanical model based on the physical measurements described above, obtaining seven kinematic values characterizing crawling locomotion. By optimizing the parameters in the neural circuit, our neuromechanical model succeeded in quantitatively reproducing the kinematics of larval locomotion that were obtained experimentally. This model could reproduce the observation of optogenetic studies reported previously. The model predicted that peristaltic locomotion could be exhibited in a low-friction condition. Analysis of floating larvae provided results consistent with this prediction. Furthermore, the model predicted a significant contribution of intersegmental connections in the central nervous system, which contrasts with a previous study. This hypothesis allowed us to make a testable prediction for the variability in intersegmental connection in sister species of the genus Drosophila.

CONCLUSIONS

We generated a neurochemical model based on physical measurement to provide a new foundation to study locomotion in soft-bodied animals and soft robot engineering.

Critical behaviour of the stochastic Wilson-Cowan model

Spontaneous brain activity is characterized by bursts and avalanche-like dynamics, with scale-free features typical of critical behaviour. The stochastic version of the celebrated Wilson-Cowan model has been widely studied as a system of spiking neurons reproducing non-trivial features of the neural activity, from avalanche dynamics to oscillatory behaviours. However, to what extent such phenomena are related to the presence of a genuine critical point remains elusive. Here we address this central issue, providing analytical results in the linear approximation and extensive numerical analysis. In particular, we present results supporting the existence of a bona fide critical point, where a second-order-like phase transition occurs, characterized by scale-free avalanche dynamics, scaling with the system size and a diverging relaxation time-scale. Moreover, our study shows that the observed critical behaviour falls within the universality class of the mean-field branching process, where the exponents of the avalanche size and duration distributions are, respectively, 3/2 and 2. We also provide an accurate analysis of the system behaviour as a function of the total number of neurons, focusing on the time correlation functions of the firing rate in a wide range of the parameter space.

Graph neural fields: A framework for spatiotemporal dynamical models on the human connectome

Tools from the field of graph signal processing, in particular the graph Laplacian operator, have recently been successfully applied to the investigation of structure-function relationships in the human brain. The eigenvectors of the human connectome graph Laplacian, dubbed "connectome harmonics", have been shown to relate to the functionally relevant resting-state networks. Whole-brain modelling of brain activity combines structural connectivity with local dynamical models to provide insight into the large-scale functional organization of the human brain. In this study, we employ the graph Laplacian and its properties to define and implement a large class of neural activity models directly on the human connectome. These models, consisting of systems of stochastic integrodifferential equations on graphs, are dubbed graph neural fields, in analogy with the well-established continuous neural fields. We obtain analytic predictions for harmonic and temporal power spectra, as well as functional connectivity and coherence matrices, of graph neural fields, with a technique dubbed CHAOSS (shorthand for Connectome-Harmonic Analysis Of Spatiotemporal Spectra). Combining graph neural fields with appropriate observation models allows for estimating model parameters from experimental data as obtained from electroencephalography (EEG), magnetoencephalography (MEG), or functional magnetic resonance imaging (fMRI). As an example application, we study a stochastic Wilson-Cowan graph neural field model on a high-resolution connectome graph constructed from diffusion tensor imaging (DTI) and structural MRI data. We show that the model equilibrium fluctuations can reproduce the empirically observed harmonic power spectrum of resting-state fMRI data, and predict its functional connectivity, with a high level of detail. Graph neural fields natively allow the inclusion of important features of cortical anatomy and fast computations of observable quantities for comparison with multimodal empirical data. They thus appear particularly suitable for modelling whole-brain activity at mesoscopic scales, and opening new potential avenues for connectome-graph-based investigations of structure-function relationships.

Active probing to highlight approaching transitions to ictal states in coupled neural mass models

The extraction of electrophysiological features that reliably forecast the occurrence of seizures is one of the most challenging goals in epilepsy research. Among possible approaches to tackle this problem is the use of active probing paradigms in which responses to stimuli are used to detect underlying system changes leading up to seizures. This work evaluates the theoretical and mechanistic underpinnings of this strategy using two coupled populations of the well-studied Wendling neural mass model. Different model settings are evaluated, shifting parameters (excitability, slow inhibition, or inter-population coupling gains) from normal towards ictal states while probing stimuli are applied every 2 seconds to the input of either one or both populations. The correlation between the extracted features and the ictogenic parameter shifting indicates if the impending transition to the ictal state may be identified in advance. Results show that not only can the response to the probing stimuli forecast seizures but this is true regardless of the altered ictogenic parameter. That is, similar feature changes are highlighted by probing stimuli responses in advance of the seizure including: increased response variance and lag-1 autocorrelation, decreased skewness, and increased mutual information between the outputs of both model subsets. These changes were mostly restricted to the stimulated population, showing a local effect of this perturbational approach. The transition latencies from normal activity to sustained discharges of spikes were not affected, suggesting that stimuli had no pro-ictal effects. However, stimuli were found to elicit interictal-like spikes just before the transition to the ictal state. Furthermore, the observed feature changes highlighted by probing the neuronal populations may reflect the phenomenon of critical slowing down, where increased recovery times from perturbations may signal the loss of a systems' resilience and are common hallmarks of an impending critical transition. These results provide more evidence that active probing approaches highlight information about underlying system changes involved in ictogenesis and may be able to play a role in assisting seizure forecasting methods which can be incorporated into early-warning systems that ultimately enable closing the loop for targeted seizure-controlling interventions.

Detecting and distinguishing tipping points using spectral early warning signals

Theory and observation tell us that many complex systems exhibit tipping points—thresholds involving an abrupt and irreversible transition to a contrasting dynamical regime. Such events are commonly referred to as critical transitions. Current research seeks to develop early warning signals (EWS) of critical transitions that could help prevent undesirable events such as ecosystem collapse. However, conventional EWS do not indicate the type of transition, since they are based on the generic phenomena of critical slowing down. For instance, they may fail to distinguish the onset of oscillations (e.g. Hopf bifurcation) from a transition to a distant attractor (e.g. Fold bifurcation). Moreover, conventional EWS are less reliable in systems with density-dependent noise. Other EWS based on the power spectrum (spectral EWS) have been proposed, but they rely upon spectral reddening, which does not occur prior to critical transitions with an oscillatory component. Here, we use Ornstein–Uhlenbeck theory to derive analytic approximations for EWS prior to each type of local bifurcation, thereby creating new spectral EWS that provide greater sensitivity to transition proximity; higher robustness to density-dependent noise and bifurcation type; and clues to the type of approaching transition. We demonstrate the advantage of applying these spectral EWS in concert with conventional EWS using a population model, and show that they provide a characteristic signal prior to two different Hopf bifurcations in data from a predator–prey chemostat experiment. The ability to better infer and differentiate the nature of upcoming transitions in complex systems will help humanity manage critical transitions in the Anthropocene Era.

Neurostimulation stabilizes spiking neural networks by disrupting seizure-like oscillatory transitions

An improved understanding of the mechanisms underlying neuromodulatory approaches to mitigate seizure onset is needed to identify clinical targets for the treatment of epilepsy. Using a Wilson–Cowan-motivated network of inhibitory and excitatory populations, we examined the role played by intrinsic and extrinsic stimuli on the network’s predisposition to sudden transitions into oscillatory dynamics, similar to the transition to the seizure state. Our joint computational and mathematical analyses revealed that such stimuli, be they noisy or periodic in nature, exert a stabilizing influence on network responses, disrupting the development of such oscillations. Based on a combination of numerical simulations and mean-field analyses, our results suggest that high variance and/or high frequency stimulation waveforms can prevent multi-stability, a mathematical harbinger of sudden changes in network dynamics. By tuning the neurons’ responses to input, stimuli stabilize network dynamics away from these transitions. Furthermore, our research shows that such stabilization of neural activity occurs through a selective recruitment of inhibitory cells, providing a theoretical undergird for the known key role these cells play in both the healthy and diseased brain. Taken together, these findings provide new vistas on neuromodulatory approaches to stabilize neural microcircuit activity.

Critical slowing down as a biomarker for seizure susceptibility

The human brain has the capacity to rapidly change state, and in epilepsy these state changes can be catastrophic, resulting in loss of consciousness, injury and even death. Theoretical interpretations considering the brain as a dynamical system suggest that prior to a seizure, recorded brain signals may exhibit critical slowing down, a warning signal preceding many critical transitions in dynamical systems. Using long-term intracranial electroencephalography (iEEG) recordings from fourteen patients with focal epilepsy, we monitored key signatures of critical slowing down prior to seizures. The metrics used to detect critical slowing down fluctuated over temporally long scales (hours to days), longer than would be detectable in standard clinical evaluation settings. Seizure risk was associated with a combination of these signals together with epileptiform discharges. These results provide strong validation of theoretical models and demonstrate that critical slowing down is a reliable indicator that could be used in seizure forecasting algorithms.

Critical slowing (associated with increased variance and autocorrelation) can precede critical state transitions. Here, the authors show critical slowing can be used as a marker in seizure forecasting algorithms.

Spinodal decomposition in a mean-field model of the cortex: Emergence of hexagonally symmetric activation patterns

Spinodal decomposition is a well-known pattern-forming mechanism in metallurgic alloys, semiconductor crystals, and colloidal gels. In metallurgy, if a heated sample of a homogeneous Zn-Al alloy is suddenly quenched below a critical temperature, then the sample can spontaneously precipitate into inhomogenous textures of Zn- and Al-rich regions with significantly altered material properties such as ductility and hardness. Here we report on our recent discovery that a two-dimensional model of the human cortex with inhibitory diffusion can, under particular homogeneous initial conditions, exhibit a form of nonconserved spinodal decomposition in which regions of the cortex self-organize into hexagonally distributed binary patches of activity and inactivity. Fine-scale patterns precipitate rapidly, and then the dynamics slows to render coarser-scale shapes which can ripen into a range of slowly evolving patterns including mazelike labyrinths, hexagonal islands and continents, nucleating "mitotic cells" which grow to a critical size then subdivide, and inverse nucleations in which quiescent islands are surrounded by a sea of activity. One interesting class of activity coalesces into a soliton-like narrow ribbon of depolarization that traverses the cortex at ∼4cm/s. We speculate that this may correspond to the thus far unexplained interictal waves of cortical activation that precede grand-mal seizure in an epileptic event. We note that spinodal decomposition is quite distinct from the Turing mechanism for symmetry breaking in cortex investigated in earlier work by the authors [Steyn-Ross et al., Phys. Rev. E 76, 011916 (2007)PLEEE81539-375510.1103/PhysRevE.76.011916].

A forward-looking review of seizure prediction

PURPOSE OF REVIEW

Seizure prediction has made important advances over the last decade, with the recent demonstration that prospective seizure prediction is possible, though there remain significant obstacles to broader application. In this review, we will describe insights gained from long-term trials, with the aim of identifying research goals for the next decade.

RECENT FINDINGS

Unexpected results from these studies, including strong and highly individual relationships between spikes and seizures, diurnal patterns of seizure activity, and the coexistence of different seizure populations within individual patients exhibiting distinctive dynamics, have caused us to re-evaluate many prior assumptions in seizure prediction studies and suggest alternative strategies that could be employed in the search for algorithms providing greater clinical utility. Advances in analytical approaches, particularly deep-learning techniques, harbour great promise and in combination with less-invasive systems with sufficiently power-efficient computational capacity will bring broader clinical application within reach.

SUMMARY

We conclude the review with an exercise in wishful thinking, which asks what the ideal seizure prediction dataset would look like and how these data should be manipulated to maximize benefits for patients. The motivation for structuring the review in this way is to create a forward-looking, optimistic critique of the existing methodologies.

Noise-driven neuromorphic tuned amplifier

We study a simple stochastic model of neuronal excitatory and inhibitory interactions. The model is defined on a directed lattice and internodes couplings are modulated by a nonlinear function that mimics the process of synaptic activation. We prove that such a system behaves as a fully tunable amplifier: the endogenous component of noise, stemming from finite size effects, seeds a coherent (exponential) amplification across the chain generating giant oscillations with tunable frequencies, a process that the brain could exploit to enhance, and eventually encode, different signals. On a wider perspective, the characterized amplification process could provide a reliable pacemaking mechanism for biological systems. The device extracts energy from the finite size bath and operates as an out of equilibrium thermal machine, under stationary conditions.

Intertangled stochastic motifs in networks of excitatory-inhibitory units

A stochastic model of excitatory and inhibitory interactions which bears universality traits is introduced and studied. The endogenous component of noise, stemming from finite size corrections, drives robust internode correlations that persist at large distances. Antiphase synchrony at small frequencies is resolved on adjacent nodes and found to promote the spontaneous generation of long-ranged stochastic patterns that invade the network as a whole. These patterns are lacking under the idealized deterministic scenario, and could provide hints on how living systems implement and handle a large gallery of delicate computational tasks.

Stochastic Network Models in Neuroscience: A Festschrift for Jack Cowan. Introduction to the Special Issue

Jack Cowan's remarkable career has spanned, and molded, the development of neuroscience as a quantitative and mathematical discipline combining deep theoretical contributions, rigorous mathematical work and groundbreaking biological insights. The Banff International Research Station hosted a workshop in his honor, on Stochastic Network Models of Neocortex, July 17-24, 2014. This accompanying Festschrift celebrates Cowan's contributions by assembling current research in stochastic phenomena in neural networks. It combines historical perspectives with new results including applications to epilepsy, path-integral methods, stochastic synchronization, higher-order correlation analysis, and pattern formation in visual cortex.

Which System Variables Carry Robust Early Signs of Upcoming Phase Transition? An Ecological Example

Growth of critical fluctuations prior to catastrophic state transition is generally regarded as a universal phenomenon, providing a valuable early warning signal in dynamical systems. Using an ecological fisheries model of three populations (juvenile prey J, adult prey A and predator P), a recent study has reported silent early warning signals obtained from P and A populations prior to saddle-node (SN) bifurcation, and thus concluded that early warning signals are not universal. By performing a full eigenvalue analysis of the same system we demonstrate that while J and P populations undergo SN bifurcation, A does not jump to a new state, so it is not expected to carry early warning signs. In contrast with the previous study, we capture a significant increase in the noise-induced fluctuations in the P population, but only on close approach to the bifurcation point; it is not clear why the P variance initially shows a decaying trend. Here we resolve this puzzle using observability measures from control theory. By computing the observability coefficient for the system from the recordings of each population considered one at a time, we are able to quantify their ability to describe changing internal dynamics. We demonstrate that precursor fluctuations are best observed using only the J variable, and also P variable if close to transition. Using observability analysis we are able to describe why a poorly observable variable (P) has poor forecasting capabilities although a full eigenvalue analysis shows that this variable undergoes a bifurcation. We conclude that observability analysis provides complementary information to identify the variables carrying early-warning signs about impending state transition.

Multiscale modeling of brain dynamics: from single neurons and networks to mathematical tools

The extreme complexity of the brain naturally requires mathematical modeling approaches on a large variety of scales; the spectrum ranges from single neuron dynamics over the behavior of groups of neurons to neuronal network activity. Thus, the connection between the microscopic scale (single neuron activity) to macroscopic behavior (emergent behavior of the collective dynamics) and vice versa is a key to understand the brain in its complexity. In this work, we attempt a review of a wide range of approaches, ranging from the modeling of single neuron dynamics to machine learning. The models include biophysical as well as data-driven phenomenological models. The discussed models include Hodgkin-Huxley, FitzHugh-Nagumo, coupled oscillators (Kuramoto oscillators, Rössler oscillators, and the Hindmarsh-Rose neuron), Integrate and Fire, networks of neurons, and neural field equations. In addition to the mathematical models, important mathematical methods in multiscale modeling and reconstruction of the causal connectivity are sketched. The methods include linear and nonlinear tools from statistics, data analysis, and time series analysis up to differential equations, dynamical systems, and bifurcation theory, including Granger causal connectivity analysis, phase synchronization connectivity analysis, principal component analysis (PCA), independent component analysis (ICA), and manifold learning algorithms such as ISOMAP, and diffusion maps and equation-free techniques. WIREs Syst Biol Med 2016, 8:438-458. doi: 10.1002/wsbm.1348 For further resources related to this article, please visit the WIREs website.

Seizure Prediction: Science Fiction or Soon to Become Reality?

This review highlights recent developments in the field of epileptic seizure prediction. We argue that seizure prediction is possible; however, most previous attempts have used data with an insufficient amount of information to solve the problem. The review discusses four methods for gaining more information above standard clinical electrophysiological recordings. We first discuss developments in obtaining long-term data that enables better characterisation of signal features and trends. Then, we discuss the usage of electrical stimulation to probe neural circuits to obtain robust information regarding excitability. Following this, we present a review of developments in high-resolution micro-electrode technologies that enable neuroimaging across spatial scales. Finally, we present recent results from data-driven model-based analyses, which enable imaging of seizure generating mechanisms from clinical electrophysiological measurements. It is foreseeable that the field of seizure prediction will shift focus to a more probabilistic forecasting approach leading to improvements in the quality of life for the millions of people who suffer uncontrolled seizures. However, a missing piece of the puzzle is devices to acquire long-term high-quality data. When this void is filled, seizure prediction will become a reality.